Jun 02 04:42:32.083068 ip-10-0-132-27 systemd[1]: Starting Kubernetes Kubelet... Jun 02 04:42:32.570064 ip-10-0-132-27 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:42:32.570064 ip-10-0-132-27 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 04:42:32.570064 ip-10-0-132-27 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:42:32.570064 ip-10-0-132-27 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 04:42:32.570064 ip-10-0-132-27 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:42:32.573235 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.573133 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 04:42:32.578958 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578941 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:32.578958 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578958 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:32.578958 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578961 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578965 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578968 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578972 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578974 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578977 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578980 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578982 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578985 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578987 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578989 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578992 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578995 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.578999 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579003 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579006 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579009 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579011 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579014 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:32.579060 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579017 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579019 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579022 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579025 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579035 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579038 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579041 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579043 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579046 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579049 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579051 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579054 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579056 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579059 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579061 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579064 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579067 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579069 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579072 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579075 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:32.579499 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579077 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579080 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579082 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579085 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579087 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579090 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579092 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579096 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579098 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579101 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579103 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579106 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579108 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579110 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579114 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579117 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579119 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579121 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579124 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579127 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:32.580103 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579129 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579132 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579134 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579136 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579139 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579141 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579144 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579146 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579149 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579151 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579154 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579156 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579158 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579161 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579164 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579167 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579169 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579173 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579176 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:32.580623 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579179 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579181 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579183 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579187 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579191 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579193 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579594 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579599 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579602 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579605 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579607 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579610 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579612 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579615 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579618 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579621 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579623 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579626 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579628 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579630 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:32.581094 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579633 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579635 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579638 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579640 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579642 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579645 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579657 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579661 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579663 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579666 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579669 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579671 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579673 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579676 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579679 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579682 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579701 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579704 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579707 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:32.581587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579711 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579714 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579716 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579719 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579722 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579724 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579727 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579729 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579732 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579734 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579739 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579743 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579746 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579749 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579751 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579754 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579756 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579759 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579761 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:32.582068 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579788 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579792 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579797 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579802 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579805 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579807 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579810 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579812 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579815 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579818 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579820 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579823 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579826 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579828 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579831 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579834 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579837 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579839 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579842 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579844 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:32.582561 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579849 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579853 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579855 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579858 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579860 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579863 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579865 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579867 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579870 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579872 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579875 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579877 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579880 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.579884 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579958 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579967 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579976 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579982 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579989 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579994 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.579998 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 04:42:32.583069 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580003 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580007 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580010 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580014 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580017 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580021 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580024 2563 flags.go:64] FLAG: --cgroup-root="" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580027 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580030 2563 flags.go:64] FLAG: --client-ca-file="" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580032 2563 flags.go:64] FLAG: --cloud-config="" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580035 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580037 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580042 2563 flags.go:64] FLAG: --cluster-domain="" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580045 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580048 2563 flags.go:64] FLAG: --config-dir="" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580051 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580054 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580058 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580061 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580064 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580067 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580070 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580073 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580076 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580079 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 04:42:32.583566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580082 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580086 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580089 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580092 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580095 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580098 2563 flags.go:64] FLAG: --enable-server="true" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580101 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580106 2563 flags.go:64] FLAG: --event-burst="100" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580109 2563 flags.go:64] FLAG: --event-qps="50" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580112 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580115 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580119 2563 flags.go:64] FLAG: --eviction-hard="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580123 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580126 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580129 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580132 2563 flags.go:64] FLAG: --eviction-soft="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580135 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580137 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580140 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580143 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580146 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580148 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580151 2563 flags.go:64] FLAG: --feature-gates="" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580155 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580158 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 04:42:32.584206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580161 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580164 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580167 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580169 2563 flags.go:64] FLAG: --help="false" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580173 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580176 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580179 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580182 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580185 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580188 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580191 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580194 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580197 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580199 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580207 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580210 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580213 2563 flags.go:64] FLAG: --kube-reserved="" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580215 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580219 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580222 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580224 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580227 2563 flags.go:64] FLAG: --lock-file="" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580230 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580233 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 04:42:32.584829 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580236 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580241 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580244 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580247 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580250 2563 flags.go:64] FLAG: --logging-format="text" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580252 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580255 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580258 2563 flags.go:64] FLAG: --manifest-url="" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580261 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580266 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580269 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580273 2563 flags.go:64] FLAG: --max-pods="110" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580275 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580278 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580281 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580284 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580287 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580290 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580293 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580301 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580304 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580307 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580311 2563 flags.go:64] FLAG: --pod-cidr="" Jun 02 04:42:32.585382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580313 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580319 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580322 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580325 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580328 2563 flags.go:64] FLAG: --port="10250" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580331 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580334 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dcd3c5cc33500415" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580338 2563 flags.go:64] FLAG: --qos-reserved="" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580340 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580343 2563 flags.go:64] FLAG: --register-node="true" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580346 2563 flags.go:64] FLAG: --register-schedulable="true" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580349 2563 flags.go:64] FLAG: --register-with-taints="" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580352 2563 flags.go:64] FLAG: --registry-burst="10" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580355 2563 flags.go:64] FLAG: --registry-qps="5" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580358 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580361 2563 flags.go:64] FLAG: --reserved-memory="" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580364 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580368 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580370 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580373 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580377 2563 flags.go:64] FLAG: --runonce="false" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580380 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580383 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580385 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580388 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580391 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 04:42:32.585928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580394 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580397 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580400 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580404 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580407 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580410 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580414 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580417 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580420 2563 flags.go:64] FLAG: --system-cgroups="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580423 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580428 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580430 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580433 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580438 2563 flags.go:64] FLAG: --tls-min-version="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580440 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580443 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580446 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580448 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580451 2563 flags.go:64] FLAG: --v="2" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580455 2563 flags.go:64] FLAG: --version="false" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580459 2563 flags.go:64] FLAG: --vmodule="" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580465 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.580468 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580559 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:32.586548 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580562 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580566 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580570 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580573 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580575 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580578 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580581 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580584 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580586 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580589 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580591 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580594 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580597 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580599 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580603 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580605 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580608 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580611 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580613 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:32.587140 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580616 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580618 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580620 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580623 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580625 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580628 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580631 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580633 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580636 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580638 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580641 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580643 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580646 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580648 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580650 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580657 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580659 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580662 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580664 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580666 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:32.587594 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580669 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580672 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580674 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580676 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580679 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580682 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580684 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580688 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580691 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580693 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580696 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580698 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580701 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580703 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580706 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580708 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580711 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580713 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580715 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580718 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:32.588123 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580721 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580723 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580725 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580728 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580730 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580733 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580735 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580739 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580741 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580745 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580749 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580752 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580756 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580760 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580777 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580781 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580784 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580787 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580790 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580806 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:32.588662 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580809 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580812 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580815 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580818 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580820 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.580824 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.581729 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.588370 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.588386 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588434 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588440 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588443 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588446 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588449 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588452 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588455 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:32.589191 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588457 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588460 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588463 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588465 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588467 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588470 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588472 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588475 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588478 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588480 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588483 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588486 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588489 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588491 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588494 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588497 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588499 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588502 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588504 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588507 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:32.589587 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588510 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588513 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588515 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588518 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588522 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588524 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588527 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588529 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588532 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588534 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588537 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588541 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588545 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588548 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588552 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588555 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588558 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588560 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588563 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:32.590083 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588565 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588568 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588571 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588573 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588576 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588578 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588581 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588583 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588587 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588589 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588592 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588594 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588597 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588600 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588602 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588605 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588607 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588610 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588614 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:32.590571 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588616 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588619 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588621 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588624 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588626 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588629 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588631 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588633 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588636 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588639 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588641 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588643 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588646 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588648 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588651 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588653 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588657 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588661 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588664 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588666 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:32.591053 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588669 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.588675 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588809 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588816 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588818 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588821 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588823 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588826 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588828 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588831 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588833 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588836 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588845 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588848 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588850 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:32.591516 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588854 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588858 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588860 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588863 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588865 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588868 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588870 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588873 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588875 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588878 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588880 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588883 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588885 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588888 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588890 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588893 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588895 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588897 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588900 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588903 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:32.591978 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588905 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588907 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588910 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588912 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588915 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588917 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588920 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588922 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588925 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588927 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588931 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588933 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588935 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588937 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588940 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588942 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588944 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588947 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588949 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588951 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:32.592465 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588954 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588956 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588959 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588961 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588963 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588966 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588968 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588971 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588973 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588975 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588978 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588980 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588983 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588985 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588988 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588990 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588992 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588995 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588997 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.588999 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:32.592962 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589002 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589004 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589007 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589009 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589011 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589014 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589016 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589018 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589021 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589023 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589026 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589028 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:32.589032 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.589037 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.589158 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 04:42:32.593442 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.591219 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 04:42:32.593811 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.593081 2563 server.go:1019] "Starting client certificate rotation" Jun 02 04:42:32.593811 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.593173 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 04:42:32.593811 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.593199 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 04:42:32.620732 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.620708 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 04:42:32.625841 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.625815 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 04:42:32.641149 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.641114 2563 log.go:25] "Validated CRI v1 runtime API" Jun 02 04:42:32.647977 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.647824 2563 log.go:25] "Validated CRI v1 image API" Jun 02 04:42:32.649263 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.649246 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 04:42:32.651094 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.651076 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 04:42:32.651843 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.651820 2563 fs.go:135] Filesystem UUIDs: map[15679ec1-09ef-4cef-a1e9-fae52a60ae81:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e7464013-aff8-4c91-925c-920725f4dc49:/dev/nvme0n1p4] Jun 02 04:42:32.651915 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.651841 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 04:42:32.656195 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.656067 2563 manager.go:217] Machine: {Timestamp:2026-06-02 04:42:32.655520536 +0000 UTC m=+0.437781998 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3180092 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c631bbc5b7c8db4a97314f3bd54ed SystemUUID:ec2c631b-bc5b-7c8d-b4a9-7314f3bd54ed BootID:27863f53-5852-4658-aa13-04a2288c1ef6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:2d:07:f6:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:2d:07:f6:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:ce:7c:53:12:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 04:42:32.656921 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.656906 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 04:42:32.657033 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.657017 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 04:42:32.660360 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.660331 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 04:42:32.660506 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.660363 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 04:42:32.660556 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.660516 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 04:42:32.660556 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.660524 2563 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 04:42:32.660556 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.660532 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 04:42:32.660556 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.660545 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 04:42:32.661373 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.661362 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 02 04:42:32.661491 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.661482 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 04:42:32.663903 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.663893 2563 kubelet.go:491] "Attempting to sync node with API server" Jun 02 04:42:32.663938 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.663907 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 04:42:32.663938 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.663919 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 04:42:32.663938 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.663928 2563 kubelet.go:397] "Adding apiserver pod source" Jun 02 04:42:32.663938 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.663937 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 04:42:32.667966 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.667944 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 04:42:32.668025 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.667981 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 04:42:32.671568 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.671553 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 04:42:32.673618 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.673602 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 04:42:32.675906 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675892 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 04:42:32.675985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675914 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 04:42:32.675985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675924 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 04:42:32.675985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675932 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 04:42:32.675985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675945 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 04:42:32.675985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675955 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 04:42:32.675985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675965 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 04:42:32.676189 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.675990 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 04:42:32.676189 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.676000 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 04:42:32.676189 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.676010 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 04:42:32.676189 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.676029 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 04:42:32.676189 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.676038 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 04:42:32.677145 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.677126 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 04:42:32.677207 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.677167 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 04:42:32.677350 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.677029 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 04:42:32.677646 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.677605 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 04:42:32.678624 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.678599 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzzwt" Jun 02 04:42:32.681122 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.681108 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 04:42:32.681209 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.681200 2563 server.go:1295] "Started kubelet" Jun 02 04:42:32.681290 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.681260 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 04:42:32.681356 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.681309 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 04:42:32.681389 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.681376 2563 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 04:42:32.682140 ip-10-0-132-27 systemd[1]: Started Kubernetes Kubelet. Jun 02 04:42:32.682720 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.682707 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 04:42:32.684410 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.684394 2563 server.go:317] "Adding debug handlers to kubelet server" Jun 02 04:42:32.685438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.685421 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzzwt" Jun 02 04:42:32.689541 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.689524 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 04:42:32.690031 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.690012 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 04:42:32.690145 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690036 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 04:42:32.690297 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690276 2563 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 04:42:32.690355 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690298 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 04:42:32.690403 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690388 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 04:42:32.690451 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690439 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 02 04:42:32.690451 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690447 2563 reconciler.go:26] "Reconciler: start to sync state" Jun 02 04:42:32.690727 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.690708 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 04:42:32.690960 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.690906 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:32.691120 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691107 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 04:42:32.691120 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691119 2563 factory.go:55] Registering systemd factory Jun 02 04:42:32.691225 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691125 2563 factory.go:223] Registration of the systemd container factory successfully Jun 02 04:42:32.691340 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691327 2563 factory.go:153] Registering CRI-O factory Jun 02 04:42:32.691340 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691341 2563 factory.go:223] Registration of the crio container factory successfully Jun 02 04:42:32.691437 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691354 2563 factory.go:103] Registering Raw factory Jun 02 04:42:32.691437 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691367 2563 manager.go:1196] Started watching for new ooms in manager Jun 02 04:42:32.691799 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.690680 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-27.ec2.internal.18b529f34f6b4cb0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-27.ec2.internal,UID:ip-10-0-132-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-27.ec2.internal,},FirstTimestamp:2026-06-02 04:42:32.681122992 +0000 UTC m=+0.463384435,LastTimestamp:2026-06-02 04:42:32.681122992 +0000 UTC m=+0.463384435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-27.ec2.internal,}" Jun 02 04:42:32.691905 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.691890 2563 manager.go:319] Starting recovery of all containers Jun 02 04:42:32.694145 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.694119 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:32.697358 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.697336 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-27.ec2.internal\" not found" node="ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.704293 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.704273 2563 manager.go:324] Recovery completed Jun 02 04:42:32.708375 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.708363 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:32.710536 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.710519 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:32.710597 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.710550 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:32.710597 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.710559 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:32.711109 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.711094 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 04:42:32.711109 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.711106 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 04:42:32.711247 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.711137 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 02 04:42:32.713673 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.713659 2563 policy_none.go:49] "None policy: Start" Jun 02 04:42:32.713752 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.713679 2563 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 04:42:32.713752 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.713694 2563 state_mem.go:35] "Initializing new in-memory state store" Jun 02 04:42:32.757381 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757363 2563 manager.go:341] "Starting Device Plugin manager" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.757403 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757416 2563 server.go:85] "Starting device plugin registration server" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757706 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757716 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757829 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757934 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.757945 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.758416 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 04:42:32.763402 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.758451 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:32.834306 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.834230 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 04:42:32.835587 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.835570 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 04:42:32.835710 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.835597 2563 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 04:42:32.835710 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.835623 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 04:42:32.835710 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.835632 2563 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 04:42:32.835710 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.835705 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 04:42:32.837977 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.837958 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:32.857985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.857951 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:32.858893 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.858877 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:32.858952 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.858907 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:32.858952 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.858917 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:32.859063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.858963 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.868909 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.868894 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.868983 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.868917 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-27.ec2.internal\": node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:32.883816 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.883789 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:32.936872 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.936827 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal"] Jun 02 04:42:32.936970 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.936928 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:32.938728 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.938712 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:32.938817 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.938742 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:32.938817 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.938751 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:32.940036 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940022 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:32.940203 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940186 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.940264 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940217 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:32.940818 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940791 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:32.940892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940821 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:32.940892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940831 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:32.940892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940840 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:32.940892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940846 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:32.940892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.940851 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:32.942054 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.942039 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.942109 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.942071 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:32.942816 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.942802 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:32.942876 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.942825 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:32.942876 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.942837 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:32.967484 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.967465 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-27.ec2.internal\" not found" node="ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.972047 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.972029 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-27.ec2.internal\" not found" node="ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.984197 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:32.984176 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:32.992632 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.992615 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6aedcff271f357909731b7f93c1315e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-27.ec2.internal\" (UID: \"6aedcff271f357909731b7f93c1315e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.992716 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.992641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/276288898e5c2c660e5b3e80d2e2bbe3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"276288898e5c2c660e5b3e80d2e2bbe3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:32.992716 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:32.992662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/276288898e5c2c660e5b3e80d2e2bbe3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"276288898e5c2c660e5b3e80d2e2bbe3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.084782 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.084690 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.093377 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.093353 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6aedcff271f357909731b7f93c1315e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-27.ec2.internal\" (UID: \"6aedcff271f357909731b7f93c1315e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.093438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.093380 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/276288898e5c2c660e5b3e80d2e2bbe3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"276288898e5c2c660e5b3e80d2e2bbe3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.093438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.093403 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/276288898e5c2c660e5b3e80d2e2bbe3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"276288898e5c2c660e5b3e80d2e2bbe3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.093438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.093433 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/276288898e5c2c660e5b3e80d2e2bbe3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"276288898e5c2c660e5b3e80d2e2bbe3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.093545 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.093448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6aedcff271f357909731b7f93c1315e3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-27.ec2.internal\" (UID: \"6aedcff271f357909731b7f93c1315e3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.093545 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.093475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/276288898e5c2c660e5b3e80d2e2bbe3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal\" (UID: \"276288898e5c2c660e5b3e80d2e2bbe3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.185025 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.184994 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.269505 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.269482 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.275078 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.275057 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.285810 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.285792 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.386374 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.386278 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.486808 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.486758 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.587304 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.587269 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.593592 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.593579 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 04:42:33.593754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.593738 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 04:42:33.593840 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.593800 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 04:42:33.687400 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.687362 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.688459 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.688424 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 04:37:32 +0000 UTC" deadline="2028-02-27 04:37:26.56883808 +0000 UTC" Jun 02 04:42:33.688512 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.688460 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15239h54m52.880381311s" Jun 02 04:42:33.690651 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.690626 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 04:42:33.715725 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.715700 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 04:42:33.757014 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:33.756976 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276288898e5c2c660e5b3e80d2e2bbe3.slice/crio-9c7507ab0b19ef9bdfdd23d2fca16d89081faf82e0824dc5b9b175be226352a7 WatchSource:0}: Error finding container 9c7507ab0b19ef9bdfdd23d2fca16d89081faf82e0824dc5b9b175be226352a7: Status 404 returned error can't find the container with id 9c7507ab0b19ef9bdfdd23d2fca16d89081faf82e0824dc5b9b175be226352a7 Jun 02 04:42:33.757206 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:33.757186 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aedcff271f357909731b7f93c1315e3.slice/crio-33e3f5efa7e396941ac454632ac5dc31d564bf6b2992e7663e5e90c4539add1d WatchSource:0}: Error finding container 33e3f5efa7e396941ac454632ac5dc31d564bf6b2992e7663e5e90c4539add1d: Status 404 returned error can't find the container with id 33e3f5efa7e396941ac454632ac5dc31d564bf6b2992e7663e5e90c4539add1d Jun 02 04:42:33.759784 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.759739 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhlvq" Jun 02 04:42:33.762892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.762878 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:42:33.788025 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:33.788002 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-27.ec2.internal\" not found" Jun 02 04:42:33.789622 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.789605 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhlvq" Jun 02 04:42:33.839096 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.839045 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" event={"ID":"6aedcff271f357909731b7f93c1315e3","Type":"ContainerStarted","Data":"33e3f5efa7e396941ac454632ac5dc31d564bf6b2992e7663e5e90c4539add1d"} Jun 02 04:42:33.839931 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.839911 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" event={"ID":"276288898e5c2c660e5b3e80d2e2bbe3","Type":"ContainerStarted","Data":"9c7507ab0b19ef9bdfdd23d2fca16d89081faf82e0824dc5b9b175be226352a7"} Jun 02 04:42:33.852693 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.852677 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:33.890799 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.890775 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.903267 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.903244 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 04:42:33.905479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.905463 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" Jun 02 04:42:33.915942 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:33.915889 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 04:42:34.021135 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.021107 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:34.665617 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.665584 2563 apiserver.go:52] "Watching apiserver" Jun 02 04:42:34.673111 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.673078 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 04:42:34.673503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.673481 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-zrjs7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v","openshift-cluster-node-tuning-operator/tuned-9sn6q","openshift-multus/multus-dzwck","openshift-network-diagnostics/network-check-target-mm6qg","openshift-network-operator/iptables-alerter-cmgnp","openshift-ovn-kubernetes/ovnkube-node-nmhf8","kube-system/global-pull-secret-syncer-6tkmn","kube-system/konnectivity-agent-4jcw2","kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal","openshift-image-registry/node-ca-tkmbg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal","openshift-multus/multus-additional-cni-plugins-cnx4c"] Jun 02 04:42:34.675816 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.675796 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.677108 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.677085 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.678264 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.678245 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.678809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.678428 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 04:42:34.678809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.678717 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p7whw\"" Jun 02 04:42:34.679042 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679017 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 04:42:34.679280 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679256 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 04:42:34.679357 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679308 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 04:42:34.679411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679352 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 04:42:34.679517 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679499 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5j8p2\"" Jun 02 04:42:34.679517 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679516 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 04:42:34.679754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679608 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 04:42:34.679939 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.679925 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 04:42:34.681115 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.680009 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 04:42:34.681452 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.681435 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:42:34.683629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.681831 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xrr7\"" Jun 02 04:42:34.683629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.681897 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 04:42:34.683629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.682394 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.684804 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.684018 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:34.684804 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.684111 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:34.684804 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.684130 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.685125 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.685105 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 04:42:34.685266 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.685240 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 04:42:34.685350 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.685340 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 04:42:34.685420 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.685399 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 04:42:34.685752 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.685737 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhbcw\"" Jun 02 04:42:34.687565 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.687548 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rpwqk\"" Jun 02 04:42:34.687633 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.687599 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:42:34.687865 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.687848 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 04:42:34.687930 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.687884 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 04:42:34.688983 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.688880 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:34.688983 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.688945 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:34.688983 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.688959 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.690164 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.690146 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.691135 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.691113 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 04:42:34.691285 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.691269 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4fwb9\"" Jun 02 04:42:34.691368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.691355 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 04:42:34.691596 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.691583 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.692309 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.692290 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 04:42:34.692623 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.692605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 04:42:34.692718 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.692605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 04:42:34.692805 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.692757 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c27cb\"" Jun 02 04:42:34.692984 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.692969 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.693058 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.693022 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:34.693892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.693856 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 04:42:34.693995 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.693907 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mkxkz\"" Jun 02 04:42:34.694078 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.694032 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-etc-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703506 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703561 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62mst\" (UniqueName: \"kubernetes.io/projected/88285037-dc2e-405c-a1c6-d4358e2db5c2-kube-api-access-62mst\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-sys\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-hostroot\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703644 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-node-log\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703680 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-cni-bin\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-systemd\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj65w\" (UniqueName: \"kubernetes.io/projected/9313302a-59af-4923-a991-06bf17a1dd7b-kube-api-access-fj65w\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-k8s-cni-cncf-io\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-host-slash\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zcj8\" (UniqueName: \"kubernetes.io/projected/b5b920bb-c69e-4df4-9978-67bc26f91798-kube-api-access-5zcj8\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-cnibin\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.704063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-cni-bin\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-cni-multus\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.703964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704000 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-etc-kubernetes\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cnibin\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-slash\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-log-socket\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704105 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-cni-binary-copy\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-netns\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbhpn\" (UniqueName: \"kubernetes.io/projected/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-kube-api-access-pbhpn\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb49v\" (UniqueName: \"kubernetes.io/projected/aad941c8-a1aa-42b0-b94a-96ce43c6273d-kube-api-access-gb49v\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-cni-netd\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-modprobe-d\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysconfig\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysctl-d\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-lib-modules\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.704848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704321 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9313302a-59af-4923-a991-06bf17a1dd7b-tmp\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-socket-dir-parent\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-daemon-config\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-multus-certs\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704418 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-kubelet\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-env-overrides\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-os-release\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-iptables-alerter-script\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-os-release\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704569 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-run-netns\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovnkube-script-lib\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-kubernetes\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9313302a-59af-4923-a991-06bf17a1dd7b-etc-tuned\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-cni-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.705479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5h8x\" (UniqueName: \"kubernetes.io/projected/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-kube-api-access-z5h8x\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-systemd\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovnkube-config\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-system-cni-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-conf-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27037e14-66ef-40e1-8dcd-ad807abab817-agent-certs\") pod \"konnectivity-agent-4jcw2\" (UID: \"27037e14-66ef-40e1-8dcd-ad807abab817\") " pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.704980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4brm\" (UniqueName: \"kubernetes.io/projected/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-kube-api-access-z4brm\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-socket-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovn-node-metrics-cert\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27037e14-66ef-40e1-8dcd-ad807abab817-konnectivity-ca\") pod \"konnectivity-agent-4jcw2\" (UID: \"27037e14-66ef-40e1-8dcd-ad807abab817\") " pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705094 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rshzr\" (UniqueName: \"kubernetes.io/projected/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-kube-api-access-rshzr\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad941c8-a1aa-42b0-b94a-96ce43c6273d-host\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aad941c8-a1aa-42b0-b94a-96ce43c6273d-serviceca\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-run\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705173 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-device-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.706091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-var-lib-kubelet\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705227 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-var-lib-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-system-cni-dir\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-systemd-units\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysctl-conf\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705383 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-host\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-kubelet\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705440 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-registration-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-sys-fs\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705490 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-ovn\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.706629 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.705539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.790672 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.790573 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 04:37:33 +0000 UTC" deadline="2027-11-23 22:12:31.937947314 +0000 UTC" Jun 02 04:42:34.790672 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.790609 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12953h29m57.147340748s" Jun 02 04:42:34.791117 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.791092 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 04:42:34.797438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.797407 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:34.806073 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806045 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-systemd-units\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806084 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysctl-conf\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806108 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-host\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806139 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-kubelet\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806160 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-registration-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-systemd-units\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806181 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-sys-fs\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.806230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806223 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-ovn\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806226 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-sys-fs\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806263 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysctl-conf\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-host\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-ovn\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-kubelet\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-registration-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806252 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5239d059-c2e7-41ec-9826-50e4f07fa70c-kubelet-config\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806375 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-etc-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806399 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806425 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-etc-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806499 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62mst\" (UniqueName: \"kubernetes.io/projected/88285037-dc2e-405c-a1c6-d4358e2db5c2-kube-api-access-62mst\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.806523 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806525 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-sys\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806556 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-hostroot\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5239d059-c2e7-41ec-9826-50e4f07fa70c-dbus\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-node-log\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806622 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-sys\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806628 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-cni-bin\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-hostroot\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806680 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-systemd\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806700 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-cni-bin\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-node-log\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806740 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fj65w\" (UniqueName: \"kubernetes.io/projected/9313302a-59af-4923-a991-06bf17a1dd7b-kube-api-access-fj65w\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806788 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-systemd\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806833 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-k8s-cni-cncf-io\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806864 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-host-slash\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-k8s-cni-cncf-io\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zcj8\" (UniqueName: \"kubernetes.io/projected/b5b920bb-c69e-4df4-9978-67bc26f91798-kube-api-access-5zcj8\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806916 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-host-slash\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.807139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806941 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-cnibin\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806962 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.806987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807015 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-cni-bin\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-cnibin\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807038 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-cni-multus\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807063 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-cni-bin\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807088 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-etc-kubernetes\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-etc-kubernetes\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-var-lib-cni-multus\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807136 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cnibin\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807164 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-slash\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807170 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cnibin\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807188 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-log-socket\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807219 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-slash\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807249 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-cni-binary-copy\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.807962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807276 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-netns\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807303 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbhpn\" (UniqueName: \"kubernetes.io/projected/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-kube-api-access-pbhpn\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807331 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb49v\" (UniqueName: \"kubernetes.io/projected/aad941c8-a1aa-42b0-b94a-96ce43c6273d-kube-api-access-gb49v\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807354 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-cni-netd\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807378 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-modprobe-d\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807402 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysconfig\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807424 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysctl-d\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807455 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-lib-modules\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807469 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-cni-netd\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807473 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807494 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-netns\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807479 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9313302a-59af-4923-a991-06bf17a1dd7b-tmp\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807528 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-socket-dir-parent\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807543 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-daemon-config\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807543 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysconfig\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807560 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-multus-certs\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.808730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807575 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-kubelet\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807602 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-env-overrides\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807627 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-os-release\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807642 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-iptables-alerter-script\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-modprobe-d\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807668 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-os-release\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807720 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-os-release\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807751 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-run-netns\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807799 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-cni-binary-copy\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807799 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807815 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807830 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807844 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovnkube-script-lib\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-sysctl-d\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807872 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-kubernetes\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807896 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9313302a-59af-4923-a991-06bf17a1dd7b-etc-tuned\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807917 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-cni-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.809496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-lib-modules\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807943 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z5h8x\" (UniqueName: \"kubernetes.io/projected/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-kube-api-access-z5h8x\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807962 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-socket-dir-parent\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808000 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-systemd\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808025 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovnkube-config\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808037 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-daemon-config\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808050 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-system-cni-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808054 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-run-netns\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808075 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-conf-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808101 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27037e14-66ef-40e1-8dcd-ad807abab817-agent-certs\") pod \"konnectivity-agent-4jcw2\" (UID: \"27037e14-66ef-40e1-8dcd-ad807abab817\") " pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808109 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-host-run-multus-certs\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-os-release\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808129 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4brm\" (UniqueName: \"kubernetes.io/projected/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-kube-api-access-z4brm\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808157 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-host-kubelet\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810215 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-cni-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808192 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-socket-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-etc-kubernetes\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808219 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovn-node-metrics-cert\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-system-cni-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808252 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27037e14-66ef-40e1-8dcd-ad807abab817-konnectivity-ca\") pod \"konnectivity-agent-4jcw2\" (UID: \"27037e14-66ef-40e1-8dcd-ad807abab817\") " pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808265 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-multus-conf-dir\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.807215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-log-socket\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808294 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rshzr\" (UniqueName: \"kubernetes.io/projected/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-kube-api-access-rshzr\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808325 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad941c8-a1aa-42b0-b94a-96ce43c6273d-host\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808350 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aad941c8-a1aa-42b0-b94a-96ce43c6273d-serviceca\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808375 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-run\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808398 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-device-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808423 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-var-lib-kubelet\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808447 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-var-lib-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808474 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808528 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:34.810949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808558 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-system-cni-dir\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-system-cni-dir\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-iptables-alerter-script\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808683 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovnkube-config\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-device-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-run-systemd\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/88285037-dc2e-405c-a1c6-d4358e2db5c2-var-lib-openvswitch\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.808873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-var-lib-kubelet\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809019 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovnkube-script-lib\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.809129 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9313302a-59af-4923-a991-06bf17a1dd7b-run\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809173 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27037e14-66ef-40e1-8dcd-ad807abab817-konnectivity-ca\") pod \"konnectivity-agent-4jcw2\" (UID: \"27037e14-66ef-40e1-8dcd-ad807abab817\") " pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809223 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aad941c8-a1aa-42b0-b94a-96ce43c6273d-host\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.809228 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:35.309180675 +0000 UTC m=+3.091442106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809282 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-socket-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aad941c8-a1aa-42b0-b94a-96ce43c6273d-serviceca\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809491 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.811640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.809594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/88285037-dc2e-405c-a1c6-d4358e2db5c2-env-overrides\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.812308 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.811472 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9313302a-59af-4923-a991-06bf17a1dd7b-tmp\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.812308 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.811534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/88285037-dc2e-405c-a1c6-d4358e2db5c2-ovn-node-metrics-cert\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.812308 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.811602 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27037e14-66ef-40e1-8dcd-ad807abab817-agent-certs\") pod \"konnectivity-agent-4jcw2\" (UID: \"27037e14-66ef-40e1-8dcd-ad807abab817\") " pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:34.812308 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.811849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9313302a-59af-4923-a991-06bf17a1dd7b-etc-tuned\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.821114 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.821088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62mst\" (UniqueName: \"kubernetes.io/projected/88285037-dc2e-405c-a1c6-d4358e2db5c2-kube-api-access-62mst\") pod \"ovnkube-node-nmhf8\" (UID: \"88285037-dc2e-405c-a1c6-d4358e2db5c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.831197 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.831166 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4brm\" (UniqueName: \"kubernetes.io/projected/a2a9a55e-4ffe-4521-9018-d33f6f034b4e-kube-api-access-z4brm\") pod \"multus-additional-cni-plugins-cnx4c\" (UID: \"a2a9a55e-4ffe-4521-9018-d33f6f034b4e\") " pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:34.832170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.832142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj65w\" (UniqueName: \"kubernetes.io/projected/9313302a-59af-4923-a991-06bf17a1dd7b-kube-api-access-fj65w\") pod \"tuned-9sn6q\" (UID: \"9313302a-59af-4923-a991-06bf17a1dd7b\") " pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:34.833298 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.833276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5h8x\" (UniqueName: \"kubernetes.io/projected/6102f2ce-8afa-4ddb-bcb8-032a7a6d1281-kube-api-access-z5h8x\") pod \"iptables-alerter-cmgnp\" (UID: \"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281\") " pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:34.834183 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.834163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb49v\" (UniqueName: \"kubernetes.io/projected/aad941c8-a1aa-42b0-b94a-96ce43c6273d-kube-api-access-gb49v\") pod \"node-ca-tkmbg\" (UID: \"aad941c8-a1aa-42b0-b94a-96ce43c6273d\") " pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:34.835182 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.835160 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:34.835272 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.835186 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:34.835272 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.835199 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:34.835538 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.835272 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:35.335252222 +0000 UTC m=+3.117513691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:34.837455 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.837431 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zcj8\" (UniqueName: \"kubernetes.io/projected/b5b920bb-c69e-4df4-9978-67bc26f91798-kube-api-access-5zcj8\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:34.837557 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.837513 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbhpn\" (UniqueName: \"kubernetes.io/projected/8050a471-4a99-4bd9-9aaf-e4ee1a535db0-kube-api-access-pbhpn\") pod \"multus-dzwck\" (UID: \"8050a471-4a99-4bd9-9aaf-e4ee1a535db0\") " pod="openshift-multus/multus-dzwck" Jun 02 04:42:34.837750 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.837729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rshzr\" (UniqueName: \"kubernetes.io/projected/10ddce91-832b-4b7b-87b9-d1670b3d5f0a-kube-api-access-rshzr\") pod \"aws-ebs-csi-driver-node-xwf9v\" (UID: \"10ddce91-832b-4b7b-87b9-d1670b3d5f0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:34.909361 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.909326 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5239d059-c2e7-41ec-9826-50e4f07fa70c-kubelet-config\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.909361 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.909375 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5239d059-c2e7-41ec-9826-50e4f07fa70c-dbus\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.909585 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.909410 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.909585 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.909417 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5239d059-c2e7-41ec-9826-50e4f07fa70c-kubelet-config\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.909585 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.909557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5239d059-c2e7-41ec-9826-50e4f07fa70c-dbus\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:34.909585 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.909581 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:34.909724 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:34.909642 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:42:35.409621529 +0000 UTC m=+3.191882964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:34.926160 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.926130 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:34.990818 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.990741 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:42:34.997804 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:34.997761 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" Jun 02 04:42:35.005916 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.005882 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" Jun 02 04:42:35.010664 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.010638 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dzwck" Jun 02 04:42:35.018305 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.018273 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cmgnp" Jun 02 04:42:35.026083 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.026054 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:35.030761 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.030738 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tkmbg" Jun 02 04:42:35.036467 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.036441 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" Jun 02 04:42:35.311432 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.311397 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:35.311597 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.311577 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:35.311659 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.311641 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:36.311626801 +0000 UTC m=+4.093888232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:35.352670 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:35.352623 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88285037_dc2e_405c_a1c6_d4358e2db5c2.slice/crio-cf515987dc3435181d911d269f3307f57c56c4f2c34c721b07e1847e71f830db WatchSource:0}: Error finding container cf515987dc3435181d911d269f3307f57c56c4f2c34c721b07e1847e71f830db: Status 404 returned error can't find the container with id cf515987dc3435181d911d269f3307f57c56c4f2c34c721b07e1847e71f830db Jun 02 04:42:35.356411 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:35.356390 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8050a471_4a99_4bd9_9aaf_e4ee1a535db0.slice/crio-1f99a9a84f10ff4e70d6b765b5dc052a5e8399a120b21393103246466b576309 WatchSource:0}: Error finding container 1f99a9a84f10ff4e70d6b765b5dc052a5e8399a120b21393103246466b576309: Status 404 returned error can't find the container with id 1f99a9a84f10ff4e70d6b765b5dc052a5e8399a120b21393103246466b576309 Jun 02 04:42:35.358419 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:35.358394 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9313302a_59af_4923_a991_06bf17a1dd7b.slice/crio-87fe4c6fcc6c7e79c5e4dce63e71beac6fe8ef14e8b4e84315d8f0ced3af325d WatchSource:0}: Error finding container 87fe4c6fcc6c7e79c5e4dce63e71beac6fe8ef14e8b4e84315d8f0ced3af325d: Status 404 returned error can't find the container with id 87fe4c6fcc6c7e79c5e4dce63e71beac6fe8ef14e8b4e84315d8f0ced3af325d Jun 02 04:42:35.359581 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:35.359559 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a9a55e_4ffe_4521_9018_d33f6f034b4e.slice/crio-d2f8ef41bff881743515617f30d640c1575a740379e941775a56af48083f5a60 WatchSource:0}: Error finding container d2f8ef41bff881743515617f30d640c1575a740379e941775a56af48083f5a60: Status 404 returned error can't find the container with id d2f8ef41bff881743515617f30d640c1575a740379e941775a56af48083f5a60 Jun 02 04:42:35.360563 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:35.360512 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ddce91_832b_4b7b_87b9_d1670b3d5f0a.slice/crio-e09499d1f590110d0ba3af03a25d645302ca566cd676d6e7fe7ec91505d41c0e WatchSource:0}: Error finding container e09499d1f590110d0ba3af03a25d645302ca566cd676d6e7fe7ec91505d41c0e: Status 404 returned error can't find the container with id e09499d1f590110d0ba3af03a25d645302ca566cd676d6e7fe7ec91505d41c0e Jun 02 04:42:35.361272 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:35.361249 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad941c8_a1aa_42b0_b94a_96ce43c6273d.slice/crio-57a277587353d9e2866a051001e257ff91ed53530eeb9ab65aa6a97b5ea0e5bb WatchSource:0}: Error finding container 57a277587353d9e2866a051001e257ff91ed53530eeb9ab65aa6a97b5ea0e5bb: Status 404 returned error can't find the container with id 57a277587353d9e2866a051001e257ff91ed53530eeb9ab65aa6a97b5ea0e5bb Jun 02 04:42:35.411815 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.411790 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:35.411936 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.411828 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:35.411986 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.411932 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:35.411986 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.411943 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:35.411986 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.411959 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:35.411986 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.411969 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:35.412172 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.411999 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:42:36.411979291 +0000 UTC m=+4.194240740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:35.412172 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.412022 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:36.412015274 +0000 UTC m=+4.194276706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:35.791207 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.791127 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 04:37:33 +0000 UTC" deadline="2028-01-01 04:54:17.949970864 +0000 UTC" Jun 02 04:42:35.791207 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.791170 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13872h11m42.158804354s" Jun 02 04:42:35.836844 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.835885 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:35.836844 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.836022 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:35.836844 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.836509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:35.836844 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.836610 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:35.836844 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.836686 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:35.836844 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:35.836757 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:35.859589 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.859326 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jcw2" event={"ID":"27037e14-66ef-40e1-8dcd-ad807abab817","Type":"ContainerStarted","Data":"5bb1fbee099a06bf6b301c7a98ffc629a5e9c92f0bfb745dd6d8b3d01d54f8e0"} Jun 02 04:42:35.863404 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.863368 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerStarted","Data":"d2f8ef41bff881743515617f30d640c1575a740379e941775a56af48083f5a60"} Jun 02 04:42:35.873202 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.873169 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dzwck" event={"ID":"8050a471-4a99-4bd9-9aaf-e4ee1a535db0","Type":"ContainerStarted","Data":"1f99a9a84f10ff4e70d6b765b5dc052a5e8399a120b21393103246466b576309"} Jun 02 04:42:35.877509 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.877475 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" event={"ID":"6aedcff271f357909731b7f93c1315e3","Type":"ContainerStarted","Data":"2c15705050a1218bd6a80ea41a960d328236651c688045850c2bbac09b6e5cd6"} Jun 02 04:42:35.880040 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.880011 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tkmbg" event={"ID":"aad941c8-a1aa-42b0-b94a-96ce43c6273d","Type":"ContainerStarted","Data":"57a277587353d9e2866a051001e257ff91ed53530eeb9ab65aa6a97b5ea0e5bb"} Jun 02 04:42:35.884166 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.884139 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" event={"ID":"10ddce91-832b-4b7b-87b9-d1670b3d5f0a","Type":"ContainerStarted","Data":"e09499d1f590110d0ba3af03a25d645302ca566cd676d6e7fe7ec91505d41c0e"} Jun 02 04:42:35.888638 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.888611 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" event={"ID":"9313302a-59af-4923-a991-06bf17a1dd7b","Type":"ContainerStarted","Data":"87fe4c6fcc6c7e79c5e4dce63e71beac6fe8ef14e8b4e84315d8f0ced3af325d"} Jun 02 04:42:35.896784 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.896733 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"cf515987dc3435181d911d269f3307f57c56c4f2c34c721b07e1847e71f830db"} Jun 02 04:42:35.897971 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.897926 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-27.ec2.internal" podStartSLOduration=2.897899576 podStartE2EDuration="2.897899576s" podCreationTimestamp="2026-06-02 04:42:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:35.897789638 +0000 UTC m=+3.680051089" watchObservedRunningTime="2026-06-02 04:42:35.897899576 +0000 UTC m=+3.680161029" Jun 02 04:42:35.902586 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.902558 2563 generic.go:358] "Generic (PLEG): container finished" podID="276288898e5c2c660e5b3e80d2e2bbe3" containerID="e3280ae4435c967099f5149a4bdedb9892b4eafb070e2d535b6c1b60e897d438" exitCode=0 Jun 02 04:42:35.902700 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.902599 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" event={"ID":"276288898e5c2c660e5b3e80d2e2bbe3","Type":"ContainerDied","Data":"e3280ae4435c967099f5149a4bdedb9892b4eafb070e2d535b6c1b60e897d438"} Jun 02 04:42:35.909409 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:35.909383 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cmgnp" event={"ID":"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281","Type":"ContainerStarted","Data":"dcd03a68f369c6becaf9ecc01d38ef51667cd41c1e69d6387a9e941bc3103afc"} Jun 02 04:42:36.319813 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:36.319153 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:36.319813 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.319309 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:36.319813 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.319376 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:38.319356845 +0000 UTC m=+6.101618290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:36.420672 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:36.420585 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:36.420930 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:36.420681 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:36.420930 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.420871 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:36.421057 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.420937 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:42:38.420917901 +0000 UTC m=+6.203179336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:36.421362 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.421340 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:36.421443 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.421365 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:36.421443 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.421378 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:36.421443 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:36.421421 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:38.42140698 +0000 UTC m=+6.203668415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:36.925119 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:36.925060 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" event={"ID":"276288898e5c2c660e5b3e80d2e2bbe3","Type":"ContainerStarted","Data":"100dc760a2fba734f332566ddd42c0fef404055f9fbba85fc1b8884f642bdd95"} Jun 02 04:42:37.836810 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:37.836749 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:37.836986 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:37.836914 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:37.837365 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:37.837345 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:37.837477 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:37.837457 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:37.837549 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:37.837529 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:37.837607 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:37.837588 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:38.336404 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:38.336244 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:38.336404 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.336365 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:38.336916 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.336439 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:42.336418505 +0000 UTC m=+10.118679941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:38.437323 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:38.437287 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:38.437497 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:38.437343 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:38.437497 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.437486 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:38.437594 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.437503 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:38.437594 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.437514 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:38.437594 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.437571 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:42.437551244 +0000 UTC m=+10.219812679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:38.438009 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.437985 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:38.438112 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:38.438046 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:42:42.438032701 +0000 UTC m=+10.220294132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:39.837106 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:39.836297 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:39.837106 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:39.836430 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:39.837106 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:39.836851 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:39.837106 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:39.836949 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:39.837106 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:39.836999 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:39.837106 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:39.837065 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:41.539927 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.539862 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-27.ec2.internal" podStartSLOduration=8.53983955 podStartE2EDuration="8.53983955s" podCreationTimestamp="2026-06-02 04:42:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:36.940236173 +0000 UTC m=+4.722497629" watchObservedRunningTime="2026-06-02 04:42:41.53983955 +0000 UTC m=+9.322101005" Jun 02 04:42:41.540402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.540008 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2dqnm"] Jun 02 04:42:41.542020 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.541998 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.545154 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.545134 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 04:42:41.545420 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.545404 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 04:42:41.546003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.545986 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zrgp6\"" Jun 02 04:42:41.664984 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.664950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-tmp-dir\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.665172 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.665039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87h58\" (UniqueName: \"kubernetes.io/projected/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-kube-api-access-87h58\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.665172 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.665109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-hosts-file\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.766237 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.766194 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-tmp-dir\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.766237 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.766243 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87h58\" (UniqueName: \"kubernetes.io/projected/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-kube-api-access-87h58\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.766454 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.766276 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-hosts-file\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.766454 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.766363 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-hosts-file\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.766653 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.766633 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-tmp-dir\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.778704 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.778671 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87h58\" (UniqueName: \"kubernetes.io/projected/74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7-kube-api-access-87h58\") pod \"node-resolver-2dqnm\" (UID: \"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7\") " pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:41.836076 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.835987 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:41.836076 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.836051 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:41.836260 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:41.836157 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:41.836401 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.836368 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:41.836524 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:41.836501 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:41.836595 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:41.836578 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:41.854386 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:41.854353 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2dqnm" Jun 02 04:42:42.370557 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:42.370520 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:42.370750 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.370664 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:42.370750 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.370729 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:50.370709999 +0000 UTC m=+18.152971433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:42.471887 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:42.471849 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:42.472084 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:42.471952 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:42.472084 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.472074 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:42.472194 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.472136 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:42:50.472117886 +0000 UTC m=+18.254379323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:42.472557 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.472534 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:42.472557 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.472562 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:42.472717 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.472575 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:42.472717 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:42.472616 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:42:50.472602703 +0000 UTC m=+18.254864138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:43.836634 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:43.836558 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:43.836634 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:43.836627 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:43.837173 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:43.836588 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:43.837173 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:43.836747 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:43.837173 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:43.836855 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:43.837173 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:43.836923 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:45.836876 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:45.836840 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:45.837315 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:45.836840 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:45.837315 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:45.836983 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:45.837315 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:45.836840 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:45.837315 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:45.837069 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:45.837315 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:45.837149 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:47.836196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:47.835973 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:47.836706 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:47.836002 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:47.836706 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:47.836290 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:47.836706 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:47.836029 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:47.836706 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:47.836374 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:47.836706 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:47.836452 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:49.836582 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:49.836546 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:49.837068 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:49.836548 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:49.837068 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:49.836711 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:49.837068 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:49.836807 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:49.837068 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:49.836549 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:49.837068 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:49.836892 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:50.434469 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:50.434429 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:50.434630 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.434604 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:50.434678 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.434672 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.434657897 +0000 UTC m=+34.216919328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:50.535716 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:50.535664 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:50.535905 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:50.535742 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:50.535982 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.535933 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:50.535982 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.535943 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:50.535982 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.535961 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:50.535982 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.535970 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:50.536164 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.536016 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.535994352 +0000 UTC m=+34.318255785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:50.536164 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:50.536039 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.536026615 +0000 UTC m=+34.318288054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:51.836317 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:51.836276 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:51.836317 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:51.836300 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:51.836848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:51.836278 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:51.836848 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:51.836415 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:51.836848 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:51.836506 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:51.836848 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:51.836635 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:52.778294 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:42:52.778264 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a0ee00_cd9a_4498_b61f_f92d6a6ffbd7.slice/crio-286057bb5414b92b8655e2b64a25d833bd0aae35cc1ca0f39a2e2985d4a17338 WatchSource:0}: Error finding container 286057bb5414b92b8655e2b64a25d833bd0aae35cc1ca0f39a2e2985d4a17338: Status 404 returned error can't find the container with id 286057bb5414b92b8655e2b64a25d833bd0aae35cc1ca0f39a2e2985d4a17338 Jun 02 04:42:52.955436 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:52.955392 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tkmbg" event={"ID":"aad941c8-a1aa-42b0-b94a-96ce43c6273d","Type":"ContainerStarted","Data":"0bd1b801d22763d28d4abaf1f3a251f34dc5e53ab13212dad82d52990b0c379d"} Jun 02 04:42:52.979416 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:52.979374 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2dqnm" event={"ID":"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7","Type":"ContainerStarted","Data":"286057bb5414b92b8655e2b64a25d833bd0aae35cc1ca0f39a2e2985d4a17338"} Jun 02 04:42:52.980620 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:52.980600 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerStarted","Data":"209b236026960caf4a597f6a8c16442b93b9a1004bdcbfed2e8267f5aca93a32"} Jun 02 04:42:53.837057 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.836797 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:53.837232 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.836806 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:53.837232 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:53.837104 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:53.837232 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.836819 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:53.837232 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:53.837207 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:53.837428 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:53.837292 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:53.982929 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.982894 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" event={"ID":"9313302a-59af-4923-a991-06bf17a1dd7b","Type":"ContainerStarted","Data":"7e8295520428920f92310cbaf29b603c210d67eb43938cfa833c3169e5cf173c"} Jun 02 04:42:53.984542 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.984521 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:42:53.984892 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.984870 2563 generic.go:358] "Generic (PLEG): container finished" podID="88285037-dc2e-405c-a1c6-d4358e2db5c2" containerID="49ca5e88a40d16e947504b833a23e24a82f745999f228cef2f7fa9622cdb45a7" exitCode=1 Jun 02 04:42:53.984967 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.984939 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"cad01d93cd5125ba4ea5ca965e183d6b9063d418a615b4a64702bf892d6e3422"} Jun 02 04:42:53.985003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.984971 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerDied","Data":"49ca5e88a40d16e947504b833a23e24a82f745999f228cef2f7fa9622cdb45a7"} Jun 02 04:42:53.985003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.984986 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"1d5432fec9b5cf1f91e7de8bef7f6b5df188f950d6d76cdccc1168881c9aff83"} Jun 02 04:42:53.986027 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.986000 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2dqnm" event={"ID":"74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7","Type":"ContainerStarted","Data":"b195e177249ab0d60eeefc5a71ff6432bd3671248fb06ff6ab8754163125f452"} Jun 02 04:42:53.987185 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.987163 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4jcw2" event={"ID":"27037e14-66ef-40e1-8dcd-ad807abab817","Type":"ContainerStarted","Data":"16419620119af651e325d710ed46bbec92737b98dc50b7f914eaae21f45d9d01"} Jun 02 04:42:53.988524 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.988502 2563 generic.go:358] "Generic (PLEG): container finished" podID="a2a9a55e-4ffe-4521-9018-d33f6f034b4e" containerID="209b236026960caf4a597f6a8c16442b93b9a1004bdcbfed2e8267f5aca93a32" exitCode=0 Jun 02 04:42:53.988601 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.988563 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerDied","Data":"209b236026960caf4a597f6a8c16442b93b9a1004bdcbfed2e8267f5aca93a32"} Jun 02 04:42:53.989893 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.989854 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dzwck" event={"ID":"8050a471-4a99-4bd9-9aaf-e4ee1a535db0","Type":"ContainerStarted","Data":"fe733cef8531fbb1364724e56d1d3dce8a200c7221a5d7c8395866a52aa75f68"} Jun 02 04:42:53.991092 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:53.991065 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" event={"ID":"10ddce91-832b-4b7b-87b9-d1670b3d5f0a","Type":"ContainerStarted","Data":"e8a312ca657f9d2572a09671a0f2cddf49ee5659a4009fb04335f92760d7ef29"} Jun 02 04:42:54.000567 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.000531 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sn6q" podStartSLOduration=4.234613446 podStartE2EDuration="22.000521296s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.360096929 +0000 UTC m=+3.142358374" lastFinishedPulling="2026-06-02 04:42:53.126004778 +0000 UTC m=+20.908266224" observedRunningTime="2026-06-02 04:42:54.000010696 +0000 UTC m=+21.782272170" watchObservedRunningTime="2026-06-02 04:42:54.000521296 +0000 UTC m=+21.782782749" Jun 02 04:42:54.014124 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.014083 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tkmbg" podStartSLOduration=9.045581751 podStartE2EDuration="22.014070336s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.365208693 +0000 UTC m=+3.147470125" lastFinishedPulling="2026-06-02 04:42:48.333697278 +0000 UTC m=+16.115958710" observedRunningTime="2026-06-02 04:42:54.013786453 +0000 UTC m=+21.796047897" watchObservedRunningTime="2026-06-02 04:42:54.014070336 +0000 UTC m=+21.796331830" Jun 02 04:42:54.029407 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.029361 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4jcw2" podStartSLOduration=4.621839415 podStartE2EDuration="22.02934635s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.365872188 +0000 UTC m=+3.148133620" lastFinishedPulling="2026-06-02 04:42:52.77337911 +0000 UTC m=+20.555640555" observedRunningTime="2026-06-02 04:42:54.02931681 +0000 UTC m=+21.811578264" watchObservedRunningTime="2026-06-02 04:42:54.02934635 +0000 UTC m=+21.811607806" Jun 02 04:42:54.071389 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.071230 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2dqnm" podStartSLOduration=13.071215805 podStartE2EDuration="13.071215805s" podCreationTimestamp="2026-06-02 04:42:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:54.070946201 +0000 UTC m=+21.853207655" watchObservedRunningTime="2026-06-02 04:42:54.071215805 +0000 UTC m=+21.853477258" Jun 02 04:42:54.092669 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.092629 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dzwck" podStartSLOduration=4.642068436 podStartE2EDuration="22.092615839s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.35842878 +0000 UTC m=+3.140690215" lastFinishedPulling="2026-06-02 04:42:52.808976186 +0000 UTC m=+20.591237618" observedRunningTime="2026-06-02 04:42:54.092512833 +0000 UTC m=+21.874774288" watchObservedRunningTime="2026-06-02 04:42:54.092615839 +0000 UTC m=+21.874877292" Jun 02 04:42:54.451579 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.451549 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 04:42:54.769499 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.769328 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T04:42:54.451570024Z","UUID":"09b7411b-2cb2-4fe3-84ae-2439f2ff0be5","Handler":null,"Name":"","Endpoint":""} Jun 02 04:42:54.772889 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.772863 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 04:42:54.773021 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.772902 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 04:42:54.995780 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.995736 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cmgnp" event={"ID":"6102f2ce-8afa-4ddb-bcb8-032a7a6d1281","Type":"ContainerStarted","Data":"4951c682b74a9c0796913ff511fd2d5bca3955978ff07c4f49e314942a1b6823"} Jun 02 04:42:54.998092 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:54.998058 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" event={"ID":"10ddce91-832b-4b7b-87b9-d1670b3d5f0a","Type":"ContainerStarted","Data":"0ed18b99a2b20e8eaaaca6bd70a16f124f4236dab461bb4552c8ba022ad6f1f1"} Jun 02 04:42:55.000682 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.000662 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:42:55.001070 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.000994 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"7b56dd67c157481cd199de4e92332cb36448ab2bad613f278c325f3820bac276"} Jun 02 04:42:55.001070 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.001026 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"8a3b11b2f7668a517ae01bd26d6a37f2982feaa6ea86ec5df8cacc886616a0b1"} Jun 02 04:42:55.001070 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.001040 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"75cabe1fb1b7b162c4abcb9e68814988faebed299b3123541d151a5032e5b57c"} Jun 02 04:42:55.826150 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.825917 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:55.826635 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.826613 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:55.836118 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.836085 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:55.836266 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.836199 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:55.836266 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:55.836207 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:55.836378 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:55.836273 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:55.836378 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.836279 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:55.836378 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:55.836349 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:55.846458 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:55.846401 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cmgnp" podStartSLOduration=6.438977307 podStartE2EDuration="23.846385636s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.366008186 +0000 UTC m=+3.148269631" lastFinishedPulling="2026-06-02 04:42:52.773416509 +0000 UTC m=+20.555677960" observedRunningTime="2026-06-02 04:42:55.011541573 +0000 UTC m=+22.793803027" watchObservedRunningTime="2026-06-02 04:42:55.846385636 +0000 UTC m=+23.628647091" Jun 02 04:42:56.004913 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:56.004872 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" event={"ID":"10ddce91-832b-4b7b-87b9-d1670b3d5f0a","Type":"ContainerStarted","Data":"474b137ff47a334d41fa5212cd51b2c4ca2d0b1785c795dea5d0b61704c7bc55"} Jun 02 04:42:56.005640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:56.005363 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:56.005881 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:56.005862 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4jcw2" Jun 02 04:42:56.029165 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:56.029121 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xwf9v" podStartSLOduration=4.018210828 podStartE2EDuration="24.029103342s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.365585268 +0000 UTC m=+3.147846703" lastFinishedPulling="2026-06-02 04:42:55.376477772 +0000 UTC m=+23.158739217" observedRunningTime="2026-06-02 04:42:56.028998341 +0000 UTC m=+23.811259794" watchObservedRunningTime="2026-06-02 04:42:56.029103342 +0000 UTC m=+23.811364796" Jun 02 04:42:57.835931 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:57.835890 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:57.835931 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:57.835927 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:57.836588 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:57.835927 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:57.836588 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:57.836033 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:42:57.836588 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:57.836102 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:57.836588 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:57.836159 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:58.012146 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:58.012124 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:42:58.012471 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:58.012450 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"0d6c9cf2e86d1d25c7bc21cc73f41eed1634ed9f1cb260b64c05fe96cb428357"} Jun 02 04:42:59.015736 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:59.015520 2563 generic.go:358] "Generic (PLEG): container finished" podID="a2a9a55e-4ffe-4521-9018-d33f6f034b4e" containerID="92d77885c3ca5cdd0be2a5fb7460d6449d7b42bdde27ff9efaacfbb9021fcaca" exitCode=0 Jun 02 04:42:59.015736 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:59.015604 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerDied","Data":"92d77885c3ca5cdd0be2a5fb7460d6449d7b42bdde27ff9efaacfbb9021fcaca"} Jun 02 04:42:59.835880 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:59.835837 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:42:59.836033 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:59.835950 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:42:59.836033 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:59.835961 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:42:59.836105 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:59.836065 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:42:59.836138 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:42:59.836111 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:42:59.836198 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:42:59.836182 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:43:00.019240 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:00.019140 2563 generic.go:358] "Generic (PLEG): container finished" podID="a2a9a55e-4ffe-4521-9018-d33f6f034b4e" containerID="8ead993c183a96f4e12bd7c81a78d40c2d392e0bafdfc2d86911c3664a09c36b" exitCode=0 Jun 02 04:43:00.019240 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:00.019188 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerDied","Data":"8ead993c183a96f4e12bd7c81a78d40c2d392e0bafdfc2d86911c3664a09c36b"} Jun 02 04:43:01.023880 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.023850 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:43:01.024382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.024191 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"66b79fc9044bb07425e0738c5c3d9f398f73975332b4ae0e37e27cb92dd42142"} Jun 02 04:43:01.024514 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.024497 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:43:01.024588 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.024523 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:43:01.024790 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.024758 2563 scope.go:117] "RemoveContainer" containerID="49ca5e88a40d16e947504b833a23e24a82f745999f228cef2f7fa9622cdb45a7" Jun 02 04:43:01.028479 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.028456 2563 generic.go:358] "Generic (PLEG): container finished" podID="a2a9a55e-4ffe-4521-9018-d33f6f034b4e" containerID="f956c91c6f6c7232079a059c110c607beb61692c798ff5eb35f36c6f94325513" exitCode=0 Jun 02 04:43:01.028638 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.028528 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerDied","Data":"f956c91c6f6c7232079a059c110c607beb61692c798ff5eb35f36c6f94325513"} Jun 02 04:43:01.042058 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.042036 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:43:01.836600 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.836410 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:01.836760 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.836416 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:01.836760 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:01.836695 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:43:01.836888 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:01.836451 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:01.836888 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:01.836825 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:43:01.836888 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:01.836872 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:43:02.019724 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.019687 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6tkmn"] Jun 02 04:43:02.025009 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.024918 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrjs7"] Jun 02 04:43:02.025712 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.025668 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mm6qg"] Jun 02 04:43:02.038966 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.038884 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:43:02.039380 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.039359 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:02.039498 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:02.039474 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:43:02.040933 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.040902 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" event={"ID":"88285037-dc2e-405c-a1c6-d4358e2db5c2","Type":"ContainerStarted","Data":"7f69fc6c043ae2f2e35b86e463d1f32eaad40c9d0d86f2db4371a3c85b70e712"} Jun 02 04:43:02.041041 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.040985 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:02.041095 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:02.041073 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:43:02.041205 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.041154 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:02.041306 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:02.041247 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:43:02.041393 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.041378 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:43:02.062552 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.062458 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:43:02.087254 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:02.087195 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" podStartSLOduration=12.00563588 podStartE2EDuration="30.08717535s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.354583907 +0000 UTC m=+3.136845350" lastFinishedPulling="2026-06-02 04:42:53.436123374 +0000 UTC m=+21.218384820" observedRunningTime="2026-06-02 04:43:02.082049458 +0000 UTC m=+29.864310912" watchObservedRunningTime="2026-06-02 04:43:02.08717535 +0000 UTC m=+29.869436803" Jun 02 04:43:03.836402 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:03.836359 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:03.837149 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:03.836414 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:03.837149 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:03.836507 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:43:03.837149 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:03.836562 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:43:03.837149 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:03.836571 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:03.837149 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:03.836671 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:43:05.836467 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:05.836431 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:05.837017 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:05.836483 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:05.837017 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:05.836537 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:05.837017 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:05.836658 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:43:05.837017 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:05.836730 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6tkmn" podUID="5239d059-c2e7-41ec-9826-50e4f07fa70c" Jun 02 04:43:05.837017 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:05.836845 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mm6qg" podUID="6ff7a85e-d56a-4c3b-a792-d1c55963210e" Jun 02 04:43:05.993024 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:05.992993 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-27.ec2.internal" event="NodeReady" Jun 02 04:43:05.993200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:05.993138 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 04:43:06.054750 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.054718 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s5l44"] Jun 02 04:43:06.058656 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.058627 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.059655 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.059633 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h2nlw"] Jun 02 04:43:06.063720 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.063414 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.069031 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069006 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s8w52\"" Jun 02 04:43:06.069338 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069317 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 04:43:06.069602 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069515 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 04:43:06.069691 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 04:43:06.069811 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069792 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 04:43:06.069913 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069845 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 04:43:06.069971 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.069912 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l292j\"" Jun 02 04:43:06.080921 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.080899 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5l44"] Jun 02 04:43:06.082805 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.082785 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h2nlw"] Jun 02 04:43:06.156093 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.156006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8mcl\" (UniqueName: \"kubernetes.io/projected/f9b8947b-721e-4443-9565-f994b0749a0c-kube-api-access-k8mcl\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.156093 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.156059 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.156327 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.156133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.156327 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.156199 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b8947b-721e-4443-9565-f994b0749a0c-tmp-dir\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.156327 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.156235 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b8947b-721e-4443-9565-f994b0749a0c-config-volume\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.156327 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.156258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-667f8\" (UniqueName: \"kubernetes.io/projected/8a0e601f-ccac-4d92-a601-394064cb97c0-kube-api-access-667f8\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.257435 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257401 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b8947b-721e-4443-9565-f994b0749a0c-tmp-dir\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.257435 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b8947b-721e-4443-9565-f994b0749a0c-config-volume\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.257684 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257487 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-667f8\" (UniqueName: \"kubernetes.io/projected/8a0e601f-ccac-4d92-a601-394064cb97c0-kube-api-access-667f8\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.257684 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257548 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8mcl\" (UniqueName: \"kubernetes.io/projected/f9b8947b-721e-4443-9565-f994b0749a0c-kube-api-access-k8mcl\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.257684 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257572 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.257684 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257594 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.257684 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.257681 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:06.257905 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.257740 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.757720568 +0000 UTC m=+34.539982001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:06.257905 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.257818 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9b8947b-721e-4443-9565-f994b0749a0c-tmp-dir\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.258012 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.257924 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:06.258012 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.257993 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.757976361 +0000 UTC m=+34.540237793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:06.258127 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.258108 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b8947b-721e-4443-9565-f994b0749a0c-config-volume\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.269335 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.269305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8mcl\" (UniqueName: \"kubernetes.io/projected/f9b8947b-721e-4443-9565-f994b0749a0c-kube-api-access-k8mcl\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.269460 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.269360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-667f8\" (UniqueName: \"kubernetes.io/projected/8a0e601f-ccac-4d92-a601-394064cb97c0-kube-api-access-667f8\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.459844 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.459753 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:06.460007 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.459880 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:43:06.460007 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.459948 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:38.45992842 +0000 UTC m=+66.242189873 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:43:06.560826 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.560790 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:06.561005 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.560919 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:43:06.561005 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.560942 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:06.561005 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.560983 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret podName:5239d059-c2e7-41ec-9826-50e4f07fa70c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:38.560967086 +0000 UTC m=+66.343228517 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret") pod "global-pull-secret-syncer-6tkmn" (UID: "5239d059-c2e7-41ec-9826-50e4f07fa70c") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:43:06.561175 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.561041 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:43:06.561175 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.561054 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:43:06.561175 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.561064 2563 projected.go:194] Error preparing data for projected volume kube-api-access-tcj7w for pod openshift-network-diagnostics/network-check-target-mm6qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:43:06.561175 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.561116 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w podName:6ff7a85e-d56a-4c3b-a792-d1c55963210e nodeName:}" failed. No retries permitted until 2026-06-02 04:43:38.561103106 +0000 UTC m=+66.343364537 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcj7w" (UniqueName: "kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w") pod "network-check-target-mm6qg" (UID: "6ff7a85e-d56a-4c3b-a792-d1c55963210e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:43:06.762716 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.762689 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:06.762835 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:06.762727 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:06.762896 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.762844 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:06.762896 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.762846 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:06.762980 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.762908 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:07.762888709 +0000 UTC m=+35.545150160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:06.762980 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:06.762929 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:07.762917685 +0000 UTC m=+35.545179122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:07.051092 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.050889 2563 generic.go:358] "Generic (PLEG): container finished" podID="a2a9a55e-4ffe-4521-9018-d33f6f034b4e" containerID="0ea110f7da4a3c5a8a3b2b1ea20be03bdcf51f618b7773079935fb38b4870779" exitCode=0 Jun 02 04:43:07.051611 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.050979 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerDied","Data":"0ea110f7da4a3c5a8a3b2b1ea20be03bdcf51f618b7773079935fb38b4870779"} Jun 02 04:43:07.770717 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.770685 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:07.770717 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.770722 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:07.770946 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:07.770850 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:07.770946 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:07.770872 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:07.770946 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:07.770912 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:09.770896821 +0000 UTC m=+37.553158252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:07.770946 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:07.770928 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:09.770921139 +0000 UTC m=+37.553182570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:07.836200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.836154 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:07.836200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.836188 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:07.836407 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.836265 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:07.840380 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.840357 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2ckqz\"" Jun 02 04:43:07.840524 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.840357 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 04:43:07.840524 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.840362 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 04:43:07.840633 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.840555 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 04:43:07.840633 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.840561 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qgskw\"" Jun 02 04:43:07.840633 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:07.840629 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 04:43:08.056139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:08.056058 2563 generic.go:358] "Generic (PLEG): container finished" podID="a2a9a55e-4ffe-4521-9018-d33f6f034b4e" containerID="c4339a6458d029706fb4d9944ec8175c7091b26344f94c90ed6ca542743e8bb1" exitCode=0 Jun 02 04:43:08.056139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:08.056102 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerDied","Data":"c4339a6458d029706fb4d9944ec8175c7091b26344f94c90ed6ca542743e8bb1"} Jun 02 04:43:09.061023 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:09.060984 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" event={"ID":"a2a9a55e-4ffe-4521-9018-d33f6f034b4e","Type":"ContainerStarted","Data":"26d27fcd9bceea631b562b9bb67313824afdd10a3ccd6be4a10afe280be10f0d"} Jun 02 04:43:09.093105 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:09.093046 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cnx4c" podStartSLOduration=5.699690964 podStartE2EDuration="37.093030957s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:42:35.364036556 +0000 UTC m=+3.146297988" lastFinishedPulling="2026-06-02 04:43:06.757376546 +0000 UTC m=+34.539637981" observedRunningTime="2026-06-02 04:43:09.092453744 +0000 UTC m=+36.874715198" watchObservedRunningTime="2026-06-02 04:43:09.093030957 +0000 UTC m=+36.875292410" Jun 02 04:43:09.789018 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:09.788964 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:09.789018 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:09.789020 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:09.789249 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:09.789111 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:09.789249 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:09.789122 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:09.789249 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:09.789161 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:13.789147716 +0000 UTC m=+41.571409147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:09.789249 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:09.789182 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:13.789169931 +0000 UTC m=+41.571431362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:13.816797 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:13.816748 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:13.817224 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:13.816807 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:13.817224 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:13.816923 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:13.817224 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:13.816955 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:13.817224 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:13.816996 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:21.816975814 +0000 UTC m=+49.599237320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:13.817224 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:13.817078 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:21.81706684 +0000 UTC m=+49.599328271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:21.876730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:21.876690 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:21.876730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:21.876732 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:21.877435 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:21.876883 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:21.877435 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:21.876898 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:21.877435 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:21.876951 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:37.876935321 +0000 UTC m=+65.659196767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:21.877435 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:21.876966 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:43:37.876960746 +0000 UTC m=+65.659222177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:22.179360 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.179268 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9"] Jun 02 04:43:22.213041 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.213002 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9"] Jun 02 04:43:22.213219 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.213157 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.216200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.216168 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 04:43:22.217216 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.217195 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 04:43:22.217323 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.217197 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 04:43:22.217323 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.217231 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 04:43:22.381022 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.380983 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-828tv\" (UniqueName: \"kubernetes.io/projected/d21d3713-5ccc-40e5-8956-367aa3b98b22-kube-api-access-828tv\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.381220 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.381066 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d21d3713-5ccc-40e5-8956-367aa3b98b22-tmp\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.381220 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.381132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d21d3713-5ccc-40e5-8956-367aa3b98b22-klusterlet-config\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.481590 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.481502 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d21d3713-5ccc-40e5-8956-367aa3b98b22-klusterlet-config\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.481590 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.481558 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-828tv\" (UniqueName: \"kubernetes.io/projected/d21d3713-5ccc-40e5-8956-367aa3b98b22-kube-api-access-828tv\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.481787 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.481605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d21d3713-5ccc-40e5-8956-367aa3b98b22-tmp\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.481996 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.481975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d21d3713-5ccc-40e5-8956-367aa3b98b22-tmp\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.484940 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.484912 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d21d3713-5ccc-40e5-8956-367aa3b98b22-klusterlet-config\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.490664 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.490636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-828tv\" (UniqueName: \"kubernetes.io/projected/d21d3713-5ccc-40e5-8956-367aa3b98b22-kube-api-access-828tv\") pod \"klusterlet-addon-workmgr-67c77988d5-bfsb9\" (UID: \"d21d3713-5ccc-40e5-8956-367aa3b98b22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.522228 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.522189 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:22.682906 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:22.682876 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9"] Jun 02 04:43:22.686965 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:43:22.686938 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21d3713_5ccc_40e5_8956_367aa3b98b22.slice/crio-27471550d8619840e07017bcfddf1015af68d3e0371a8e3082feccb211fe94b8 WatchSource:0}: Error finding container 27471550d8619840e07017bcfddf1015af68d3e0371a8e3082feccb211fe94b8: Status 404 returned error can't find the container with id 27471550d8619840e07017bcfddf1015af68d3e0371a8e3082feccb211fe94b8 Jun 02 04:43:23.089319 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:23.089286 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" event={"ID":"d21d3713-5ccc-40e5-8956-367aa3b98b22","Type":"ContainerStarted","Data":"27471550d8619840e07017bcfddf1015af68d3e0371a8e3082feccb211fe94b8"} Jun 02 04:43:28.101455 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:28.101415 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" event={"ID":"d21d3713-5ccc-40e5-8956-367aa3b98b22","Type":"ContainerStarted","Data":"e6b9ce6ed562a64090f3526adbcfafc54aad7fdb6075506855fb56d26f6f6171"} Jun 02 04:43:28.101855 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:28.101624 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:28.103266 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:28.103244 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:43:28.118580 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:28.118538 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" podStartSLOduration=0.858475886 podStartE2EDuration="6.11852558s" podCreationTimestamp="2026-06-02 04:43:22 +0000 UTC" firstStartedPulling="2026-06-02 04:43:22.688805455 +0000 UTC m=+50.471066899" lastFinishedPulling="2026-06-02 04:43:27.948855161 +0000 UTC m=+55.731116593" observedRunningTime="2026-06-02 04:43:28.117178112 +0000 UTC m=+55.899439564" watchObservedRunningTime="2026-06-02 04:43:28.11852558 +0000 UTC m=+55.900787032" Jun 02 04:43:34.054258 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:34.054219 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nmhf8" Jun 02 04:43:37.897465 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:37.897422 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:43:37.897465 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:37.897467 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:43:37.897873 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:37.897569 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:37.897873 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:37.897572 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:37.897873 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:37.897618 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:44:09.897604146 +0000 UTC m=+97.679865577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:43:37.897873 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:37.897640 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:09.897625067 +0000 UTC m=+97.679886498 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:43:38.501583 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.501529 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:43:38.504616 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.504597 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 04:43:38.511892 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:38.511876 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 04:43:38.511961 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:43:38.511951 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:42.511935096 +0000 UTC m=+130.294196529 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : secret "metrics-daemon-secret" not found Jun 02 04:43:38.602730 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.602695 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:38.602877 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.602754 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:38.605623 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.605605 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 04:43:38.605681 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.605605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 04:43:38.616015 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.615983 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5239d059-c2e7-41ec-9826-50e4f07fa70c-original-pull-secret\") pod \"global-pull-secret-syncer-6tkmn\" (UID: \"5239d059-c2e7-41ec-9826-50e4f07fa70c\") " pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:38.616122 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.616037 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 04:43:38.626847 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.626824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcj7w\" (UniqueName: \"kubernetes.io/projected/6ff7a85e-d56a-4c3b-a792-d1c55963210e-kube-api-access-tcj7w\") pod \"network-check-target-mm6qg\" (UID: \"6ff7a85e-d56a-4c3b-a792-d1c55963210e\") " pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:38.748848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.748813 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qgskw\"" Jun 02 04:43:38.756087 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.756029 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6tkmn" Jun 02 04:43:38.756331 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.756312 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:38.908798 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.908730 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mm6qg"] Jun 02 04:43:38.912601 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:43:38.912574 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff7a85e_d56a_4c3b_a792_d1c55963210e.slice/crio-837b9cd479865d62f7a9cd98b6d09b90b15276140d5919c011e97fbd5ceabe40 WatchSource:0}: Error finding container 837b9cd479865d62f7a9cd98b6d09b90b15276140d5919c011e97fbd5ceabe40: Status 404 returned error can't find the container with id 837b9cd479865d62f7a9cd98b6d09b90b15276140d5919c011e97fbd5ceabe40 Jun 02 04:43:38.924278 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:38.924255 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6tkmn"] Jun 02 04:43:38.927220 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:43:38.927194 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5239d059_c2e7_41ec_9826_50e4f07fa70c.slice/crio-3ab2f5d2dc7a3acb82f57404121320325327127397e8a9d286b22d64ca4ae308 WatchSource:0}: Error finding container 3ab2f5d2dc7a3acb82f57404121320325327127397e8a9d286b22d64ca4ae308: Status 404 returned error can't find the container with id 3ab2f5d2dc7a3acb82f57404121320325327127397e8a9d286b22d64ca4ae308 Jun 02 04:43:39.123617 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:39.123574 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mm6qg" event={"ID":"6ff7a85e-d56a-4c3b-a792-d1c55963210e","Type":"ContainerStarted","Data":"837b9cd479865d62f7a9cd98b6d09b90b15276140d5919c011e97fbd5ceabe40"} Jun 02 04:43:39.124565 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:39.124542 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6tkmn" event={"ID":"5239d059-c2e7-41ec-9826-50e4f07fa70c","Type":"ContainerStarted","Data":"3ab2f5d2dc7a3acb82f57404121320325327127397e8a9d286b22d64ca4ae308"} Jun 02 04:43:44.136803 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:44.136732 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mm6qg" event={"ID":"6ff7a85e-d56a-4c3b-a792-d1c55963210e","Type":"ContainerStarted","Data":"a4ccbd644e3f6bae33fde451d049636edbbbac48d934a9084c69a774941dbc00"} Jun 02 04:43:44.137313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:44.136863 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:43:44.138175 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:44.138155 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6tkmn" event={"ID":"5239d059-c2e7-41ec-9826-50e4f07fa70c","Type":"ContainerStarted","Data":"167bb79a9aa282345f9d36a9b544c2620a21b01c223b010a7b043fa8593c7b79"} Jun 02 04:43:44.154623 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:44.154572 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mm6qg" podStartSLOduration=67.819123813 podStartE2EDuration="1m12.154555162s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:43:38.914390431 +0000 UTC m=+66.696651862" lastFinishedPulling="2026-06-02 04:43:43.249821768 +0000 UTC m=+71.032083211" observedRunningTime="2026-06-02 04:43:44.153424669 +0000 UTC m=+71.935686121" watchObservedRunningTime="2026-06-02 04:43:44.154555162 +0000 UTC m=+71.936816616" Jun 02 04:43:44.169202 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:43:44.169155 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6tkmn" podStartSLOduration=66.845292927 podStartE2EDuration="1m11.169141575s" podCreationTimestamp="2026-06-02 04:42:33 +0000 UTC" firstStartedPulling="2026-06-02 04:43:38.928866704 +0000 UTC m=+66.711128135" lastFinishedPulling="2026-06-02 04:43:43.252715336 +0000 UTC m=+71.034976783" observedRunningTime="2026-06-02 04:43:44.168712507 +0000 UTC m=+71.950973961" watchObservedRunningTime="2026-06-02 04:43:44.169141575 +0000 UTC m=+71.951403027" Jun 02 04:44:09.922209 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:09.922042 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:44:09.922209 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:09.922106 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:44:09.922209 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:09.922196 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:44:09.922209 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:09.922197 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:44:09.922687 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:09.922280 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls podName:f9b8947b-721e-4443-9565-f994b0749a0c nodeName:}" failed. No retries permitted until 2026-06-02 04:45:13.922261324 +0000 UTC m=+161.704522758 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls") pod "dns-default-s5l44" (UID: "f9b8947b-721e-4443-9565-f994b0749a0c") : secret "dns-default-metrics-tls" not found Jun 02 04:44:09.922687 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:09.922304 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert podName:8a0e601f-ccac-4d92-a601-394064cb97c0 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:13.92229601 +0000 UTC m=+161.704557441 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert") pod "ingress-canary-h2nlw" (UID: "8a0e601f-ccac-4d92-a601-394064cb97c0") : secret "canary-serving-cert" not found Jun 02 04:44:15.142745 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:15.142716 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mm6qg" Jun 02 04:44:42.559611 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:42.559569 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:44:42.560069 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:42.559722 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 04:44:42.560069 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:42.559829 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs podName:b5b920bb-c69e-4df4-9978-67bc26f91798 nodeName:}" failed. No retries permitted until 2026-06-02 04:46:44.559804948 +0000 UTC m=+252.342066378 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs") pod "network-metrics-daemon-zrjs7" (UID: "b5b920bb-c69e-4df4-9978-67bc26f91798") : secret "metrics-daemon-secret" not found Jun 02 04:44:52.688465 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.688434 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8557867c7-w77jw"] Jun 02 04:44:52.693055 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.693031 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-565f6ff7c9-p25dv"] Jun 02 04:44:52.693191 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.693174 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.695038 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.695022 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.697199 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.697175 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 04:44:52.697320 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.697305 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4vpfz\"" Jun 02 04:44:52.697615 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.697600 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 04:44:52.699360 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.699345 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 04:44:52.700167 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.700145 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ztmdk\"" Jun 02 04:44:52.700336 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.700315 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 04:44:52.700486 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.700467 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 04:44:52.700863 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.700845 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 04:44:52.700948 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.700862 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 04:44:52.701368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.701351 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 04:44:52.701938 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.701920 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 04:44:52.705553 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.705534 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 04:44:52.709564 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.709529 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8557867c7-w77jw"] Jun 02 04:44:52.723761 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.723736 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-565f6ff7c9-p25dv"] Jun 02 04:44:52.837004 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.836962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.837004 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837011 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-stats-auth\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.837228 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837228 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-registry-certificates\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837228 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qbbr\" (UniqueName: \"kubernetes.io/projected/39823f2c-324b-432b-b415-f80912340496-kube-api-access-6qbbr\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.837333 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-image-registry-private-configuration\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837333 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-trusted-ca\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837333 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837280 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-bound-sa-token\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837333 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.837466 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7198dedc-b1a9-4494-8099-13c076b9befa-ca-trust-extracted\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837466 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-installation-pull-secrets\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.837466 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-default-certificate\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.837466 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.837445 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdl49\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-kube-api-access-mdl49\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.938577 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.938485 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-image-registry-private-configuration\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.938577 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.938523 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-trusted-ca\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.938577 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.938540 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-bound-sa-token\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.938577 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.938562 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.938577 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.938578 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7198dedc-b1a9-4494-8099-13c076b9befa-ca-trust-extracted\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.938913 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.938685 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-installation-pull-secrets\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.939104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.939076 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-default-certificate\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.939169 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:52.939132 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 04:44:52.939241 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:52.939227 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:53.439195242 +0000 UTC m=+141.221456693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : secret "router-metrics-certs-default" not found Jun 02 04:44:52.939310 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.939136 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdl49\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-kube-api-access-mdl49\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.939970 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.939942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-trusted-ca\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.940101 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.939996 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.940101 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.940044 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-stats-auth\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.940220 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.940098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7198dedc-b1a9-4494-8099-13c076b9befa-ca-trust-extracted\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.940220 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.940100 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.940309 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:52.940250 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:44:52.940309 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:52.940268 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557867c7-w77jw: secret "image-registry-tls" not found Jun 02 04:44:52.940309 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.940267 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-registry-certificates\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.940438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.940327 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qbbr\" (UniqueName: \"kubernetes.io/projected/39823f2c-324b-432b-b415-f80912340496-kube-api-access-6qbbr\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.940743 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:52.940705 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls podName:7198dedc-b1a9-4494-8099-13c076b9befa nodeName:}" failed. No retries permitted until 2026-06-02 04:44:53.440680808 +0000 UTC m=+141.222942264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls") pod "image-registry-8557867c7-w77jw" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa") : secret "image-registry-tls" not found Jun 02 04:44:52.941112 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:52.940889 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:53.440871705 +0000 UTC m=+141.223133137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : configmap references non-existent config key: service-ca.crt Jun 02 04:44:52.941612 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.941591 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-registry-certificates\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.942415 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.942394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-default-certificate\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.943916 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.943889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-stats-auth\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.944897 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.944877 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-image-registry-private-configuration\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.944987 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.944921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-installation-pull-secrets\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.948495 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.948468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-bound-sa-token\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:52.949731 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.949714 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qbbr\" (UniqueName: \"kubernetes.io/projected/39823f2c-324b-432b-b415-f80912340496-kube-api-access-6qbbr\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:52.950243 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:52.950224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdl49\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-kube-api-access-mdl49\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:53.444358 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:53.444319 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:53.444579 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:53.444381 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:53.444579 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:53.444411 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:53.444579 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:53.444486 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 04:44:53.444579 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:53.444492 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:44:53.444579 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:53.444559 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557867c7-w77jw: secret "image-registry-tls" not found Jun 02 04:44:53.444579 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:53.444566 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:54.444546552 +0000 UTC m=+142.226808004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : configmap references non-existent config key: service-ca.crt Jun 02 04:44:53.444830 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:53.444600 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls podName:7198dedc-b1a9-4494-8099-13c076b9befa nodeName:}" failed. No retries permitted until 2026-06-02 04:44:54.444583106 +0000 UTC m=+142.226844538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls") pod "image-registry-8557867c7-w77jw" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa") : secret "image-registry-tls" not found Jun 02 04:44:53.444830 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:53.444617 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:54.444607882 +0000 UTC m=+142.226869315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : secret "router-metrics-certs-default" not found Jun 02 04:44:54.452811 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.452755 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.452834 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.452864 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:54.452879 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:54.452966 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:54.452976 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557867c7-w77jw: secret "image-registry-tls" not found Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:54.453000 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:56.452978386 +0000 UTC m=+144.235240001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : secret "router-metrics-certs-default" not found Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:54.453019 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:56.453011069 +0000 UTC m=+144.235272502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : configmap references non-existent config key: service-ca.crt Jun 02 04:44:54.453231 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:54.453033 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls podName:7198dedc-b1a9-4494-8099-13c076b9befa nodeName:}" failed. No retries permitted until 2026-06-02 04:44:56.453025139 +0000 UTC m=+144.235286574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls") pod "image-registry-8557867c7-w77jw" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa") : secret "image-registry-tls" not found Jun 02 04:44:54.601630 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.601595 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb"] Jun 02 04:44:54.604126 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.604109 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.607217 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.607192 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 04:44:54.607325 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.607288 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:44:54.607746 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.607726 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 04:44:54.607882 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.607730 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xxwcn\"" Jun 02 04:44:54.608330 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.608317 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 04:44:54.613700 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.613676 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb"] Jun 02 04:44:54.654096 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.654055 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75a21974-5053-42ba-9095-ca1cef397976-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.654096 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.654102 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75a21974-5053-42ba-9095-ca1cef397976-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.654335 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.654218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h57s\" (UniqueName: \"kubernetes.io/projected/75a21974-5053-42ba-9095-ca1cef397976-kube-api-access-8h57s\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.754687 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.754585 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h57s\" (UniqueName: \"kubernetes.io/projected/75a21974-5053-42ba-9095-ca1cef397976-kube-api-access-8h57s\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.754860 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.754695 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75a21974-5053-42ba-9095-ca1cef397976-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.754860 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.754726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75a21974-5053-42ba-9095-ca1cef397976-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.755268 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.755238 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75a21974-5053-42ba-9095-ca1cef397976-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.757076 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.757048 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75a21974-5053-42ba-9095-ca1cef397976-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.764046 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.764024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h57s\" (UniqueName: \"kubernetes.io/projected/75a21974-5053-42ba-9095-ca1cef397976-kube-api-access-8h57s\") pod \"kube-storage-version-migrator-operator-96ddc787c-v76cb\" (UID: \"75a21974-5053-42ba-9095-ca1cef397976\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:54.913439 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:54.913389 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" Jun 02 04:44:55.038848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:55.038808 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb"] Jun 02 04:44:55.042659 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:44:55.042633 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a21974_5053_42ba_9095_ca1cef397976.slice/crio-c18c2b2e4631ae574cae07a4555a3097af8e2622745dc8ed6fcc835c265ac894 WatchSource:0}: Error finding container c18c2b2e4631ae574cae07a4555a3097af8e2622745dc8ed6fcc835c265ac894: Status 404 returned error can't find the container with id c18c2b2e4631ae574cae07a4555a3097af8e2622745dc8ed6fcc835c265ac894 Jun 02 04:44:55.277038 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:55.277002 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" event={"ID":"75a21974-5053-42ba-9095-ca1cef397976","Type":"ContainerStarted","Data":"c18c2b2e4631ae574cae07a4555a3097af8e2622745dc8ed6fcc835c265ac894"} Jun 02 04:44:56.468885 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:56.468847 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:56.468885 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:56.468898 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:56.468952 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:56.469051 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:00.469027967 +0000 UTC m=+148.251289413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : configmap references non-existent config key: service-ca.crt Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:56.469075 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:56.469081 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:56.469097 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557867c7-w77jw: secret "image-registry-tls" not found Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:56.469114 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:00.46910188 +0000 UTC m=+148.251363311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : secret "router-metrics-certs-default" not found Jun 02 04:44:56.469327 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:44:56.469134 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls podName:7198dedc-b1a9-4494-8099-13c076b9befa nodeName:}" failed. No retries permitted until 2026-06-02 04:45:00.469122604 +0000 UTC m=+148.251384035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls") pod "image-registry-8557867c7-w77jw" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa") : secret "image-registry-tls" not found Jun 02 04:44:57.282269 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.282227 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" event={"ID":"75a21974-5053-42ba-9095-ca1cef397976","Type":"ContainerStarted","Data":"9017aea86a9a36ef0dd4e047c81a19b224de44fc1e52149d2aee1b45347efd7d"} Jun 02 04:44:57.300809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.300675 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" podStartSLOduration=1.296014857 podStartE2EDuration="3.300662239s" podCreationTimestamp="2026-06-02 04:44:54 +0000 UTC" firstStartedPulling="2026-06-02 04:44:55.044940541 +0000 UTC m=+142.827201975" lastFinishedPulling="2026-06-02 04:44:57.049587912 +0000 UTC m=+144.831849357" observedRunningTime="2026-06-02 04:44:57.29925853 +0000 UTC m=+145.081519982" watchObservedRunningTime="2026-06-02 04:44:57.300662239 +0000 UTC m=+145.082923692" Jun 02 04:44:57.845711 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.845676 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w"] Jun 02 04:44:57.847517 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.847501 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" Jun 02 04:44:57.849939 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.849919 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wdjwm\"" Jun 02 04:44:57.856187 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.856167 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w"] Jun 02 04:44:57.880178 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.880140 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpqr2\" (UniqueName: \"kubernetes.io/projected/e76e13f8-1013-4cd1-8422-5da0bac0b542-kube-api-access-tpqr2\") pod \"network-check-source-56d84b9f44-qk27w\" (UID: \"e76e13f8-1013-4cd1-8422-5da0bac0b542\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" Jun 02 04:44:57.980985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.980934 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpqr2\" (UniqueName: \"kubernetes.io/projected/e76e13f8-1013-4cd1-8422-5da0bac0b542-kube-api-access-tpqr2\") pod \"network-check-source-56d84b9f44-qk27w\" (UID: \"e76e13f8-1013-4cd1-8422-5da0bac0b542\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" Jun 02 04:44:57.989603 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:57.989566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpqr2\" (UniqueName: \"kubernetes.io/projected/e76e13f8-1013-4cd1-8422-5da0bac0b542-kube-api-access-tpqr2\") pod \"network-check-source-56d84b9f44-qk27w\" (UID: \"e76e13f8-1013-4cd1-8422-5da0bac0b542\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" Jun 02 04:44:58.156539 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:58.156447 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" Jun 02 04:44:58.285663 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:58.285637 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w"] Jun 02 04:44:58.288411 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:44:58.288382 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76e13f8_1013_4cd1_8422_5da0bac0b542.slice/crio-609e401fc18e2bf09745cc2630e3073f1400b88550ab1c52b19baf2715ae0027 WatchSource:0}: Error finding container 609e401fc18e2bf09745cc2630e3073f1400b88550ab1c52b19baf2715ae0027: Status 404 returned error can't find the container with id 609e401fc18e2bf09745cc2630e3073f1400b88550ab1c52b19baf2715ae0027 Jun 02 04:44:59.288545 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:59.288503 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" event={"ID":"e76e13f8-1013-4cd1-8422-5da0bac0b542","Type":"ContainerStarted","Data":"2a0b624c499ce893388d42127b1859df600c0b76b7a1e27ecf3298ec761e94b1"} Jun 02 04:44:59.288545 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:59.288547 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" event={"ID":"e76e13f8-1013-4cd1-8422-5da0bac0b542","Type":"ContainerStarted","Data":"609e401fc18e2bf09745cc2630e3073f1400b88550ab1c52b19baf2715ae0027"} Jun 02 04:44:59.305518 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:59.305469 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qk27w" podStartSLOduration=2.305455806 podStartE2EDuration="2.305455806s" podCreationTimestamp="2026-06-02 04:44:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:44:59.30449763 +0000 UTC m=+147.086759083" watchObservedRunningTime="2026-06-02 04:44:59.305455806 +0000 UTC m=+147.087717260" Jun 02 04:44:59.443112 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:44:59.443082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2dqnm_74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7/dns-node-resolver/0.log" Jun 02 04:45:00.498821 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:00.498754 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:00.498844 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:00.498872 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:00.498910 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:00.498969 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:00.498982 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8557867c7-w77jw: secret "image-registry-tls" not found Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:00.498973 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:08.498957702 +0000 UTC m=+156.281219138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : secret "router-metrics-certs-default" not found Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:00.499025 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:08.499012837 +0000 UTC m=+156.281274268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : configmap references non-existent config key: service-ca.crt Jun 02 04:45:00.499206 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:00.499038 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls podName:7198dedc-b1a9-4494-8099-13c076b9befa nodeName:}" failed. No retries permitted until 2026-06-02 04:45:08.499029414 +0000 UTC m=+156.281290845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls") pod "image-registry-8557867c7-w77jw" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa") : secret "image-registry-tls" not found Jun 02 04:45:00.643085 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:00.643057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tkmbg_aad941c8-a1aa-42b0-b94a-96ce43c6273d/node-ca/0.log" Jun 02 04:45:08.561822 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:08.561751 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:08.562218 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:08.561851 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:08.562218 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:08.561878 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:08.562218 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:08.561918 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 04:45:08.562218 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:08.562000 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:24.56198079 +0000 UTC m=+172.344242223 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : configmap references non-existent config key: service-ca.crt Jun 02 04:45:08.562218 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:08.562024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs podName:39823f2c-324b-432b-b415-f80912340496 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:24.562014731 +0000 UTC m=+172.344276163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs") pod "router-default-565f6ff7c9-p25dv" (UID: "39823f2c-324b-432b-b415-f80912340496") : secret "router-metrics-certs-default" not found Jun 02 04:45:08.564355 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:08.564324 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"image-registry-8557867c7-w77jw\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:08.603425 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:08.603392 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:08.733285 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:08.733229 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8557867c7-w77jw"] Jun 02 04:45:08.736832 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:08.736806 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7198dedc_b1a9_4494_8099_13c076b9befa.slice/crio-b21ca2f54c1d8dbcf4a8e7f9a9ead2b094395defc372cee2cab624be755b1df8 WatchSource:0}: Error finding container b21ca2f54c1d8dbcf4a8e7f9a9ead2b094395defc372cee2cab624be755b1df8: Status 404 returned error can't find the container with id b21ca2f54c1d8dbcf4a8e7f9a9ead2b094395defc372cee2cab624be755b1df8 Jun 02 04:45:09.071637 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:09.071595 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s5l44" podUID="f9b8947b-721e-4443-9565-f994b0749a0c" Jun 02 04:45:09.078772 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:09.078742 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-h2nlw" podUID="8a0e601f-ccac-4d92-a601-394064cb97c0" Jun 02 04:45:09.316718 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:09.316686 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:45:09.316718 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:09.316702 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557867c7-w77jw" event={"ID":"7198dedc-b1a9-4494-8099-13c076b9befa","Type":"ContainerStarted","Data":"f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10"} Jun 02 04:45:09.317003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:09.316988 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5l44" Jun 02 04:45:09.317068 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:09.317027 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:09.317068 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:09.317050 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557867c7-w77jw" event={"ID":"7198dedc-b1a9-4494-8099-13c076b9befa","Type":"ContainerStarted","Data":"b21ca2f54c1d8dbcf4a8e7f9a9ead2b094395defc372cee2cab624be755b1df8"} Jun 02 04:45:09.342455 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:09.342347 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8557867c7-w77jw" podStartSLOduration=17.342331197 podStartE2EDuration="17.342331197s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:45:09.341489784 +0000 UTC m=+157.123751236" watchObservedRunningTime="2026-06-02 04:45:09.342331197 +0000 UTC m=+157.124592649" Jun 02 04:45:10.851852 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:10.851811 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-zrjs7" podUID="b5b920bb-c69e-4df4-9978-67bc26f91798" Jun 02 04:45:14.004929 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.004893 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:45:14.005308 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.004934 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:45:14.007388 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.007359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9b8947b-721e-4443-9565-f994b0749a0c-metrics-tls\") pod \"dns-default-s5l44\" (UID: \"f9b8947b-721e-4443-9565-f994b0749a0c\") " pod="openshift-dns/dns-default-s5l44" Jun 02 04:45:14.007503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.007468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a0e601f-ccac-4d92-a601-394064cb97c0-cert\") pod \"ingress-canary-h2nlw\" (UID: \"8a0e601f-ccac-4d92-a601-394064cb97c0\") " pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:45:14.121838 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.121802 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s8w52\"" Jun 02 04:45:14.121838 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.121826 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l292j\"" Jun 02 04:45:14.127886 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.127869 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h2nlw" Jun 02 04:45:14.127978 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.127960 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s5l44" Jun 02 04:45:14.273449 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.273423 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s5l44"] Jun 02 04:45:14.275740 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:14.275697 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b8947b_721e_4443_9565_f994b0749a0c.slice/crio-b8dc47e8e380c727305ee37e23cb495bb6e6c235e4adac8c23c7a956a327e28e WatchSource:0}: Error finding container b8dc47e8e380c727305ee37e23cb495bb6e6c235e4adac8c23c7a956a327e28e: Status 404 returned error can't find the container with id b8dc47e8e380c727305ee37e23cb495bb6e6c235e4adac8c23c7a956a327e28e Jun 02 04:45:14.281020 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.280999 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h2nlw"] Jun 02 04:45:14.282497 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:14.282475 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0e601f_ccac_4d92_a601_394064cb97c0.slice/crio-05fbafdfcee7291cbdc64253174af943796af5a217439e957bd15b46bcf0c4dd WatchSource:0}: Error finding container 05fbafdfcee7291cbdc64253174af943796af5a217439e957bd15b46bcf0c4dd: Status 404 returned error can't find the container with id 05fbafdfcee7291cbdc64253174af943796af5a217439e957bd15b46bcf0c4dd Jun 02 04:45:14.331200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.331159 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5l44" event={"ID":"f9b8947b-721e-4443-9565-f994b0749a0c","Type":"ContainerStarted","Data":"b8dc47e8e380c727305ee37e23cb495bb6e6c235e4adac8c23c7a956a327e28e"} Jun 02 04:45:14.332128 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:14.332108 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h2nlw" event={"ID":"8a0e601f-ccac-4d92-a601-394064cb97c0","Type":"ContainerStarted","Data":"05fbafdfcee7291cbdc64253174af943796af5a217439e957bd15b46bcf0c4dd"} Jun 02 04:45:16.338839 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:16.338801 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5l44" event={"ID":"f9b8947b-721e-4443-9565-f994b0749a0c","Type":"ContainerStarted","Data":"9cce5c82cfe2b90da74531facedd67ba02e9675266454739cb7587a5bf210e74"} Jun 02 04:45:16.338839 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:16.338844 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s5l44" event={"ID":"f9b8947b-721e-4443-9565-f994b0749a0c","Type":"ContainerStarted","Data":"c17ac2f130269d8d73b527bc19c6de316cda1f81c72e7e30511cfdce839ee3e9"} Jun 02 04:45:16.339348 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:16.338944 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s5l44" Jun 02 04:45:16.340110 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:16.340088 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h2nlw" event={"ID":"8a0e601f-ccac-4d92-a601-394064cb97c0","Type":"ContainerStarted","Data":"21484c473237bc5f18acf130b5a252316ff987d34a09939b8b5f92261b5368b5"} Jun 02 04:45:16.357103 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:16.357062 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-s5l44" podStartSLOduration=128.62946086 podStartE2EDuration="2m10.35705059s" podCreationTimestamp="2026-06-02 04:43:06 +0000 UTC" firstStartedPulling="2026-06-02 04:45:14.277850553 +0000 UTC m=+162.060111987" lastFinishedPulling="2026-06-02 04:45:16.005440268 +0000 UTC m=+163.787701717" observedRunningTime="2026-06-02 04:45:16.357003469 +0000 UTC m=+164.139264921" watchObservedRunningTime="2026-06-02 04:45:16.35705059 +0000 UTC m=+164.139312039" Jun 02 04:45:16.373201 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:16.373124 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h2nlw" podStartSLOduration=128.648668718 podStartE2EDuration="2m10.373103804s" podCreationTimestamp="2026-06-02 04:43:06 +0000 UTC" firstStartedPulling="2026-06-02 04:45:14.284729495 +0000 UTC m=+162.066990927" lastFinishedPulling="2026-06-02 04:45:16.009164582 +0000 UTC m=+163.791426013" observedRunningTime="2026-06-02 04:45:16.372202135 +0000 UTC m=+164.154463588" watchObservedRunningTime="2026-06-02 04:45:16.373103804 +0000 UTC m=+164.155365257" Jun 02 04:45:23.836027 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:23.835973 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:45:24.588594 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.588536 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:24.588831 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.588612 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:24.589334 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.589231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39823f2c-324b-432b-b415-f80912340496-service-ca-bundle\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:24.590985 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.590966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39823f2c-324b-432b-b415-f80912340496-metrics-certs\") pod \"router-default-565f6ff7c9-p25dv\" (UID: \"39823f2c-324b-432b-b415-f80912340496\") " pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:24.722266 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.722230 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8557867c7-w77jw"] Jun 02 04:45:24.725686 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.725658 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-b9cdv"] Jun 02 04:45:24.726750 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.726721 2563 patch_prober.go:28] interesting pod/image-registry-8557867c7-w77jw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 04:45:24.726888 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.726805 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8557867c7-w77jw" podUID="7198dedc-b1a9-4494-8099-13c076b9befa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 04:45:24.730420 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.730398 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.733382 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.733363 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 04:45:24.733843 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.733826 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 04:45:24.733905 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.733832 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 04:45:24.738447 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.734418 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 04:45:24.738447 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.736299 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxtwx\"" Jun 02 04:45:24.743407 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.743380 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b9cdv"] Jun 02 04:45:24.790541 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.790500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.790541 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.790547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-data-volume\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.790736 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.790632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.790736 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.790683 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgr8d\" (UniqueName: \"kubernetes.io/projected/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-kube-api-access-pgr8d\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.790849 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.790749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-crio-socket\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.808548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.808513 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:24.891321 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.891274 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.891735 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.891330 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-data-volume\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.891735 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.891374 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.891735 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.891404 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgr8d\" (UniqueName: \"kubernetes.io/projected/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-kube-api-access-pgr8d\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.891933 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.891872 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-crio-socket\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.891987 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.891959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-crio-socket\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.892280 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.892255 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.892389 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.892342 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-data-volume\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.894558 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.894528 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.907525 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.907500 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgr8d\" (UniqueName: \"kubernetes.io/projected/f4d74f24-1de3-4ad4-a07d-fafe43d6568f-kube-api-access-pgr8d\") pod \"insights-runtime-extractor-b9cdv\" (UID: \"f4d74f24-1de3-4ad4-a07d-fafe43d6568f\") " pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:24.947614 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:24.947591 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-565f6ff7c9-p25dv"] Jun 02 04:45:24.950012 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:24.949989 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39823f2c_324b_432b_b415_f80912340496.slice/crio-2d027aa09411dbee5a4a969131f65c3e2b5b46f6f5f61a26ce67c60fc8e01c5a WatchSource:0}: Error finding container 2d027aa09411dbee5a4a969131f65c3e2b5b46f6f5f61a26ce67c60fc8e01c5a: Status 404 returned error can't find the container with id 2d027aa09411dbee5a4a969131f65c3e2b5b46f6f5f61a26ce67c60fc8e01c5a Jun 02 04:45:25.044487 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.044455 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-b9cdv" Jun 02 04:45:25.189563 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.189527 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-b9cdv"] Jun 02 04:45:25.192668 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:25.192633 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d74f24_1de3_4ad4_a07d_fafe43d6568f.slice/crio-7620e1c3b5526e9622f03dcae78d11aa47a6ab89b6fb6e07fe4d95cd7ccc7ea8 WatchSource:0}: Error finding container 7620e1c3b5526e9622f03dcae78d11aa47a6ab89b6fb6e07fe4d95cd7ccc7ea8: Status 404 returned error can't find the container with id 7620e1c3b5526e9622f03dcae78d11aa47a6ab89b6fb6e07fe4d95cd7ccc7ea8 Jun 02 04:45:25.363889 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.363846 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9cdv" event={"ID":"f4d74f24-1de3-4ad4-a07d-fafe43d6568f","Type":"ContainerStarted","Data":"3e571e306379a99c147cfb133f915f12f09fe79b913c1076a12f6f577500a35b"} Jun 02 04:45:25.363889 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.363892 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9cdv" event={"ID":"f4d74f24-1de3-4ad4-a07d-fafe43d6568f","Type":"ContainerStarted","Data":"7620e1c3b5526e9622f03dcae78d11aa47a6ab89b6fb6e07fe4d95cd7ccc7ea8"} Jun 02 04:45:25.365173 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.365140 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" event={"ID":"39823f2c-324b-432b-b415-f80912340496","Type":"ContainerStarted","Data":"fb55fd35acdc9cc3e811fa2cf079daf6040ee4517b9cfef2e4341b382816959e"} Jun 02 04:45:25.365326 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.365180 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" event={"ID":"39823f2c-324b-432b-b415-f80912340496","Type":"ContainerStarted","Data":"2d027aa09411dbee5a4a969131f65c3e2b5b46f6f5f61a26ce67c60fc8e01c5a"} Jun 02 04:45:25.391158 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.391059 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" podStartSLOduration=33.391046673 podStartE2EDuration="33.391046673s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:45:25.3900708 +0000 UTC m=+173.172332254" watchObservedRunningTime="2026-06-02 04:45:25.391046673 +0000 UTC m=+173.173308126" Jun 02 04:45:25.809018 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.808980 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:25.811502 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:25.811477 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:26.345633 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:26.345606 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s5l44" Jun 02 04:45:26.368974 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:26.368937 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9cdv" event={"ID":"f4d74f24-1de3-4ad4-a07d-fafe43d6568f","Type":"ContainerStarted","Data":"6a87bcccb5e5f7ce7f68cab40859b958a7cc0794d976183d8842851126708414"} Jun 02 04:45:26.369205 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:26.369188 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:26.370588 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:26.370564 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-565f6ff7c9-p25dv" Jun 02 04:45:28.375824 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:28.375738 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-b9cdv" event={"ID":"f4d74f24-1de3-4ad4-a07d-fafe43d6568f","Type":"ContainerStarted","Data":"471b803beeac65986240d49e8d4d5c05ee8c3d66fbc966a983bdbacfd48f6cd7"} Jun 02 04:45:28.376983 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:28.376961 2563 generic.go:358] "Generic (PLEG): container finished" podID="d21d3713-5ccc-40e5-8956-367aa3b98b22" containerID="e6b9ce6ed562a64090f3526adbcfafc54aad7fdb6075506855fb56d26f6f6171" exitCode=1 Jun 02 04:45:28.377065 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:28.377038 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" event={"ID":"d21d3713-5ccc-40e5-8956-367aa3b98b22","Type":"ContainerDied","Data":"e6b9ce6ed562a64090f3526adbcfafc54aad7fdb6075506855fb56d26f6f6171"} Jun 02 04:45:28.377403 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:28.377391 2563 scope.go:117] "RemoveContainer" containerID="e6b9ce6ed562a64090f3526adbcfafc54aad7fdb6075506855fb56d26f6f6171" Jun 02 04:45:28.395462 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:28.395393 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-b9cdv" podStartSLOduration=2.131852776 podStartE2EDuration="4.395379432s" podCreationTimestamp="2026-06-02 04:45:24 +0000 UTC" firstStartedPulling="2026-06-02 04:45:25.260328464 +0000 UTC m=+173.042589899" lastFinishedPulling="2026-06-02 04:45:27.52385511 +0000 UTC m=+175.306116555" observedRunningTime="2026-06-02 04:45:28.393940136 +0000 UTC m=+176.176201591" watchObservedRunningTime="2026-06-02 04:45:28.395379432 +0000 UTC m=+176.177640932" Jun 02 04:45:29.380785 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:29.380741 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" event={"ID":"d21d3713-5ccc-40e5-8956-367aa3b98b22","Type":"ContainerStarted","Data":"456345f36599aaef964299d99aaf6175a149dda9832122c11ef72837b431bf5b"} Jun 02 04:45:29.381244 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:29.381229 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:45:29.381837 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:29.381817 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-67c77988d5-bfsb9" Jun 02 04:45:31.910616 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.910579 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq"] Jun 02 04:45:31.913108 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.913093 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:31.915657 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.915635 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jzds6\"" Jun 02 04:45:31.915657 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.915639 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 04:45:31.915889 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.915745 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 04:45:31.916618 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.916605 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 04:45:31.916951 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.916932 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 04:45:31.917048 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.917029 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 04:45:31.921435 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:31.921415 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq"] Jun 02 04:45:32.053233 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.053200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.053379 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.053242 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.053379 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.053301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ztc\" (UniqueName: \"kubernetes.io/projected/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-kube-api-access-w7ztc\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.053379 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.053349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.153939 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.153891 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.153939 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.153945 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.154185 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.153978 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ztc\" (UniqueName: \"kubernetes.io/projected/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-kube-api-access-w7ztc\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.154185 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.154007 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.154580 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.154542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.156680 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.156649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.156794 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.156690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.162922 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.162868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ztc\" (UniqueName: \"kubernetes.io/projected/3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c-kube-api-access-w7ztc\") pod \"prometheus-operator-658bcd8bdf-hvdlq\" (UID: \"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.221860 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.221826 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" Jun 02 04:45:32.351572 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.351544 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq"] Jun 02 04:45:32.354735 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:32.354713 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5aaa6d_4f9b_476a_a6aa_2ebf1437ba4c.slice/crio-a208aa209547bb2567b8c44747f324b2a5f6eaf752b3e62fba3793f2e48c590f WatchSource:0}: Error finding container a208aa209547bb2567b8c44747f324b2a5f6eaf752b3e62fba3793f2e48c590f: Status 404 returned error can't find the container with id a208aa209547bb2567b8c44747f324b2a5f6eaf752b3e62fba3793f2e48c590f Jun 02 04:45:32.388818 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:32.388786 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" event={"ID":"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c","Type":"ContainerStarted","Data":"a208aa209547bb2567b8c44747f324b2a5f6eaf752b3e62fba3793f2e48c590f"} Jun 02 04:45:34.395341 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:34.395298 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" event={"ID":"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c","Type":"ContainerStarted","Data":"14f6d1f24eab2d7046965ace99114cbd10502109433a768c52ef9a6c9caa7a1d"} Jun 02 04:45:34.395799 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:34.395348 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" event={"ID":"3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c","Type":"ContainerStarted","Data":"f91eceea68ab980518744d7b6c2e22d54ff294c16bdfef33c7668b9a6294f65f"} Jun 02 04:45:34.415021 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:34.414971 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hvdlq" podStartSLOduration=1.988567471 podStartE2EDuration="3.414956345s" podCreationTimestamp="2026-06-02 04:45:31 +0000 UTC" firstStartedPulling="2026-06-02 04:45:32.356529837 +0000 UTC m=+180.138791269" lastFinishedPulling="2026-06-02 04:45:33.782918711 +0000 UTC m=+181.565180143" observedRunningTime="2026-06-02 04:45:34.414044253 +0000 UTC m=+182.196305707" watchObservedRunningTime="2026-06-02 04:45:34.414956345 +0000 UTC m=+182.197217796" Jun 02 04:45:34.726487 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:34.726411 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:36.247496 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.247457 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-k4wvh"] Jun 02 04:45:36.249863 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.249845 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.253450 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.253422 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jlbdt\"" Jun 02 04:45:36.253580 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.253469 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 04:45:36.253580 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.253475 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 04:45:36.260100 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.260072 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-k4wvh"] Jun 02 04:45:36.266734 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.266702 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7"] Jun 02 04:45:36.268799 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.268782 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.272575 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.272550 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 04:45:36.272753 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.272730 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 04:45:36.272908 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.272663 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 04:45:36.272908 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.272667 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cnkvj\"" Jun 02 04:45:36.287821 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.287760 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7"] Jun 02 04:45:36.289026 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.289001 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5xz4b"] Jun 02 04:45:36.291097 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.291080 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.294127 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.294103 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 04:45:36.294267 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.294246 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 04:45:36.294377 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.294320 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 04:45:36.294451 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.294430 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xw5gq\"" Jun 02 04:45:36.389328 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.389513 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389336 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh5bb\" (UniqueName: \"kubernetes.io/projected/9153c29c-75b6-437c-9a83-57c1d8a35653-kube-api-access-lh5bb\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.389513 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a7657b-657c-41a6-b602-d7a62eb9ae77-metrics-client-ca\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389513 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-tls\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389513 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389419 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-sys\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389513 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9153c29c-75b6-437c-9a83-57c1d8a35653-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-textfile\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9153c29c-75b6-437c-9a83-57c1d8a35653-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-root\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36feed34-58e7-4898-ba5e-c95fac40996d-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtjb9\" (UniqueName: \"kubernetes.io/projected/36feed34-58e7-4898-ba5e-c95fac40996d-kube-api-access-wtjb9\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389671 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36feed34-58e7-4898-ba5e-c95fac40996d-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.389702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.390014 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqmp\" (UniqueName: \"kubernetes.io/projected/55a7657b-657c-41a6-b602-d7a62eb9ae77-kube-api-access-vsqmp\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.390014 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-wtmp\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.390014 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389791 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9153c29c-75b6-437c-9a83-57c1d8a35653-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.390014 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.389819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.490362 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490325 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-tls\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490362 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490364 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-sys\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490393 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9153c29c-75b6-437c-9a83-57c1d8a35653-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.490566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490434 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-textfile\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490566 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490481 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490566 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:36.490509 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:36.490583 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-tls podName:55a7657b-657c-41a6-b602-d7a62eb9ae77 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:36.99056321 +0000 UTC m=+184.772824658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-tls") pod "node-exporter-5xz4b" (UID: "55a7657b-657c-41a6-b602-d7a62eb9ae77") : secret "node-exporter-tls" not found Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490518 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9153c29c-75b6-437c-9a83-57c1d8a35653-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490637 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-root\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490669 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36feed34-58e7-4898-ba5e-c95fac40996d-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490696 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtjb9\" (UniqueName: \"kubernetes.io/projected/36feed34-58e7-4898-ba5e-c95fac40996d-kube-api-access-wtjb9\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36feed34-58e7-4898-ba5e-c95fac40996d-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490752 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490795 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqmp\" (UniqueName: \"kubernetes.io/projected/55a7657b-657c-41a6-b602-d7a62eb9ae77-kube-api-access-vsqmp\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.490825 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490828 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-wtmp\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490868 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-textfile\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490868 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9153c29c-75b6-437c-9a83-57c1d8a35653-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490920 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490959 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.490994 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lh5bb\" (UniqueName: \"kubernetes.io/projected/9153c29c-75b6-437c-9a83-57c1d8a35653-kube-api-access-lh5bb\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:36.491064 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:36.491120 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-tls podName:36feed34-58e7-4898-ba5e-c95fac40996d nodeName:}" failed. No retries permitted until 2026-06-02 04:45:36.991102166 +0000 UTC m=+184.773363617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-rbfr7" (UID: "36feed34-58e7-4898-ba5e-c95fac40996d") : secret "kube-state-metrics-tls" not found Jun 02 04:45:36.491313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.491150 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a7657b-657c-41a6-b602-d7a62eb9ae77-metrics-client-ca\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.491718 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.491666 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/55a7657b-657c-41a6-b602-d7a62eb9ae77-metrics-client-ca\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.491848 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.491761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-root\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.492187 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492160 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.492477 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492454 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-wtmp\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.492610 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492588 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55a7657b-657c-41a6-b602-d7a62eb9ae77-sys\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.492690 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492543 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9153c29c-75b6-437c-9a83-57c1d8a35653-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.492690 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/36feed34-58e7-4898-ba5e-c95fac40996d-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.492920 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492892 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-accelerators-collector-config\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.493040 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.492941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36feed34-58e7-4898-ba5e-c95fac40996d-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.493531 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.493508 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.494101 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.494073 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9153c29c-75b6-437c-9a83-57c1d8a35653-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.495207 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.495186 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.495286 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.495194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9153c29c-75b6-437c-9a83-57c1d8a35653-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.500274 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.500215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqmp\" (UniqueName: \"kubernetes.io/projected/55a7657b-657c-41a6-b602-d7a62eb9ae77-kube-api-access-vsqmp\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.500274 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.500253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtjb9\" (UniqueName: \"kubernetes.io/projected/36feed34-58e7-4898-ba5e-c95fac40996d-kube-api-access-wtjb9\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.500874 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.500845 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh5bb\" (UniqueName: \"kubernetes.io/projected/9153c29c-75b6-437c-9a83-57c1d8a35653-kube-api-access-lh5bb\") pod \"openshift-state-metrics-85658796db-k4wvh\" (UID: \"9153c29c-75b6-437c-9a83-57c1d8a35653\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.558947 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.558909 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" Jun 02 04:45:36.693429 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.693395 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-k4wvh"] Jun 02 04:45:36.695909 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:36.695883 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9153c29c_75b6_437c_9a83_57c1d8a35653.slice/crio-a67cb754a470f3963b7dc33c2a9ab350889b47136edac6271c957d7d93ac2938 WatchSource:0}: Error finding container a67cb754a470f3963b7dc33c2a9ab350889b47136edac6271c957d7d93ac2938: Status 404 returned error can't find the container with id a67cb754a470f3963b7dc33c2a9ab350889b47136edac6271c957d7d93ac2938 Jun 02 04:45:36.994918 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.994876 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:36.995122 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.994941 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-tls\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.997427 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.997399 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/55a7657b-657c-41a6-b602-d7a62eb9ae77-node-exporter-tls\") pod \"node-exporter-5xz4b\" (UID: \"55a7657b-657c-41a6-b602-d7a62eb9ae77\") " pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:36.997540 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:36.997452 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/36feed34-58e7-4898-ba5e-c95fac40996d-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-rbfr7\" (UID: \"36feed34-58e7-4898-ba5e-c95fac40996d\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:37.180046 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.180004 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" Jun 02 04:45:37.200223 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.200042 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5xz4b" Jun 02 04:45:37.211124 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:37.211081 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a7657b_657c_41a6_b602_d7a62eb9ae77.slice/crio-ce1b7b9f8c01c106870ffdf2053384e5e804209347d5e4e095ffa4058be4f5a2 WatchSource:0}: Error finding container ce1b7b9f8c01c106870ffdf2053384e5e804209347d5e4e095ffa4058be4f5a2: Status 404 returned error can't find the container with id ce1b7b9f8c01c106870ffdf2053384e5e804209347d5e4e095ffa4058be4f5a2 Jun 02 04:45:37.314703 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.314679 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7"] Jun 02 04:45:37.317101 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:37.317071 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36feed34_58e7_4898_ba5e_c95fac40996d.slice/crio-1ccf5229a753b6128fad60cc1f7d9e8afcc81a0fad74c9315a525cc13a727a83 WatchSource:0}: Error finding container 1ccf5229a753b6128fad60cc1f7d9e8afcc81a0fad74c9315a525cc13a727a83: Status 404 returned error can't find the container with id 1ccf5229a753b6128fad60cc1f7d9e8afcc81a0fad74c9315a525cc13a727a83 Jun 02 04:45:37.403213 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.403173 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xz4b" event={"ID":"55a7657b-657c-41a6-b602-d7a62eb9ae77","Type":"ContainerStarted","Data":"ce1b7b9f8c01c106870ffdf2053384e5e804209347d5e4e095ffa4058be4f5a2"} Jun 02 04:45:37.404152 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.404125 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" event={"ID":"36feed34-58e7-4898-ba5e-c95fac40996d","Type":"ContainerStarted","Data":"1ccf5229a753b6128fad60cc1f7d9e8afcc81a0fad74c9315a525cc13a727a83"} Jun 02 04:45:37.405899 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.405866 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" event={"ID":"9153c29c-75b6-437c-9a83-57c1d8a35653","Type":"ContainerStarted","Data":"3d0b01e6f89757c0e07f01a9f042f172b73fdd5297f955f281a8101ffaae43d8"} Jun 02 04:45:37.405899 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.405900 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" event={"ID":"9153c29c-75b6-437c-9a83-57c1d8a35653","Type":"ContainerStarted","Data":"1112c68ec932f843157d856ef93e9190e7ba26b13055e9f8845f336a7a3aafe4"} Jun 02 04:45:37.406063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:37.405914 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" event={"ID":"9153c29c-75b6-437c-9a83-57c1d8a35653","Type":"ContainerStarted","Data":"a67cb754a470f3963b7dc33c2a9ab350889b47136edac6271c957d7d93ac2938"} Jun 02 04:45:38.411027 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.410947 2563 generic.go:358] "Generic (PLEG): container finished" podID="55a7657b-657c-41a6-b602-d7a62eb9ae77" containerID="05a17f82b6e6c98f5cb4712b3931ee115461ac9903d54ae6881d75d841c8df15" exitCode=0 Jun 02 04:45:38.411027 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.410987 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xz4b" event={"ID":"55a7657b-657c-41a6-b602-d7a62eb9ae77","Type":"ContainerDied","Data":"05a17f82b6e6c98f5cb4712b3931ee115461ac9903d54ae6881d75d841c8df15"} Jun 02 04:45:38.413370 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.413339 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" event={"ID":"9153c29c-75b6-437c-9a83-57c1d8a35653","Type":"ContainerStarted","Data":"c8ad0db7b92cbec53bbb605ebeb5180a527919e63360290d34b764bf078b8b2a"} Jun 02 04:45:38.459781 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.459682 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-k4wvh" podStartSLOduration=1.423421787 podStartE2EDuration="2.459665327s" podCreationTimestamp="2026-06-02 04:45:36 +0000 UTC" firstStartedPulling="2026-06-02 04:45:36.810970848 +0000 UTC m=+184.593232279" lastFinishedPulling="2026-06-02 04:45:37.847214385 +0000 UTC m=+185.629475819" observedRunningTime="2026-06-02 04:45:38.458799598 +0000 UTC m=+186.241061051" watchObservedRunningTime="2026-06-02 04:45:38.459665327 +0000 UTC m=+186.241926779" Jun 02 04:45:38.669438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.669356 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-sh869"] Jun 02 04:45:38.672169 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.672135 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:38.675140 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.675112 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-28rtw\"" Jun 02 04:45:38.675268 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.675169 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 04:45:38.675343 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.675274 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 04:45:38.685821 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.685759 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-sh869"] Jun 02 04:45:38.811667 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.811639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4nn\" (UniqueName: \"kubernetes.io/projected/98f6214c-89bb-40b8-b552-deda93f27576-kube-api-access-wm4nn\") pod \"downloads-c65b8dc4b-sh869\" (UID: \"98f6214c-89bb-40b8-b552-deda93f27576\") " pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:38.912861 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.912820 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4nn\" (UniqueName: \"kubernetes.io/projected/98f6214c-89bb-40b8-b552-deda93f27576-kube-api-access-wm4nn\") pod \"downloads-c65b8dc4b-sh869\" (UID: \"98f6214c-89bb-40b8-b552-deda93f27576\") " pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:38.923016 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.922987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4nn\" (UniqueName: \"kubernetes.io/projected/98f6214c-89bb-40b8-b552-deda93f27576-kube-api-access-wm4nn\") pod \"downloads-c65b8dc4b-sh869\" (UID: \"98f6214c-89bb-40b8-b552-deda93f27576\") " pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:38.982091 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:38.982055 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:39.150321 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.150271 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-sh869"] Jun 02 04:45:39.154852 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:39.154823 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f6214c_89bb_40b8_b552_deda93f27576.slice/crio-cae9c706081129f925807b3a4210bdd4e03b745e8fc1af9b3caf2dc62d4dd7b7 WatchSource:0}: Error finding container cae9c706081129f925807b3a4210bdd4e03b745e8fc1af9b3caf2dc62d4dd7b7: Status 404 returned error can't find the container with id cae9c706081129f925807b3a4210bdd4e03b745e8fc1af9b3caf2dc62d4dd7b7 Jun 02 04:45:39.419043 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.419011 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xz4b" event={"ID":"55a7657b-657c-41a6-b602-d7a62eb9ae77","Type":"ContainerStarted","Data":"6cb497b19f8a4636d8aa0f497581e796268b66e682261e724fa2e0ba5fb1c818"} Jun 02 04:45:39.419043 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.419047 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5xz4b" event={"ID":"55a7657b-657c-41a6-b602-d7a62eb9ae77","Type":"ContainerStarted","Data":"4e1d5891e3caa387c913b0c8a2918abb3693b0700cad74649b6138e77c5eef97"} Jun 02 04:45:39.420944 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.420911 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" event={"ID":"36feed34-58e7-4898-ba5e-c95fac40996d","Type":"ContainerStarted","Data":"88e98f3fef3d81144e2e2b081459ec3df52afb2f0a60c01f1efadd1c638ff4d4"} Jun 02 04:45:39.420944 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.420941 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" event={"ID":"36feed34-58e7-4898-ba5e-c95fac40996d","Type":"ContainerStarted","Data":"2a66c0abf57de24eb479257ed2b2b8748f1769cbd87e0469cefdba6c1d4a564a"} Jun 02 04:45:39.421087 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.420952 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" event={"ID":"36feed34-58e7-4898-ba5e-c95fac40996d","Type":"ContainerStarted","Data":"253801b06139c3cc3c6976766ab09fc1b64128c69b37e23ec0d74c5564440ed2"} Jun 02 04:45:39.421971 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.421950 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-sh869" event={"ID":"98f6214c-89bb-40b8-b552-deda93f27576","Type":"ContainerStarted","Data":"cae9c706081129f925807b3a4210bdd4e03b745e8fc1af9b3caf2dc62d4dd7b7"} Jun 02 04:45:39.499476 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.499430 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5xz4b" podStartSLOduration=2.59241624 podStartE2EDuration="3.499416557s" podCreationTimestamp="2026-06-02 04:45:36 +0000 UTC" firstStartedPulling="2026-06-02 04:45:37.213401721 +0000 UTC m=+184.995663165" lastFinishedPulling="2026-06-02 04:45:38.120402036 +0000 UTC m=+185.902663482" observedRunningTime="2026-06-02 04:45:39.498301764 +0000 UTC m=+187.280563228" watchObservedRunningTime="2026-06-02 04:45:39.499416557 +0000 UTC m=+187.281678009" Jun 02 04:45:39.528189 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:39.528130 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-rbfr7" podStartSLOduration=2.133061003 podStartE2EDuration="3.528115735s" podCreationTimestamp="2026-06-02 04:45:36 +0000 UTC" firstStartedPulling="2026-06-02 04:45:37.31892953 +0000 UTC m=+185.101190961" lastFinishedPulling="2026-06-02 04:45:38.713984258 +0000 UTC m=+186.496245693" observedRunningTime="2026-06-02 04:45:39.527493391 +0000 UTC m=+187.309754843" watchObservedRunningTime="2026-06-02 04:45:39.528115735 +0000 UTC m=+187.310377189" Jun 02 04:45:42.766850 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.766550 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:45:42.769925 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.769895 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.775043 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.774881 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 04:45:42.775043 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.774903 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.775451 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.775538 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.775454 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.775848 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.776155 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.776499 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9c95x\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.776543 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.776559 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 04:45:42.776809 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.776717 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 04:45:42.777336 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.776932 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6oopcjufhgrbq\"" Jun 02 04:45:42.777336 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.777093 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 04:45:42.777336 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.777316 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 04:45:42.781793 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.781359 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 04:45:42.792063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.791824 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:45:42.849393 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849567 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849567 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849567 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849567 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849567 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-config\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849830 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849583 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849830 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849830 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849829 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849848 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwzhq\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-kube-api-access-cwzhq\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.849949 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.849950 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.850271 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.850015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.850271 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.850065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.950649 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950605 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.950855 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950684 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.950855 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950722 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.950855 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950752 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.950855 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950830 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.950855 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950850 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950866 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwzhq\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-kube-api-access-cwzhq\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950925 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950957 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.950991 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951022 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951065 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951088 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951449 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951116 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951449 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951449 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951172 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951449 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951199 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-config\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.951634 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.951584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.952300 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.952260 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.952459 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.952310 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.955262 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.955072 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.955384 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.955271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.956472 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.955706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-config-out\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.956472 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.955813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-config\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.956472 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.956165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.956653 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.956475 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-web-config\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.956864 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.956756 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.956864 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.956752 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.957036 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.956871 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.957580 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.957556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.958146 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.958125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.958277 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.958257 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.958507 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.958466 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.959383 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.959368 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:42.970168 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:42.970142 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwzhq\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-kube-api-access-cwzhq\") pod \"prometheus-k8s-0\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:43.085285 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:43.085241 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:43.253147 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:43.253065 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:45:43.256939 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:45:43.256902 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3703b9_ee92_467d_afdc_af07d69e86da.slice/crio-5575a1527ec55ec71fa304c80cf14849ea0f4a654eed5380f04502f307b415e8 WatchSource:0}: Error finding container 5575a1527ec55ec71fa304c80cf14849ea0f4a654eed5380f04502f307b415e8: Status 404 returned error can't find the container with id 5575a1527ec55ec71fa304c80cf14849ea0f4a654eed5380f04502f307b415e8 Jun 02 04:45:43.437255 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:43.437177 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"5575a1527ec55ec71fa304c80cf14849ea0f4a654eed5380f04502f307b415e8"} Jun 02 04:45:44.442433 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:44.442334 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" exitCode=0 Jun 02 04:45:44.442858 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:44.442427 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} Jun 02 04:45:47.456022 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:47.455978 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} Jun 02 04:45:48.461921 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:48.461888 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} Jun 02 04:45:49.467174 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:49.467145 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} Jun 02 04:45:49.467468 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:49.467182 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} Jun 02 04:45:49.467468 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:49.467192 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} Jun 02 04:45:49.747098 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:49.747029 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8557867c7-w77jw" podUID="7198dedc-b1a9-4494-8099-13c076b9befa" containerName="registry" containerID="cri-o://f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10" gracePeriod=30 Jun 02 04:45:49.997280 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:49.997252 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:50.119932 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.119847 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-registry-certificates\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.119932 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.119885 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-trusted-ca\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.119932 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.119915 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdl49\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-kube-api-access-mdl49\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.120156 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.119946 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-installation-pull-secrets\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.120156 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.119975 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7198dedc-b1a9-4494-8099-13c076b9befa-ca-trust-extracted\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.120156 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.120004 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.120156 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.120035 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-bound-sa-token\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.120156 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.120095 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-image-registry-private-configuration\") pod \"7198dedc-b1a9-4494-8099-13c076b9befa\" (UID: \"7198dedc-b1a9-4494-8099-13c076b9befa\") " Jun 02 04:45:50.120334 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.120291 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:45:50.120602 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.120553 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:45:50.123439 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.123408 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:45:50.123439 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.123429 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:45:50.124081 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.124048 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-kube-api-access-mdl49" (OuterVolumeSpecName: "kube-api-access-mdl49") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "kube-api-access-mdl49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:45:50.124195 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.124125 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:45:50.124466 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.124442 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:45:50.130047 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.130023 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7198dedc-b1a9-4494-8099-13c076b9befa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7198dedc-b1a9-4494-8099-13c076b9befa" (UID: "7198dedc-b1a9-4494-8099-13c076b9befa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:45:50.221346 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221307 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-image-registry-private-configuration\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221346 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221348 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-registry-certificates\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221571 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221362 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7198dedc-b1a9-4494-8099-13c076b9befa-trusted-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221571 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221376 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdl49\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-kube-api-access-mdl49\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221571 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221392 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7198dedc-b1a9-4494-8099-13c076b9befa-installation-pull-secrets\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221571 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221403 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7198dedc-b1a9-4494-8099-13c076b9befa-ca-trust-extracted\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221571 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221412 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-registry-tls\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.221571 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.221419 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7198dedc-b1a9-4494-8099-13c076b9befa-bound-sa-token\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:45:50.472387 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.472080 2563 generic.go:358] "Generic (PLEG): container finished" podID="7198dedc-b1a9-4494-8099-13c076b9befa" containerID="f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10" exitCode=0 Jun 02 04:45:50.472387 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.472186 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557867c7-w77jw" event={"ID":"7198dedc-b1a9-4494-8099-13c076b9befa","Type":"ContainerDied","Data":"f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10"} Jun 02 04:45:50.472387 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.472216 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8557867c7-w77jw" event={"ID":"7198dedc-b1a9-4494-8099-13c076b9befa","Type":"ContainerDied","Data":"b21ca2f54c1d8dbcf4a8e7f9a9ead2b094395defc372cee2cab624be755b1df8"} Jun 02 04:45:50.472387 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.472237 2563 scope.go:117] "RemoveContainer" containerID="f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10" Jun 02 04:45:50.472998 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.472403 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8557867c7-w77jw" Jun 02 04:45:50.479126 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.478298 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerStarted","Data":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} Jun 02 04:45:50.486598 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.486576 2563 scope.go:117] "RemoveContainer" containerID="f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10" Jun 02 04:45:50.487070 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:45:50.487041 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10\": container with ID starting with f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10 not found: ID does not exist" containerID="f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10" Jun 02 04:45:50.487175 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.487082 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10"} err="failed to get container status \"f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10\": rpc error: code = NotFound desc = could not find container \"f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10\": container with ID starting with f6de50bd3b81f1373d4eacd8d1c4b8e840f943197294740cb0bcd6c963cecf10 not found: ID does not exist" Jun 02 04:45:50.534232 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.534174 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.533004805 podStartE2EDuration="8.534154799s" podCreationTimestamp="2026-06-02 04:45:42 +0000 UTC" firstStartedPulling="2026-06-02 04:45:43.259451032 +0000 UTC m=+191.041712480" lastFinishedPulling="2026-06-02 04:45:49.260601031 +0000 UTC m=+197.042862474" observedRunningTime="2026-06-02 04:45:50.531379091 +0000 UTC m=+198.313640548" watchObservedRunningTime="2026-06-02 04:45:50.534154799 +0000 UTC m=+198.316416253" Jun 02 04:45:50.556020 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.555982 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8557867c7-w77jw"] Jun 02 04:45:50.561473 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.561433 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8557867c7-w77jw"] Jun 02 04:45:50.841286 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:50.841246 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7198dedc-b1a9-4494-8099-13c076b9befa" path="/var/lib/kubelet/pods/7198dedc-b1a9-4494-8099-13c076b9befa/volumes" Jun 02 04:45:53.086076 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:53.086030 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:45:58.505874 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:58.505787 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-sh869" event={"ID":"98f6214c-89bb-40b8-b552-deda93f27576","Type":"ContainerStarted","Data":"309d12e207c0352e9de79262902d709b6dc572fb4eca37ed71134c96baf44d0a"} Jun 02 04:45:58.506291 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:58.506193 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:58.519559 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:58.519524 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-sh869" Jun 02 04:45:58.555617 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:45:58.555555 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-sh869" podStartSLOduration=1.657421259 podStartE2EDuration="20.555536275s" podCreationTimestamp="2026-06-02 04:45:38 +0000 UTC" firstStartedPulling="2026-06-02 04:45:39.156849798 +0000 UTC m=+186.939111243" lastFinishedPulling="2026-06-02 04:45:58.054964828 +0000 UTC m=+205.837226259" observedRunningTime="2026-06-02 04:45:58.53356202 +0000 UTC m=+206.315823474" watchObservedRunningTime="2026-06-02 04:45:58.555536275 +0000 UTC m=+206.337797731" Jun 02 04:46:28.595499 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:28.595465 2563 generic.go:358] "Generic (PLEG): container finished" podID="75a21974-5053-42ba-9095-ca1cef397976" containerID="9017aea86a9a36ef0dd4e047c81a19b224de44fc1e52149d2aee1b45347efd7d" exitCode=0 Jun 02 04:46:28.595982 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:28.595548 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" event={"ID":"75a21974-5053-42ba-9095-ca1cef397976","Type":"ContainerDied","Data":"9017aea86a9a36ef0dd4e047c81a19b224de44fc1e52149d2aee1b45347efd7d"} Jun 02 04:46:28.595982 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:28.595938 2563 scope.go:117] "RemoveContainer" containerID="9017aea86a9a36ef0dd4e047c81a19b224de44fc1e52149d2aee1b45347efd7d" Jun 02 04:46:29.600151 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:29.600115 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-v76cb" event={"ID":"75a21974-5053-42ba-9095-ca1cef397976","Type":"ContainerStarted","Data":"0339a39e406e5f58490df940b63eb1cdf24072634a264d07ba8315d1b018f984"} Jun 02 04:46:43.085386 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:43.085352 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:46:43.102159 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:43.102131 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:46:43.660388 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:43.660360 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:46:44.614497 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:44.614456 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:46:44.616965 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:44.616935 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5b920bb-c69e-4df4-9978-67bc26f91798-metrics-certs\") pod \"network-metrics-daemon-zrjs7\" (UID: \"b5b920bb-c69e-4df4-9978-67bc26f91798\") " pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:46:44.839381 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:44.839355 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2ckqz\"" Jun 02 04:46:44.846727 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:44.846700 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zrjs7" Jun 02 04:46:44.974897 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:44.974871 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zrjs7"] Jun 02 04:46:44.977460 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:46:44.977426 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b920bb_c69e_4df4_9978_67bc26f91798.slice/crio-a5446a4f17847339a98825d2c400eef30fb6a7fdd739253a7bdc399abe162c1d WatchSource:0}: Error finding container a5446a4f17847339a98825d2c400eef30fb6a7fdd739253a7bdc399abe162c1d: Status 404 returned error can't find the container with id a5446a4f17847339a98825d2c400eef30fb6a7fdd739253a7bdc399abe162c1d Jun 02 04:46:45.651782 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:45.651719 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrjs7" event={"ID":"b5b920bb-c69e-4df4-9978-67bc26f91798","Type":"ContainerStarted","Data":"a5446a4f17847339a98825d2c400eef30fb6a7fdd739253a7bdc399abe162c1d"} Jun 02 04:46:46.657093 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:46.657008 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrjs7" event={"ID":"b5b920bb-c69e-4df4-9978-67bc26f91798","Type":"ContainerStarted","Data":"ff943b6e72afbf0cb07b1abc5c1fbe9cf15e912c8c6fa2d9ff5d9b18b321d5a3"} Jun 02 04:46:46.657093 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:46.657047 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zrjs7" event={"ID":"b5b920bb-c69e-4df4-9978-67bc26f91798","Type":"ContainerStarted","Data":"61b84c1430c43cc0ea820314575b898ef325f505b1113cbe0aa10e8079e65bbf"} Jun 02 04:46:46.675289 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:46:46.675237 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zrjs7" podStartSLOduration=253.815086453 podStartE2EDuration="4m14.675220704s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:46:44.979251553 +0000 UTC m=+252.761512984" lastFinishedPulling="2026-06-02 04:46:45.8393858 +0000 UTC m=+253.621647235" observedRunningTime="2026-06-02 04:46:46.673594648 +0000 UTC m=+254.455856104" watchObservedRunningTime="2026-06-02 04:46:46.675220704 +0000 UTC m=+254.457482183" Jun 02 04:47:01.288872 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.288821 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:47:01.289469 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.289412 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="prometheus" containerID="cri-o://f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" gracePeriod=600 Jun 02 04:47:01.289542 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.289499 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy" containerID="cri-o://f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" gracePeriod=600 Jun 02 04:47:01.289592 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.289541 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="config-reloader" containerID="cri-o://c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" gracePeriod=600 Jun 02 04:47:01.289638 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.289556 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="thanos-sidecar" containerID="cri-o://aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" gracePeriod=600 Jun 02 04:47:01.289638 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.289474 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" gracePeriod=600 Jun 02 04:47:01.289638 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.289497 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-web" containerID="cri-o://a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" gracePeriod=600 Jun 02 04:47:01.546293 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.546235 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.650188 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650153 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-tls\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650202 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650229 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-config-out\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650251 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-serving-certs-ca-bundle\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650276 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-metrics-client-certs\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650297 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-config\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650329 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-metrics-client-ca\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650368 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650350 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-tls-assets\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650387 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-grpc-tls\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650416 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-kubelet-serving-ca-bundle\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650445 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-thanos-prometheus-http-client-file\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650481 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-kube-rbac-proxy\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650511 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-rulefiles-0\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650539 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-web-config\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650583 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.650702 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650612 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-trusted-ca-bundle\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.651088 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.650913 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:47:01.651088 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.651041 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:47:01.653345 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653307 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:47:01.653345 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653338 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.653345 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653360 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.653595 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653387 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwzhq\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-kube-api-access-cwzhq\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.653595 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653430 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-db\") pod \"ff3703b9-ee92-467d-afdc-af07d69e86da\" (UID: \"ff3703b9-ee92-467d-afdc-af07d69e86da\") " Jun 02 04:47:01.653697 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653608 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.653697 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653661 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-config-out" (OuterVolumeSpecName: "config-out") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:47:01.653697 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653685 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:47:01.653880 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653730 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.653880 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653824 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:47:01.654065 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.653970 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654243 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-metrics-client-ca\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654267 2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-tls-assets\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654282 2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-grpc-tls\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654297 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654311 2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654325 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654338 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654353 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654368 2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-config-out\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654381 2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.654397 2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-metrics-client-certs\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.655727 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.655568 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:47:01.655926 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.655896 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:47:01.655984 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.655952 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-config" (OuterVolumeSpecName: "config") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.656202 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.656180 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.656716 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.656691 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.656833 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.656745 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-kube-api-access-cwzhq" (OuterVolumeSpecName: "kube-api-access-cwzhq") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "kube-api-access-cwzhq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:47:01.666316 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.666295 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-web-config" (OuterVolumeSpecName: "web-config") pod "ff3703b9-ee92-467d-afdc-af07d69e86da" (UID: "ff3703b9-ee92-467d-afdc-af07d69e86da"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:47:01.708526 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708490 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" exitCode=0 Jun 02 04:47:01.708526 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708521 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" exitCode=0 Jun 02 04:47:01.708526 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708531 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" exitCode=0 Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708541 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" exitCode=0 Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708548 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" exitCode=0 Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708555 2563 generic.go:358] "Generic (PLEG): container finished" podID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" exitCode=0 Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708565 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708604 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708614 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708620 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708636 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.708754 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708626 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} Jun 02 04:47:01.709126 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708755 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} Jun 02 04:47:01.709126 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708809 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} Jun 02 04:47:01.709126 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.708824 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ff3703b9-ee92-467d-afdc-af07d69e86da","Type":"ContainerDied","Data":"5575a1527ec55ec71fa304c80cf14849ea0f4a654eed5380f04502f307b415e8"} Jun 02 04:47:01.717666 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.717650 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.725268 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.725256 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.732276 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.732259 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.738531 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.738514 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.745247 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.745223 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:47:01.745605 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.745594 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.753352 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.753333 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.753470 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.753451 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:47:01.755400 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755383 2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.755503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755407 2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-kube-rbac-proxy\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.755503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755422 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.755503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755438 2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-web-config\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.755503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755453 2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ff3703b9-ee92-467d-afdc-af07d69e86da-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.755503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755467 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwzhq\" (UniqueName: \"kubernetes.io/projected/ff3703b9-ee92-467d-afdc-af07d69e86da-kube-api-access-cwzhq\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.755503 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.755481 2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ff3703b9-ee92-467d-afdc-af07d69e86da-prometheus-k8s-db\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:47:01.759444 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.759428 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.759708 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.759691 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.759796 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.759724 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} err="failed to get container status \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" Jun 02 04:47:01.759796 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.759743 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.760010 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.759993 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.760055 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760017 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} err="failed to get container status \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" Jun 02 04:47:01.760055 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760034 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.760253 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.760237 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.760313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760261 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} err="failed to get container status \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" Jun 02 04:47:01.760313 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760288 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.760507 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.760490 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.760543 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760511 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} err="failed to get container status \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" Jun 02 04:47:01.760543 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760526 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.760749 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.760734 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.760818 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760753 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} err="failed to get container status \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" Jun 02 04:47:01.760818 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.760785 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.761014 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.760996 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.761066 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761020 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} err="failed to get container status \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" Jun 02 04:47:01.761066 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761035 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.761277 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:47:01.761262 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.761333 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761282 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} err="failed to get container status \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" Jun 02 04:47:01.761333 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761295 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.761501 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761482 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} err="failed to get container status \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" Jun 02 04:47:01.761544 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761502 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.761680 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761661 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} err="failed to get container status \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" Jun 02 04:47:01.761743 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761682 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.761880 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761866 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} err="failed to get container status \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" Jun 02 04:47:01.761923 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.761880 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.762040 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762019 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} err="failed to get container status \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" Jun 02 04:47:01.762088 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762042 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.762226 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762212 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} err="failed to get container status \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" Jun 02 04:47:01.762272 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762227 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.762397 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762384 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} err="failed to get container status \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" Jun 02 04:47:01.762432 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762398 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.762556 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762543 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} err="failed to get container status \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" Jun 02 04:47:01.762592 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762556 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.762739 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762724 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} err="failed to get container status \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" Jun 02 04:47:01.762739 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762738 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.762962 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762946 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} err="failed to get container status \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" Jun 02 04:47:01.763013 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.762965 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.763203 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763186 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} err="failed to get container status \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" Jun 02 04:47:01.763249 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763205 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.763413 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763399 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} err="failed to get container status \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" Jun 02 04:47:01.763456 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763413 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.763625 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763607 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} err="failed to get container status \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" Jun 02 04:47:01.763691 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763627 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.763899 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763880 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} err="failed to get container status \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" Jun 02 04:47:01.763954 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.763901 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.764083 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764067 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} err="failed to get container status \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" Jun 02 04:47:01.764122 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764083 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.764261 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764246 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} err="failed to get container status \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" Jun 02 04:47:01.764302 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764261 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.764443 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764426 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} err="failed to get container status \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" Jun 02 04:47:01.764509 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764445 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.764609 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764594 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} err="failed to get container status \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" Jun 02 04:47:01.764653 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764610 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.764760 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764747 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} err="failed to get container status \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" Jun 02 04:47:01.764839 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.764760 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.765025 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765006 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} err="failed to get container status \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" Jun 02 04:47:01.765077 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765025 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.765206 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765189 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} err="failed to get container status \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" Jun 02 04:47:01.765247 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765207 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.765391 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765377 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} err="failed to get container status \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" Jun 02 04:47:01.765391 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765390 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.765570 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765555 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} err="failed to get container status \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" Jun 02 04:47:01.765570 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765569 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.765751 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765733 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} err="failed to get container status \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" Jun 02 04:47:01.765751 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765751 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.765951 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765930 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} err="failed to get container status \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" Jun 02 04:47:01.765951 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.765952 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.766144 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766129 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} err="failed to get container status \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" Jun 02 04:47:01.766198 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766144 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.766321 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766303 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} err="failed to get container status \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" Jun 02 04:47:01.766361 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766321 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.766511 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766497 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} err="failed to get container status \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" Jun 02 04:47:01.766511 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766510 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.766682 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766667 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} err="failed to get container status \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" Jun 02 04:47:01.766726 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766682 2563 scope.go:117] "RemoveContainer" containerID="8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2" Jun 02 04:47:01.766877 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766863 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2"} err="failed to get container status \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": rpc error: code = NotFound desc = could not find container \"8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2\": container with ID starting with 8f5a678da246e6733a60a12ddc994268fab6442fc4e02a012d93b9c314f9b4e2 not found: ID does not exist" Jun 02 04:47:01.766914 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.766878 2563 scope.go:117] "RemoveContainer" containerID="f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c" Jun 02 04:47:01.767063 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767045 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c"} err="failed to get container status \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": rpc error: code = NotFound desc = could not find container \"f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c\": container with ID starting with f875b5d7b6d00fe7ced1055dbd96394a031480acc49104161af8fe52119ff69c not found: ID does not exist" Jun 02 04:47:01.767122 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767063 2563 scope.go:117] "RemoveContainer" containerID="a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c" Jun 02 04:47:01.767230 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767209 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c"} err="failed to get container status \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": rpc error: code = NotFound desc = could not find container \"a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c\": container with ID starting with a3a49bf26a061da6766e4d3f2ac1acc1216772371b2994a8b761c1c56f359d4c not found: ID does not exist" Jun 02 04:47:01.767291 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767234 2563 scope.go:117] "RemoveContainer" containerID="aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7" Jun 02 04:47:01.767416 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767400 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7"} err="failed to get container status \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": rpc error: code = NotFound desc = could not find container \"aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7\": container with ID starting with aa65451885ed69b9d4e6f044d9aac1379e395d227d53b9cea6aa5ebe922c0cd7 not found: ID does not exist" Jun 02 04:47:01.767477 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767417 2563 scope.go:117] "RemoveContainer" containerID="c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7" Jun 02 04:47:01.767640 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767622 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7"} err="failed to get container status \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": rpc error: code = NotFound desc = could not find container \"c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7\": container with ID starting with c46a9d7971af673a102ed3827320412e93acd5f8578b8be69fac3a7cb43a8ef7 not found: ID does not exist" Jun 02 04:47:01.767685 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767640 2563 scope.go:117] "RemoveContainer" containerID="f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc" Jun 02 04:47:01.767866 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767848 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc"} err="failed to get container status \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": rpc error: code = NotFound desc = could not find container \"f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc\": container with ID starting with f34a2e9672da21104fc7c416b19813171cb96b7364378c793bb2c01d4908b7cc not found: ID does not exist" Jun 02 04:47:01.767936 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.767867 2563 scope.go:117] "RemoveContainer" containerID="7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9" Jun 02 04:47:01.768109 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.768087 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9"} err="failed to get container status \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": rpc error: code = NotFound desc = could not find container \"7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9\": container with ID starting with 7e7d0e2d8b8edee6a2f1d434b337e0def19f41e7ec24408af6ba59979b9352c9 not found: ID does not exist" Jun 02 04:47:01.799981 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.799912 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:47:01.800170 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800158 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-web" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800172 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-web" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800181 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-thanos" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800186 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-thanos" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800194 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800200 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800207 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7198dedc-b1a9-4494-8099-13c076b9befa" containerName="registry" Jun 02 04:47:01.800212 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800212 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7198dedc-b1a9-4494-8099-13c076b9befa" containerName="registry" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800224 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="thanos-sidecar" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800230 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="thanos-sidecar" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800238 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="prometheus" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800243 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="prometheus" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800251 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="config-reloader" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800256 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="config-reloader" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800261 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="init-config-reloader" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800266 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="init-config-reloader" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800304 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="prometheus" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800312 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="config-reloader" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800317 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-thanos" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800325 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="thanos-sidecar" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800332 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="7198dedc-b1a9-4494-8099-13c076b9befa" containerName="registry" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800338 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy-web" Jun 02 04:47:01.800408 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.800343 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" containerName="kube-rbac-proxy" Jun 02 04:47:01.806489 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.806464 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.814919 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.814899 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 04:47:01.815112 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.815099 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 04:47:01.815213 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.815195 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6oopcjufhgrbq\"" Jun 02 04:47:01.815261 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.815193 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 04:47:01.815434 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.815418 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 04:47:01.815594 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.815583 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 04:47:01.816223 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.816210 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 04:47:01.816918 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.816890 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 04:47:01.817174 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.817159 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 04:47:01.818584 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.818553 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 04:47:01.818921 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.818907 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9c95x\"" Jun 02 04:47:01.818980 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.818909 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 04:47:01.818980 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.818913 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 04:47:01.825339 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.825323 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 04:47:01.828361 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.828336 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:47:01.830316 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.830293 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 04:47:01.957928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.957896 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.957928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.957932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.957975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/614f8035-332c-4967-b8b6-a900358f9e82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpcxs\" (UniqueName: \"kubernetes.io/projected/614f8035-332c-4967-b8b6-a900358f9e82-kube-api-access-rpcxs\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958196 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958193 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-config\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958311 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/614f8035-332c-4967-b8b6-a900358f9e82-config-out\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958334 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958411 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958415 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-web-config\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958691 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:01.958691 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:01.958492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059431 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059358 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-config\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059431 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059396 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/614f8035-332c-4967-b8b6-a900358f9e82-config-out\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059616 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059518 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059616 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059544 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059616 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059569 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059846 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059681 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059846 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059720 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-web-config\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059846 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059794 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.059846 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059822 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060061 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059873 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060061 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059899 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060061 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059960 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060061 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.059993 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/614f8035-332c-4967-b8b6-a900358f9e82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060061 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060016 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060061 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060042 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060516 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060068 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpcxs\" (UniqueName: \"kubernetes.io/projected/614f8035-332c-4967-b8b6-a900358f9e82-kube-api-access-rpcxs\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060516 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060095 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060516 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060125 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.060516 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.061136 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.061136 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.060955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.061238 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.061137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.062198 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.062137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.062565 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.062540 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/614f8035-332c-4967-b8b6-a900358f9e82-config-out\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.063204 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.062732 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.063204 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.063164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.063741 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.063706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-web-config\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.064173 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.064151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-config\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.064364 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.064334 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.064926 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.064900 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.065011 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.064962 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.065011 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.064997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.065395 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.065379 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/614f8035-332c-4967-b8b6-a900358f9e82-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.066141 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.066119 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/614f8035-332c-4967-b8b6-a900358f9e82-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.066319 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.066305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/614f8035-332c-4967-b8b6-a900358f9e82-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.071495 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.071476 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpcxs\" (UniqueName: \"kubernetes.io/projected/614f8035-332c-4967-b8b6-a900358f9e82-kube-api-access-rpcxs\") pod \"prometheus-k8s-0\" (UID: \"614f8035-332c-4967-b8b6-a900358f9e82\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.114676 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.114640 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:02.260041 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.260012 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 04:47:02.261645 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:47:02.261619 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614f8035_332c_4967_b8b6_a900358f9e82.slice/crio-bb144853d152debf6f464402f204f16c8f3369065ceaf045c71023ddbae8ec17 WatchSource:0}: Error finding container bb144853d152debf6f464402f204f16c8f3369065ceaf045c71023ddbae8ec17: Status 404 returned error can't find the container with id bb144853d152debf6f464402f204f16c8f3369065ceaf045c71023ddbae8ec17 Jun 02 04:47:02.713218 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.713130 2563 generic.go:358] "Generic (PLEG): container finished" podID="614f8035-332c-4967-b8b6-a900358f9e82" containerID="e30009ab5a8bf082a1b68d41b434919e859f034aebbd1ee482839636d460a88d" exitCode=0 Jun 02 04:47:02.713218 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.713170 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerDied","Data":"e30009ab5a8bf082a1b68d41b434919e859f034aebbd1ee482839636d460a88d"} Jun 02 04:47:02.713218 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.713189 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"bb144853d152debf6f464402f204f16c8f3369065ceaf045c71023ddbae8ec17"} Jun 02 04:47:02.840925 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:02.840845 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3703b9-ee92-467d-afdc-af07d69e86da" path="/var/lib/kubelet/pods/ff3703b9-ee92-467d-afdc-af07d69e86da/volumes" Jun 02 04:47:03.719285 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.719246 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"3424143f50a75c9207c0e877e5b518c2a1d4b004809c359991e67d184bc8ac05"} Jun 02 04:47:03.719285 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.719289 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"9691201bf62d66e475d748bcdef5db820dabac091b166d4b8664bab755ccd4d0"} Jun 02 04:47:03.719678 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.719299 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"0a4e7987b5af84a36da8b5456efbb0aa5f5742544f323a7de1b822ed7cf96dbd"} Jun 02 04:47:03.719678 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.719307 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"2464d9c507350c8492e302e07cb83924037c89b8adaf9c869d4a7fa7113badc0"} Jun 02 04:47:03.719678 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.719316 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"dfa751cddecbd142c855d2a8ca52dd4c7a1aa66eb3333864fb5a549acf5188ba"} Jun 02 04:47:03.719678 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.719323 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"614f8035-332c-4967-b8b6-a900358f9e82","Type":"ContainerStarted","Data":"d606b73d8d349c666bb2dcf2b3aa29854be28cb9b607211eaeb5d43dba3e3c8a"} Jun 02 04:47:03.753563 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:03.753510 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.753495495 podStartE2EDuration="2.753495495s" podCreationTimestamp="2026-06-02 04:47:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:47:03.751394711 +0000 UTC m=+271.533656162" watchObservedRunningTime="2026-06-02 04:47:03.753495495 +0000 UTC m=+271.535756948" Jun 02 04:47:07.114820 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:07.114756 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:47:32.709726 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:32.709692 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:47:32.710742 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:32.710716 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:47:32.721136 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:47:32.717154 2563 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 04:48:02.115589 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:48:02.115550 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:48:02.131511 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:48:02.131487 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:48:02.905430 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:48:02.905400 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 04:50:13.839932 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.839899 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p"] Jun 02 04:50:13.842794 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.842750 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.850821 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.850804 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 04:50:13.850921 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.850902 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4kpvc\"" Jun 02 04:50:13.851441 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.851421 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 04:50:13.851441 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.851440 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 04:50:13.852044 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.852025 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 04:50:13.859482 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.859461 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p"] Jun 02 04:50:13.882752 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.882722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90c6c9d0-e82d-4247-8792-968eeb10f3d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.882911 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.882806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90c6c9d0-e82d-4247-8792-968eeb10f3d1-manifests\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.882911 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.882827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90c6c9d0-e82d-4247-8792-968eeb10f3d1-tmp\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.882911 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.882845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c6c9d0-e82d-4247-8792-968eeb10f3d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.882911 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.882869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8466\" (UniqueName: \"kubernetes.io/projected/90c6c9d0-e82d-4247-8792-968eeb10f3d1-kube-api-access-c8466\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.983824 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.983738 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90c6c9d0-e82d-4247-8792-968eeb10f3d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.984003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.983870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90c6c9d0-e82d-4247-8792-968eeb10f3d1-manifests\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.984003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.983895 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90c6c9d0-e82d-4247-8792-968eeb10f3d1-tmp\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.984003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.983921 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c6c9d0-e82d-4247-8792-968eeb10f3d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.984003 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.983961 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8466\" (UniqueName: \"kubernetes.io/projected/90c6c9d0-e82d-4247-8792-968eeb10f3d1-kube-api-access-c8466\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.984335 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.984299 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90c6c9d0-e82d-4247-8792-968eeb10f3d1-manifests\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.986309 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.986292 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90c6c9d0-e82d-4247-8792-968eeb10f3d1-tmp\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.986636 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.986616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90c6c9d0-e82d-4247-8792-968eeb10f3d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.986680 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.986616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90c6c9d0-e82d-4247-8792-968eeb10f3d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:13.996655 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:13.996630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8466\" (UniqueName: \"kubernetes.io/projected/90c6c9d0-e82d-4247-8792-968eeb10f3d1-kube-api-access-c8466\") pod \"opendatahub-operator-controller-manager-55fcdd494f-jpm9p\" (UID: \"90c6c9d0-e82d-4247-8792-968eeb10f3d1\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:14.152739 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:14.152643 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:14.281751 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:14.281721 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p"] Jun 02 04:50:14.284390 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:50:14.284355 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c6c9d0_e82d_4247_8792_968eeb10f3d1.slice/crio-ace989221f41a66ab93a6eb0d0e3d2e77abeeb62deed4dcb99b7fbe87b52b451 WatchSource:0}: Error finding container ace989221f41a66ab93a6eb0d0e3d2e77abeeb62deed4dcb99b7fbe87b52b451: Status 404 returned error can't find the container with id ace989221f41a66ab93a6eb0d0e3d2e77abeeb62deed4dcb99b7fbe87b52b451 Jun 02 04:50:14.286122 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:14.286027 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:50:15.259622 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:15.259581 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" event={"ID":"90c6c9d0-e82d-4247-8792-968eeb10f3d1","Type":"ContainerStarted","Data":"ace989221f41a66ab93a6eb0d0e3d2e77abeeb62deed4dcb99b7fbe87b52b451"} Jun 02 04:50:17.267284 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:17.267195 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" event={"ID":"90c6c9d0-e82d-4247-8792-968eeb10f3d1","Type":"ContainerStarted","Data":"548cbc73b5e77ceb5ffe02dc1e1c2ddd1c453ce3254dd9c43c37b9e53f19ad0f"} Jun 02 04:50:18.270918 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:18.270890 2563 generic.go:358] "Generic (PLEG): container finished" podID="90c6c9d0-e82d-4247-8792-968eeb10f3d1" containerID="548cbc73b5e77ceb5ffe02dc1e1c2ddd1c453ce3254dd9c43c37b9e53f19ad0f" exitCode=0 Jun 02 04:50:18.271247 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:18.270925 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" event={"ID":"90c6c9d0-e82d-4247-8792-968eeb10f3d1","Type":"ContainerDied","Data":"548cbc73b5e77ceb5ffe02dc1e1c2ddd1c453ce3254dd9c43c37b9e53f19ad0f"} Jun 02 04:50:19.275298 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:19.275259 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" event={"ID":"90c6c9d0-e82d-4247-8792-968eeb10f3d1","Type":"ContainerStarted","Data":"773f44a59cfc0e95d817aeb3a0792a9903dab972bcc1db54a2e8bc39e2c77807"} Jun 02 04:50:19.275729 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:19.275390 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:19.300493 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:19.300436 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" podStartSLOduration=1.972781925 podStartE2EDuration="6.300416909s" podCreationTimestamp="2026-06-02 04:50:13 +0000 UTC" firstStartedPulling="2026-06-02 04:50:14.286178365 +0000 UTC m=+462.068439796" lastFinishedPulling="2026-06-02 04:50:18.613813345 +0000 UTC m=+466.396074780" observedRunningTime="2026-06-02 04:50:19.298320221 +0000 UTC m=+467.080581687" watchObservedRunningTime="2026-06-02 04:50:19.300416909 +0000 UTC m=+467.082678365" Jun 02 04:50:30.279685 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:30.279653 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-jpm9p" Jun 02 04:50:31.452665 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.452629 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f46596686-99hf6"] Jun 02 04:50:31.463445 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.463416 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.467563 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.467058 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 04:50:31.467563 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.467175 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fxwpl\"" Jun 02 04:50:31.468223 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.468198 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 04:50:31.469638 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.468878 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:50:31.469791 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.469747 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 04:50:31.470183 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.470159 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 04:50:31.471803 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.471741 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f46596686-99hf6"] Jun 02 04:50:31.541528 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.541500 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9zf\" (UniqueName: \"kubernetes.io/projected/91cf329b-bea0-4f86-bd24-0df5d343dd1d-kube-api-access-jz9zf\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.541654 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.541538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91cf329b-bea0-4f86-bd24-0df5d343dd1d-manager-config\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.541654 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.541570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91cf329b-bea0-4f86-bd24-0df5d343dd1d-metrics-cert\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.541721 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.541654 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91cf329b-bea0-4f86-bd24-0df5d343dd1d-cert\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.642439 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.642406 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9zf\" (UniqueName: \"kubernetes.io/projected/91cf329b-bea0-4f86-bd24-0df5d343dd1d-kube-api-access-jz9zf\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.642600 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.642447 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91cf329b-bea0-4f86-bd24-0df5d343dd1d-manager-config\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.642600 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.642570 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91cf329b-bea0-4f86-bd24-0df5d343dd1d-metrics-cert\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.642716 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.642621 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91cf329b-bea0-4f86-bd24-0df5d343dd1d-cert\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.643076 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.643054 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91cf329b-bea0-4f86-bd24-0df5d343dd1d-manager-config\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.645080 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.645061 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91cf329b-bea0-4f86-bd24-0df5d343dd1d-cert\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.645165 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.645136 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91cf329b-bea0-4f86-bd24-0df5d343dd1d-metrics-cert\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.655548 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.655522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9zf\" (UniqueName: \"kubernetes.io/projected/91cf329b-bea0-4f86-bd24-0df5d343dd1d-kube-api-access-jz9zf\") pod \"lws-controller-manager-6f46596686-99hf6\" (UID: \"91cf329b-bea0-4f86-bd24-0df5d343dd1d\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.778646 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.778605 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:31.904146 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:31.904120 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f46596686-99hf6"] Jun 02 04:50:31.905939 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:50:31.905912 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cf329b_bea0_4f86_bd24_0df5d343dd1d.slice/crio-47d10ed9744fd3dc8290f2f98b731dd9244cd890118a18ef75134cb362ecc31f WatchSource:0}: Error finding container 47d10ed9744fd3dc8290f2f98b731dd9244cd890118a18ef75134cb362ecc31f: Status 404 returned error can't find the container with id 47d10ed9744fd3dc8290f2f98b731dd9244cd890118a18ef75134cb362ecc31f Jun 02 04:50:32.316980 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.316946 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" event={"ID":"91cf329b-bea0-4f86-bd24-0df5d343dd1d","Type":"ContainerStarted","Data":"47d10ed9744fd3dc8290f2f98b731dd9244cd890118a18ef75134cb362ecc31f"} Jun 02 04:50:32.681298 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.681216 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77644847-v7d5v"] Jun 02 04:50:32.683981 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.683960 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.688816 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.688610 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dw26g\"" Jun 02 04:50:32.688816 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.688661 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 04:50:32.688816 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.688695 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 04:50:32.700842 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.700801 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77644847-v7d5v"] Jun 02 04:50:32.852840 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.852595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d98e289-530e-424c-93c0-d0b18fccfcca-tls-certs\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.852840 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.852649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d98e289-530e-424c-93c0-d0b18fccfcca-tmp\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.852840 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.852724 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9w7h\" (UniqueName: \"kubernetes.io/projected/8d98e289-530e-424c-93c0-d0b18fccfcca-kube-api-access-c9w7h\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.954353 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.954023 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c9w7h\" (UniqueName: \"kubernetes.io/projected/8d98e289-530e-424c-93c0-d0b18fccfcca-kube-api-access-c9w7h\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.954353 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.954108 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d98e289-530e-424c-93c0-d0b18fccfcca-tls-certs\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.954353 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.954154 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d98e289-530e-424c-93c0-d0b18fccfcca-tmp\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.965043 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.963562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d98e289-530e-424c-93c0-d0b18fccfcca-tls-certs\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.970074 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.970050 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9w7h\" (UniqueName: \"kubernetes.io/projected/8d98e289-530e-424c-93c0-d0b18fccfcca-kube-api-access-c9w7h\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.979428 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.979380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d98e289-530e-424c-93c0-d0b18fccfcca-tmp\") pod \"kube-auth-proxy-77644847-v7d5v\" (UID: \"8d98e289-530e-424c-93c0-d0b18fccfcca\") " pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:32.999926 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:32.999890 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" Jun 02 04:50:33.191442 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:33.191326 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77644847-v7d5v"] Jun 02 04:50:33.194424 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:50:33.194390 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d98e289_530e_424c_93c0_d0b18fccfcca.slice/crio-deb05586598703088d1b5bb56243b8b5ce046e58a470f4e7541212538bcf36c3 WatchSource:0}: Error finding container deb05586598703088d1b5bb56243b8b5ce046e58a470f4e7541212538bcf36c3: Status 404 returned error can't find the container with id deb05586598703088d1b5bb56243b8b5ce046e58a470f4e7541212538bcf36c3 Jun 02 04:50:33.322292 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:33.322229 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" event={"ID":"8d98e289-530e-424c-93c0-d0b18fccfcca","Type":"ContainerStarted","Data":"deb05586598703088d1b5bb56243b8b5ce046e58a470f4e7541212538bcf36c3"} Jun 02 04:50:35.336885 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:35.336805 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" event={"ID":"91cf329b-bea0-4f86-bd24-0df5d343dd1d","Type":"ContainerStarted","Data":"2a17be0da0792a0c0361a83f8ec23f57502219ac940697a7fb85200a0e2e03ca"} Jun 02 04:50:35.337341 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:35.337001 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:50:35.366239 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:35.365489 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" podStartSLOduration=1.715745595 podStartE2EDuration="4.365467934s" podCreationTimestamp="2026-06-02 04:50:31 +0000 UTC" firstStartedPulling="2026-06-02 04:50:31.907655883 +0000 UTC m=+479.689917314" lastFinishedPulling="2026-06-02 04:50:34.55737822 +0000 UTC m=+482.339639653" observedRunningTime="2026-06-02 04:50:35.362464527 +0000 UTC m=+483.144725980" watchObservedRunningTime="2026-06-02 04:50:35.365467934 +0000 UTC m=+483.147729390" Jun 02 04:50:37.343864 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:37.343809 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" event={"ID":"8d98e289-530e-424c-93c0-d0b18fccfcca","Type":"ContainerStarted","Data":"6b15f5b79ac5e498ac4f13c1c3c93bc2a7737f157964f3f72e749d2549dffec0"} Jun 02 04:50:37.362117 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:37.362061 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77644847-v7d5v" podStartSLOduration=1.814575671 podStartE2EDuration="5.362042412s" podCreationTimestamp="2026-06-02 04:50:32 +0000 UTC" firstStartedPulling="2026-06-02 04:50:33.197823673 +0000 UTC m=+480.980085107" lastFinishedPulling="2026-06-02 04:50:36.745290407 +0000 UTC m=+484.527551848" observedRunningTime="2026-06-02 04:50:37.359996668 +0000 UTC m=+485.142258133" watchObservedRunningTime="2026-06-02 04:50:37.362042412 +0000 UTC m=+485.144303865" Jun 02 04:50:46.342492 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:50:46.342463 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f46596686-99hf6" Jun 02 04:52:23.622465 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.622425 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj"] Jun 02 04:52:23.626089 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.626067 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.628658 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.628630 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 04:52:23.628806 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.628685 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vjddx\"" Jun 02 04:52:23.629698 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.629678 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 04:52:23.629790 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.629700 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 04:52:23.629790 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.629682 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 04:52:23.633257 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.633233 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj"] Jun 02 04:52:23.789844 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.789807 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dns95\" (UniqueName: \"kubernetes.io/projected/b9198047-ee2a-4aa3-9182-8ba6a775bff5-kube-api-access-dns95\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.790006 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.789863 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9198047-ee2a-4aa3-9182-8ba6a775bff5-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.790006 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.789928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9198047-ee2a-4aa3-9182-8ba6a775bff5-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.890973 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.890869 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dns95\" (UniqueName: \"kubernetes.io/projected/b9198047-ee2a-4aa3-9182-8ba6a775bff5-kube-api-access-dns95\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.890973 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.890951 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9198047-ee2a-4aa3-9182-8ba6a775bff5-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.891271 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.891001 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9198047-ee2a-4aa3-9182-8ba6a775bff5-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.891736 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.891707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b9198047-ee2a-4aa3-9182-8ba6a775bff5-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.894977 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.894946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9198047-ee2a-4aa3-9182-8ba6a775bff5-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.900139 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.900116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dns95\" (UniqueName: \"kubernetes.io/projected/b9198047-ee2a-4aa3-9182-8ba6a775bff5-kube-api-access-dns95\") pod \"kuadrant-console-plugin-6cb54b5c86-2llzj\" (UID: \"b9198047-ee2a-4aa3-9182-8ba6a775bff5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:23.947980 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:23.947947 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" Jun 02 04:52:24.106795 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:24.106744 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj"] Jun 02 04:52:24.110271 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:52:24.110241 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9198047_ee2a_4aa3_9182_8ba6a775bff5.slice/crio-2fe2286e26089e558cfda2124835b11ab2af467d3292c05b65da5dbec4453efe WatchSource:0}: Error finding container 2fe2286e26089e558cfda2124835b11ab2af467d3292c05b65da5dbec4453efe: Status 404 returned error can't find the container with id 2fe2286e26089e558cfda2124835b11ab2af467d3292c05b65da5dbec4453efe Jun 02 04:52:24.698556 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:24.698519 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" event={"ID":"b9198047-ee2a-4aa3-9182-8ba6a775bff5","Type":"ContainerStarted","Data":"2fe2286e26089e558cfda2124835b11ab2af467d3292c05b65da5dbec4453efe"} Jun 02 04:52:25.911246 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:25.911210 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-n5mm7"] Jun 02 04:52:25.915498 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:25.914954 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:25.917731 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:25.917705 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4cz4p\"" Jun 02 04:52:25.924675 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:25.924322 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-n5mm7"] Jun 02 04:52:26.111821 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:26.111751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl5h7\" (UniqueName: \"kubernetes.io/projected/ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb-kube-api-access-tl5h7\") pod \"authorino-operator-657f44b778-n5mm7\" (UID: \"ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb\") " pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:26.213214 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:26.213133 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl5h7\" (UniqueName: \"kubernetes.io/projected/ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb-kube-api-access-tl5h7\") pod \"authorino-operator-657f44b778-n5mm7\" (UID: \"ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb\") " pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:26.225613 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:26.225582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl5h7\" (UniqueName: \"kubernetes.io/projected/ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb-kube-api-access-tl5h7\") pod \"authorino-operator-657f44b778-n5mm7\" (UID: \"ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb\") " pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:26.229243 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:26.229219 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:26.375092 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:26.375061 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-n5mm7"] Jun 02 04:52:26.378407 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:52:26.378377 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9a7e35_4a7d_44a1_8f71_5bf198a8a6bb.slice/crio-e18f99e43ff8c96579777cc98b00f270869ae9163f58c47978c57782220bc4bd WatchSource:0}: Error finding container e18f99e43ff8c96579777cc98b00f270869ae9163f58c47978c57782220bc4bd: Status 404 returned error can't find the container with id e18f99e43ff8c96579777cc98b00f270869ae9163f58c47978c57782220bc4bd Jun 02 04:52:26.707889 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:26.707834 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" event={"ID":"ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb","Type":"ContainerStarted","Data":"e18f99e43ff8c96579777cc98b00f270869ae9163f58c47978c57782220bc4bd"} Jun 02 04:52:30.724871 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:30.724822 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" event={"ID":"ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb","Type":"ContainerStarted","Data":"9109af52151752a7733b2d1dc34273328a3969fa772ab305124164533cec03e4"} Jun 02 04:52:30.725337 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:30.724905 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:30.742450 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:30.742379 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" podStartSLOduration=1.568552993 podStartE2EDuration="5.742366016s" podCreationTimestamp="2026-06-02 04:52:25 +0000 UTC" firstStartedPulling="2026-06-02 04:52:26.381111383 +0000 UTC m=+594.163372814" lastFinishedPulling="2026-06-02 04:52:30.554924406 +0000 UTC m=+598.337185837" observedRunningTime="2026-06-02 04:52:30.740165997 +0000 UTC m=+598.522427453" watchObservedRunningTime="2026-06-02 04:52:30.742366016 +0000 UTC m=+598.524627468" Jun 02 04:52:32.746509 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:32.746477 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:52:32.750239 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:32.750215 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:52:41.730678 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:41.730644 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-n5mm7" Jun 02 04:52:48.793005 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:48.792966 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" event={"ID":"b9198047-ee2a-4aa3-9182-8ba6a775bff5","Type":"ContainerStarted","Data":"7f2405463f3f3f0550e0a8138e47f377c979f071c3010a530a30dbc94d8aba82"} Jun 02 04:52:48.811192 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:52:48.811137 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-2llzj" podStartSLOduration=2.174129778 podStartE2EDuration="25.811122763s" podCreationTimestamp="2026-06-02 04:52:23 +0000 UTC" firstStartedPulling="2026-06-02 04:52:24.111441653 +0000 UTC m=+591.893703084" lastFinishedPulling="2026-06-02 04:52:47.748434633 +0000 UTC m=+615.530696069" observedRunningTime="2026-06-02 04:52:48.8094973 +0000 UTC m=+616.591758751" watchObservedRunningTime="2026-06-02 04:52:48.811122763 +0000 UTC m=+616.593384216" Jun 02 04:53:13.061699 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.061662 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:53:13.114256 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.114221 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:53:13.114256 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.114252 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:53:13.114456 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.114337 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.116928 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.116893 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 04:53:13.126820 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.126795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjckx\" (UniqueName: \"kubernetes.io/projected/ec001fdc-7404-4fec-a494-d75227aaaf3f-kube-api-access-zjckx\") pod \"limitador-limitador-78c99df468-9spwg\" (UID: \"ec001fdc-7404-4fec-a494-d75227aaaf3f\") " pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.126914 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.126864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec001fdc-7404-4fec-a494-d75227aaaf3f-config-file\") pod \"limitador-limitador-78c99df468-9spwg\" (UID: \"ec001fdc-7404-4fec-a494-d75227aaaf3f\") " pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.228106 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.228072 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec001fdc-7404-4fec-a494-d75227aaaf3f-config-file\") pod \"limitador-limitador-78c99df468-9spwg\" (UID: \"ec001fdc-7404-4fec-a494-d75227aaaf3f\") " pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.228265 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.228134 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjckx\" (UniqueName: \"kubernetes.io/projected/ec001fdc-7404-4fec-a494-d75227aaaf3f-kube-api-access-zjckx\") pod \"limitador-limitador-78c99df468-9spwg\" (UID: \"ec001fdc-7404-4fec-a494-d75227aaaf3f\") " pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.228670 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.228651 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ec001fdc-7404-4fec-a494-d75227aaaf3f-config-file\") pod \"limitador-limitador-78c99df468-9spwg\" (UID: \"ec001fdc-7404-4fec-a494-d75227aaaf3f\") " pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.236276 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.236248 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjckx\" (UniqueName: \"kubernetes.io/projected/ec001fdc-7404-4fec-a494-d75227aaaf3f-kube-api-access-zjckx\") pod \"limitador-limitador-78c99df468-9spwg\" (UID: \"ec001fdc-7404-4fec-a494-d75227aaaf3f\") " pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.424919 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.424837 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:13.553149 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.553122 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:53:13.555732 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:53:13.555703 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec001fdc_7404_4fec_a494_d75227aaaf3f.slice/crio-bfc22bb4e9da585161ae2c2f47cc37bc5e63d313ce6d81331b15a97e77c755be WatchSource:0}: Error finding container bfc22bb4e9da585161ae2c2f47cc37bc5e63d313ce6d81331b15a97e77c755be: Status 404 returned error can't find the container with id bfc22bb4e9da585161ae2c2f47cc37bc5e63d313ce6d81331b15a97e77c755be Jun 02 04:53:13.879014 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:13.878982 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" event={"ID":"ec001fdc-7404-4fec-a494-d75227aaaf3f","Type":"ContainerStarted","Data":"bfc22bb4e9da585161ae2c2f47cc37bc5e63d313ce6d81331b15a97e77c755be"} Jun 02 04:53:16.889913 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:16.889878 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" event={"ID":"ec001fdc-7404-4fec-a494-d75227aaaf3f","Type":"ContainerStarted","Data":"55c6feb58be4bcd679c6f20c6a8187c74c7145507b97719e5de984fb68fee069"} Jun 02 04:53:16.890278 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:16.890002 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:53:16.908385 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:16.908342 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" podStartSLOduration=1.47850416 podStartE2EDuration="3.908327081s" podCreationTimestamp="2026-06-02 04:53:13 +0000 UTC" firstStartedPulling="2026-06-02 04:53:13.557746563 +0000 UTC m=+641.340007997" lastFinishedPulling="2026-06-02 04:53:15.987569477 +0000 UTC m=+643.769830918" observedRunningTime="2026-06-02 04:53:16.906976963 +0000 UTC m=+644.689238419" watchObservedRunningTime="2026-06-02 04:53:16.908327081 +0000 UTC m=+644.690588535" Jun 02 04:53:27.894108 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:53:27.894082 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-9spwg" Jun 02 04:54:42.243045 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.242961 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66cdb54589-rbqwt"] Jun 02 04:54:42.246264 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.246249 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:42.251460 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.251294 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 04:54:42.251728 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.251705 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jdfgh\"" Jun 02 04:54:42.260287 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.260256 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66cdb54589-rbqwt"] Jun 02 04:54:42.370592 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.370554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgthm\" (UniqueName: \"kubernetes.io/projected/fa4a94be-74dd-489f-8bfd-cde9869d009e-kube-api-access-jgthm\") pod \"maas-controller-66cdb54589-rbqwt\" (UID: \"fa4a94be-74dd-489f-8bfd-cde9869d009e\") " pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:42.471147 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.471110 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgthm\" (UniqueName: \"kubernetes.io/projected/fa4a94be-74dd-489f-8bfd-cde9869d009e-kube-api-access-jgthm\") pod \"maas-controller-66cdb54589-rbqwt\" (UID: \"fa4a94be-74dd-489f-8bfd-cde9869d009e\") " pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:42.480934 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.480889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgthm\" (UniqueName: \"kubernetes.io/projected/fa4a94be-74dd-489f-8bfd-cde9869d009e-kube-api-access-jgthm\") pod \"maas-controller-66cdb54589-rbqwt\" (UID: \"fa4a94be-74dd-489f-8bfd-cde9869d009e\") " pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:42.558429 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.558399 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:42.683780 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:42.683734 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66cdb54589-rbqwt"] Jun 02 04:54:42.686178 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:54:42.686151 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4a94be_74dd_489f_8bfd_cde9869d009e.slice/crio-1f73799b127f6281ceab6c4155f96123735b107f045788fd73974eeb102a8676 WatchSource:0}: Error finding container 1f73799b127f6281ceab6c4155f96123735b107f045788fd73974eeb102a8676: Status 404 returned error can't find the container with id 1f73799b127f6281ceab6c4155f96123735b107f045788fd73974eeb102a8676 Jun 02 04:54:43.169121 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:43.169089 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cdb54589-rbqwt" event={"ID":"fa4a94be-74dd-489f-8bfd-cde9869d009e","Type":"ContainerStarted","Data":"1f73799b127f6281ceab6c4155f96123735b107f045788fd73974eeb102a8676"} Jun 02 04:54:45.179778 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:45.179721 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cdb54589-rbqwt" event={"ID":"fa4a94be-74dd-489f-8bfd-cde9869d009e","Type":"ContainerStarted","Data":"879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862"} Jun 02 04:54:45.180162 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:45.179838 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:45.197018 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:45.196965 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-66cdb54589-rbqwt" podStartSLOduration=0.81555347 podStartE2EDuration="3.196952339s" podCreationTimestamp="2026-06-02 04:54:42 +0000 UTC" firstStartedPulling="2026-06-02 04:54:42.687466533 +0000 UTC m=+730.469727964" lastFinishedPulling="2026-06-02 04:54:45.068865398 +0000 UTC m=+732.851126833" observedRunningTime="2026-06-02 04:54:45.196181105 +0000 UTC m=+732.978442556" watchObservedRunningTime="2026-06-02 04:54:45.196952339 +0000 UTC m=+732.979213792" Jun 02 04:54:56.188724 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:56.188694 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:56.648011 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:56.647971 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66cdb54589-rbqwt"] Jun 02 04:54:56.648223 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:56.648198 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-66cdb54589-rbqwt" podUID="fa4a94be-74dd-489f-8bfd-cde9869d009e" containerName="manager" containerID="cri-o://879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862" gracePeriod=30 Jun 02 04:54:56.888751 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:56.888729 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:57.002818 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.002693 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgthm\" (UniqueName: \"kubernetes.io/projected/fa4a94be-74dd-489f-8bfd-cde9869d009e-kube-api-access-jgthm\") pod \"fa4a94be-74dd-489f-8bfd-cde9869d009e\" (UID: \"fa4a94be-74dd-489f-8bfd-cde9869d009e\") " Jun 02 04:54:57.005100 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.005076 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4a94be-74dd-489f-8bfd-cde9869d009e-kube-api-access-jgthm" (OuterVolumeSpecName: "kube-api-access-jgthm") pod "fa4a94be-74dd-489f-8bfd-cde9869d009e" (UID: "fa4a94be-74dd-489f-8bfd-cde9869d009e"). InnerVolumeSpecName "kube-api-access-jgthm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:54:57.103854 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.103815 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgthm\" (UniqueName: \"kubernetes.io/projected/fa4a94be-74dd-489f-8bfd-cde9869d009e-kube-api-access-jgthm\") on node \"ip-10-0-132-27.ec2.internal\" DevicePath \"\"" Jun 02 04:54:57.221232 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.221198 2563 generic.go:358] "Generic (PLEG): container finished" podID="fa4a94be-74dd-489f-8bfd-cde9869d009e" containerID="879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862" exitCode=0 Jun 02 04:54:57.221624 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.221267 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66cdb54589-rbqwt" Jun 02 04:54:57.221624 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.221283 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cdb54589-rbqwt" event={"ID":"fa4a94be-74dd-489f-8bfd-cde9869d009e","Type":"ContainerDied","Data":"879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862"} Jun 02 04:54:57.221624 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.221326 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66cdb54589-rbqwt" event={"ID":"fa4a94be-74dd-489f-8bfd-cde9869d009e","Type":"ContainerDied","Data":"1f73799b127f6281ceab6c4155f96123735b107f045788fd73974eeb102a8676"} Jun 02 04:54:57.221624 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.221342 2563 scope.go:117] "RemoveContainer" containerID="879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862" Jun 02 04:54:57.230353 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.230337 2563 scope.go:117] "RemoveContainer" containerID="879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862" Jun 02 04:54:57.230572 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:54:57.230554 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862\": container with ID starting with 879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862 not found: ID does not exist" containerID="879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862" Jun 02 04:54:57.230620 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.230579 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862"} err="failed to get container status \"879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862\": rpc error: code = NotFound desc = could not find container \"879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862\": container with ID starting with 879b7bebba4b5c32ddc3424a72d4640de599f6efe1baaa9c96d3dee8d916b862 not found: ID does not exist" Jun 02 04:54:57.242726 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.242703 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66cdb54589-rbqwt"] Jun 02 04:54:57.246128 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:57.246106 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66cdb54589-rbqwt"] Jun 02 04:54:58.840358 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:54:58.840321 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa4a94be-74dd-489f-8bfd-cde9869d009e" path="/var/lib/kubelet/pods/fa4a94be-74dd-489f-8bfd-cde9869d009e/volumes" Jun 02 04:55:17.944488 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.944451 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-d894bd765-qv2lj"] Jun 02 04:55:17.944971 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.944761 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4a94be-74dd-489f-8bfd-cde9869d009e" containerName="manager" Jun 02 04:55:17.944971 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.944788 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4a94be-74dd-489f-8bfd-cde9869d009e" containerName="manager" Jun 02 04:55:17.944971 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.944854 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="fa4a94be-74dd-489f-8bfd-cde9869d009e" containerName="manager" Jun 02 04:55:17.949104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.949088 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:17.951605 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.951585 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-s98rm\"" Jun 02 04:55:17.951714 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.951647 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 04:55:17.955956 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:17.955932 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d894bd765-qv2lj"] Jun 02 04:55:18.062530 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.062496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-maas-api-tls\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.062695 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.062538 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9bzp\" (UniqueName: \"kubernetes.io/projected/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-kube-api-access-l9bzp\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.163877 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.163837 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-maas-api-tls\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.163877 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.163879 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9bzp\" (UniqueName: \"kubernetes.io/projected/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-kube-api-access-l9bzp\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.164109 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:55:18.163983 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 02 04:55:18.164109 ip-10-0-132-27 kubenswrapper[2563]: E0602 04:55:18.164050 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-maas-api-tls podName:ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6 nodeName:}" failed. No retries permitted until 2026-06-02 04:55:18.664033443 +0000 UTC m=+766.446294875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-maas-api-tls") pod "maas-api-d894bd765-qv2lj" (UID: "ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6") : secret "maas-api-serving-cert" not found Jun 02 04:55:18.172593 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.172570 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9bzp\" (UniqueName: \"kubernetes.io/projected/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-kube-api-access-l9bzp\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.486149 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.486115 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:55:18.667806 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.667740 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-maas-api-tls\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.670319 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.670294 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6-maas-api-tls\") pod \"maas-api-d894bd765-qv2lj\" (UID: \"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6\") " pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.859633 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.859604 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:18.986874 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.986842 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-d894bd765-qv2lj"] Jun 02 04:55:18.989392 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:55:18.989366 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded38d32d_8429_4a83_b8d5_0ddd2f5bf2e6.slice/crio-f436be51c22149f80035ad0bfccedbc31f6b75a9f74b17772f2158c1ef9bd4e1 WatchSource:0}: Error finding container f436be51c22149f80035ad0bfccedbc31f6b75a9f74b17772f2158c1ef9bd4e1: Status 404 returned error can't find the container with id f436be51c22149f80035ad0bfccedbc31f6b75a9f74b17772f2158c1ef9bd4e1 Jun 02 04:55:18.991040 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:18.991022 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:55:19.295337 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:19.295293 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d894bd765-qv2lj" event={"ID":"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6","Type":"ContainerStarted","Data":"f436be51c22149f80035ad0bfccedbc31f6b75a9f74b17772f2158c1ef9bd4e1"} Jun 02 04:55:21.303098 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:21.303055 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-d894bd765-qv2lj" event={"ID":"ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6","Type":"ContainerStarted","Data":"2e13c088368f0b465d8b4ce33ba9349122770fcb948f9ba254a7b4fc5111a8a8"} Jun 02 04:55:21.303457 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:21.303170 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:55:21.324310 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:21.324270 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-d894bd765-qv2lj" podStartSLOduration=2.7487056770000002 podStartE2EDuration="4.324258428s" podCreationTimestamp="2026-06-02 04:55:17 +0000 UTC" firstStartedPulling="2026-06-02 04:55:18.99113905 +0000 UTC m=+766.773400481" lastFinishedPulling="2026-06-02 04:55:20.566691801 +0000 UTC m=+768.348953232" observedRunningTime="2026-06-02 04:55:21.322039743 +0000 UTC m=+769.104301196" watchObservedRunningTime="2026-06-02 04:55:21.324258428 +0000 UTC m=+769.106519880" Jun 02 04:55:27.310968 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:55:27.310937 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-d894bd765-qv2lj" Jun 02 04:56:14.644595 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:56:14.644553 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:56:19.945403 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:56:19.945367 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:56:33.258438 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:56:33.258401 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:56:38.856599 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:56:38.856562 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:56:45.444760 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:56:45.444722 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:56:50.303271 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:56:50.303229 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:57:32.772570 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:57:32.772475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:57:32.777255 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:57:32.777235 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 04:57:58.060138 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:57:58.060099 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:04.148200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:04.148154 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:12.847450 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:12.847417 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:19.393173 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:19.393140 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:28.944109 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:28.944075 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:38.148562 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:38.148519 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:47.248652 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:47.248567 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:58:56.853489 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:58:56.853455 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 04:59:05.295104 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.295070 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-679b7f88b7-4t6h6"] Jun 02 04:59:05.298359 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.298338 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 04:59:05.300880 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.300837 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 04:59:05.300992 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.300839 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jdfgh\"" Jun 02 04:59:05.305931 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.305913 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679b7f88b7-4t6h6"] Jun 02 04:59:05.394145 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.394116 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvn67\" (UniqueName: \"kubernetes.io/projected/d8eee928-75b4-4e19-8ca5-586a3ebb1723-kube-api-access-fvn67\") pod \"maas-controller-679b7f88b7-4t6h6\" (UID: \"d8eee928-75b4-4e19-8ca5-586a3ebb1723\") " pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 04:59:05.494543 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.494501 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvn67\" (UniqueName: \"kubernetes.io/projected/d8eee928-75b4-4e19-8ca5-586a3ebb1723-kube-api-access-fvn67\") pod \"maas-controller-679b7f88b7-4t6h6\" (UID: \"d8eee928-75b4-4e19-8ca5-586a3ebb1723\") " pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 04:59:05.503346 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.503317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvn67\" (UniqueName: \"kubernetes.io/projected/d8eee928-75b4-4e19-8ca5-586a3ebb1723-kube-api-access-fvn67\") pod \"maas-controller-679b7f88b7-4t6h6\" (UID: \"d8eee928-75b4-4e19-8ca5-586a3ebb1723\") " pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 04:59:05.609421 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.609326 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 04:59:05.737186 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:05.737152 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-679b7f88b7-4t6h6"] Jun 02 04:59:05.740843 ip-10-0-132-27 kubenswrapper[2563]: W0602 04:59:05.740813 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8eee928_75b4_4e19_8ca5_586a3ebb1723.slice/crio-9ad39b14d79e7bf536a2c9acf14c60db84b13045a59011e48df2aa74be355f62 WatchSource:0}: Error finding container 9ad39b14d79e7bf536a2c9acf14c60db84b13045a59011e48df2aa74be355f62: Status 404 returned error can't find the container with id 9ad39b14d79e7bf536a2c9acf14c60db84b13045a59011e48df2aa74be355f62 Jun 02 04:59:06.022327 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:06.022289 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" event={"ID":"d8eee928-75b4-4e19-8ca5-586a3ebb1723","Type":"ContainerStarted","Data":"9ad39b14d79e7bf536a2c9acf14c60db84b13045a59011e48df2aa74be355f62"} Jun 02 04:59:07.027185 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:07.027145 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" event={"ID":"d8eee928-75b4-4e19-8ca5-586a3ebb1723","Type":"ContainerStarted","Data":"e6e6b3a06c632f2aadd6f0e195f529d4aaffed301060cc78d913c99979c8d5b5"} Jun 02 04:59:07.027812 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:07.027208 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 04:59:07.045200 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:07.045143 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" podStartSLOduration=1.603715317 podStartE2EDuration="2.045127567s" podCreationTimestamp="2026-06-02 04:59:05 +0000 UTC" firstStartedPulling="2026-06-02 04:59:05.741983221 +0000 UTC m=+993.524244652" lastFinishedPulling="2026-06-02 04:59:06.183395467 +0000 UTC m=+993.965656902" observedRunningTime="2026-06-02 04:59:07.043910583 +0000 UTC m=+994.826172037" watchObservedRunningTime="2026-06-02 04:59:07.045127567 +0000 UTC m=+994.827389019" Jun 02 04:59:18.036202 ip-10-0-132-27 kubenswrapper[2563]: I0602 04:59:18.036165 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-679b7f88b7-4t6h6" Jun 02 05:00:11.049916 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:00:11.049885 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:00:27.079098 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:00:27.078999 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:01:06.542305 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:01:06.542270 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:01:23.651048 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:01:23.651015 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:01:36.255541 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:01:36.255502 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:01:51.349377 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:01:51.349279 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:01:57.264109 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:01:57.264070 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:02:32.795462 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:02:32.795434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:02:32.801006 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:02:32.800981 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:02:52.850176 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:02:52.850145 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:03:01.848520 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:03:01.848477 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:03:18.857030 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:03:18.856937 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:03:25.153920 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:03:25.153882 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:03:42.757262 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:03:42.757223 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:03:51.784875 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:03:51.784839 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:04:23.844008 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:04:23.843970 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:04:32.549134 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:04:32.549090 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:04:42.044827 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:04:42.044786 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:04:50.365155 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:04:50.365079 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:04:58.143039 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:04:58.143006 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:05:14.353554 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:05:14.353515 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:05:27.756894 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:05:27.756854 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:06:16.245143 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:06:16.245100 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:06:23.944478 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:06:23.944437 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:06:29.569610 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:06:29.569571 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:06:38.044504 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:06:38.044462 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:06:46.755083 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:06:46.755046 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:06:55.563795 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:06:55.563745 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:04.562092 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:04.562054 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:13.151582 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:13.151543 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:24.485838 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:24.485796 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:30.955177 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:30.955142 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:32.821086 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:32.821047 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:07:32.827817 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:32.827796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:07:39.855118 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:39.855085 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:46.746299 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:46.746213 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:07:57.147742 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:07:57.147699 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:08:06.059083 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:08:06.059036 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:08:15.146134 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:08:15.146099 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:08:23.850641 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:08:23.850602 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:08:32.453318 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:08:32.453279 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:08:39.059466 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:08:39.059432 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:10:58.647431 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:10:58.647347 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:11:04.848969 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:11:04.848933 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:11:30.663316 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:11:30.663279 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:11:36.651270 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:11:36.651236 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:11:47.444289 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:11:47.444250 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:11:57.758496 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:11:57.758453 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:12:06.253637 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:06.253602 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:12:17.253790 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:17.253698 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:12:26.145136 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:26.145091 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:12:32.844874 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:32.844846 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:12:32.852468 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:32.852443 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:12:35.244950 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:35.244905 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:12:44.448530 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:44.448492 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:12:55.048115 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:12:55.048082 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:13:04.842021 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:13:04.841985 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:13:39.854987 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:13:39.854951 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:14:22.438377 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:14:22.438286 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:14:31.649992 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:14:31.649955 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:14:40.352881 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:14:40.352827 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:14:47.355160 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:14:47.355123 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:14:55.653340 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:14:55.653303 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:15:10.151370 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:15:10.151336 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:15:18.448873 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:15:18.448744 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:15:29.946559 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:15:29.946523 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:15:35.767690 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:15:35.767648 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:15:46.244710 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:15:46.244677 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:15:54.749660 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:15:54.749625 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:16:06.846218 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:16:06.846184 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:16:23.752455 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:16:23.752415 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:16:33.052862 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:16:33.052817 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:16:41.642267 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:16:41.642232 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:16:48.746254 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:16:48.746170 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:17:05.957117 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:05.957085 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:17:15.150587 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:15.150555 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:17:24.047718 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:24.047670 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:17:32.866735 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:32.866704 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:17:32.882869 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:32.882844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:17:34.845854 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:34.845815 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:17:43.644244 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:43.644207 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:17:51.049454 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:17:51.049423 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:18:01.460363 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:18:01.460329 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:18:16.750603 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:18:16.750520 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:18:25.343350 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:18:25.343306 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:18:38.146693 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:18:38.146654 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:18:46.762237 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:18:46.762198 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:18:57.854807 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:18:57.854747 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:19:07.146034 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:19:07.146001 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:19:15.339777 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:19:15.339703 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:19:33.645793 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:19:33.645732 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:19:40.554102 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:19:40.554068 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:19:50.955084 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:19:50.955000 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:19:58.945891 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:19:58.945857 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:20:23.153463 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:23.153426 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:20:37.451604 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:37.451570 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9spwg"] Jun 02 05:20:46.948786 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:46.948735 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d894bd765-qv2lj_ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6/maas-api/0.log" Jun 02 05:20:47.291898 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:47.291869 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-679b7f88b7-4t6h6_d8eee928-75b4-4e19-8ca5-586a3ebb1723/manager/0.log" Jun 02 05:20:47.747531 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:47.747459 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-jpm9p_90c6c9d0-e82d-4247-8792-968eeb10f3d1/copy-manifests/0.log" Jun 02 05:20:47.760316 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:47.760293 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-jpm9p_90c6c9d0-e82d-4247-8792-968eeb10f3d1/manager/0.log" Jun 02 05:20:49.419173 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:49.419141 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-n5mm7_ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb/manager/0.log" Jun 02 05:20:49.633657 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:49.633630 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-2llzj_b9198047-ee2a-4aa3-9182-8ba6a775bff5/kuadrant-console-plugin/0.log" Jun 02 05:20:49.998713 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:49.998685 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-9spwg_ec001fdc-7404-4fec-a494-d75227aaaf3f/limitador/0.log" Jun 02 05:20:50.707737 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:50.707689 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77644847-v7d5v_8d98e289-530e-424c-93c0-d0b18fccfcca/kube-auth-proxy/0.log" Jun 02 05:20:51.160953 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:51.160926 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565f6ff7c9-p25dv_39823f2c-324b-432b-b415-f80912340496/router/0.log" Jun 02 05:20:56.517519 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.517474 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf6h5/must-gather-5f54g"] Jun 02 05:20:56.521175 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.521152 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.535053 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.535022 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf6h5\"/\"openshift-service-ca.crt\"" Jun 02 05:20:56.535184 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.535116 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf6h5\"/\"kube-root-ca.crt\"" Jun 02 05:20:56.535231 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.535185 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mf6h5\"/\"default-dockercfg-s222j\"" Jun 02 05:20:56.550019 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.549997 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf6h5/must-gather-5f54g"] Jun 02 05:20:56.590004 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.589963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gln56\" (UniqueName: \"kubernetes.io/projected/0f3159e3-3ea0-4a86-b33c-4942d24b3dcd-kube-api-access-gln56\") pod \"must-gather-5f54g\" (UID: \"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd\") " pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.590177 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.590037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f3159e3-3ea0-4a86-b33c-4942d24b3dcd-must-gather-output\") pod \"must-gather-5f54g\" (UID: \"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd\") " pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.690439 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.690399 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gln56\" (UniqueName: \"kubernetes.io/projected/0f3159e3-3ea0-4a86-b33c-4942d24b3dcd-kube-api-access-gln56\") pod \"must-gather-5f54g\" (UID: \"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd\") " pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.690605 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.690464 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f3159e3-3ea0-4a86-b33c-4942d24b3dcd-must-gather-output\") pod \"must-gather-5f54g\" (UID: \"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd\") " pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.690815 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.690797 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0f3159e3-3ea0-4a86-b33c-4942d24b3dcd-must-gather-output\") pod \"must-gather-5f54g\" (UID: \"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd\") " pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.710743 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.710705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gln56\" (UniqueName: \"kubernetes.io/projected/0f3159e3-3ea0-4a86-b33c-4942d24b3dcd-kube-api-access-gln56\") pod \"must-gather-5f54g\" (UID: \"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd\") " pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.830608 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.830573 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf6h5/must-gather-5f54g" Jun 02 05:20:56.961867 ip-10-0-132-27 kubenswrapper[2563]: W0602 05:20:56.961827 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f3159e3_3ea0_4a86_b33c_4942d24b3dcd.slice/crio-08973a1ceee6bd6ff05e812d663f9d6fe0e68aac23b78429f863629ccc75ae2c WatchSource:0}: Error finding container 08973a1ceee6bd6ff05e812d663f9d6fe0e68aac23b78429f863629ccc75ae2c: Status 404 returned error can't find the container with id 08973a1ceee6bd6ff05e812d663f9d6fe0e68aac23b78429f863629ccc75ae2c Jun 02 05:20:56.962739 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.962707 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf6h5/must-gather-5f54g"] Jun 02 05:20:56.963605 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:56.963590 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:20:57.340754 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:57.340717 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/must-gather-5f54g" event={"ID":"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd","Type":"ContainerStarted","Data":"08973a1ceee6bd6ff05e812d663f9d6fe0e68aac23b78429f863629ccc75ae2c"} Jun 02 05:20:58.349872 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:58.349834 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/must-gather-5f54g" event={"ID":"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd","Type":"ContainerStarted","Data":"595aa2f4eb73ad6ab6f99f2327694e0f900f3cc7a675c26498d6ec8b9ef3e8aa"} Jun 02 05:20:58.349872 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:58.349873 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/must-gather-5f54g" event={"ID":"0f3159e3-3ea0-4a86-b33c-4942d24b3dcd","Type":"ContainerStarted","Data":"700c08aaa5b1bee49cf2fff0ce712f3c27963879d838edd4d7b74cc3ea6ccce4"} Jun 02 05:20:58.392109 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:58.392046 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mf6h5/must-gather-5f54g" podStartSLOduration=1.529431489 podStartE2EDuration="2.392025604s" podCreationTimestamp="2026-06-02 05:20:56 +0000 UTC" firstStartedPulling="2026-06-02 05:20:56.96374213 +0000 UTC m=+2304.746003562" lastFinishedPulling="2026-06-02 05:20:57.826336242 +0000 UTC m=+2305.608597677" observedRunningTime="2026-06-02 05:20:58.390691331 +0000 UTC m=+2306.172952784" watchObservedRunningTime="2026-06-02 05:20:58.392025604 +0000 UTC m=+2306.174287060" Jun 02 05:20:59.758882 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:59.758853 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6tkmn_5239d059-c2e7-41ec-9826-50e4f07fa70c/global-pull-secret-syncer/0.log" Jun 02 05:20:59.858020 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:59.857994 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4jcw2_27037e14-66ef-40e1-8dcd-ad807abab817/konnectivity-agent/0.log" Jun 02 05:20:59.963809 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:20:59.963781 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-27.ec2.internal_6aedcff271f357909731b7f93c1315e3/haproxy/0.log" Jun 02 05:21:04.271387 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:04.271340 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-n5mm7_ae9a7e35-4a7d-44a1-8f71-5bf198a8a6bb/manager/0.log" Jun 02 05:21:04.327268 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:04.327238 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-2llzj_b9198047-ee2a-4aa3-9182-8ba6a775bff5/kuadrant-console-plugin/0.log" Jun 02 05:21:04.446261 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:04.446184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-9spwg_ec001fdc-7404-4fec-a494-d75227aaaf3f/limitador/0.log" Jun 02 05:21:05.974347 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:05.974311 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-rbfr7_36feed34-58e7-4898-ba5e-c95fac40996d/kube-state-metrics/0.log" Jun 02 05:21:05.992332 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:05.992290 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-rbfr7_36feed34-58e7-4898-ba5e-c95fac40996d/kube-rbac-proxy-main/0.log" Jun 02 05:21:06.016176 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.016154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-rbfr7_36feed34-58e7-4898-ba5e-c95fac40996d/kube-rbac-proxy-self/0.log" Jun 02 05:21:06.096990 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.096935 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xz4b_55a7657b-657c-41a6-b602-d7a62eb9ae77/node-exporter/0.log" Jun 02 05:21:06.119320 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.119253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xz4b_55a7657b-657c-41a6-b602-d7a62eb9ae77/kube-rbac-proxy/0.log" Jun 02 05:21:06.147853 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.147815 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5xz4b_55a7657b-657c-41a6-b602-d7a62eb9ae77/init-textfile/0.log" Jun 02 05:21:06.348959 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.348927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-k4wvh_9153c29c-75b6-437c-9a83-57c1d8a35653/kube-rbac-proxy-main/0.log" Jun 02 05:21:06.389710 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.389677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-k4wvh_9153c29c-75b6-437c-9a83-57c1d8a35653/kube-rbac-proxy-self/0.log" Jun 02 05:21:06.413024 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.412993 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-k4wvh_9153c29c-75b6-437c-9a83-57c1d8a35653/openshift-state-metrics/0.log" Jun 02 05:21:06.455076 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.455039 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/prometheus/0.log" Jun 02 05:21:06.481465 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.481431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/config-reloader/0.log" Jun 02 05:21:06.513597 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.513565 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/thanos-sidecar/0.log" Jun 02 05:21:06.537188 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.537156 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/kube-rbac-proxy-web/0.log" Jun 02 05:21:06.567697 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.566543 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/kube-rbac-proxy/0.log" Jun 02 05:21:06.604050 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.603950 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/kube-rbac-proxy-thanos/0.log" Jun 02 05:21:06.634031 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.633900 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_614f8035-332c-4967-b8b6-a900358f9e82/init-config-reloader/0.log" Jun 02 05:21:06.674896 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.674864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-hvdlq_3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c/prometheus-operator/0.log" Jun 02 05:21:06.702460 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:06.702358 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-hvdlq_3c5aaa6d-4f9b-476a-a6aa-2ebf1437ba4c/kube-rbac-proxy/0.log" Jun 02 05:21:09.227293 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.227262 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-sh869_98f6214c-89bb-40b8-b552-deda93f27576/download-server/0.log" Jun 02 05:21:09.741053 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.741020 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc"] Jun 02 05:21:09.748881 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.748855 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.754887 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.754853 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc"] Jun 02 05:21:09.825467 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.825433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-542s5\" (UniqueName: \"kubernetes.io/projected/a187552c-b1aa-446d-a2df-eea3e6213afa-kube-api-access-542s5\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.825732 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.825706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-lib-modules\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.825907 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.825890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-sys\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.826112 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.826089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-proc\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.826237 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.826222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-podres\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927608 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927579 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-sys\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927842 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927643 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-proc\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927842 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927667 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-podres\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927842 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927696 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-542s5\" (UniqueName: \"kubernetes.io/projected/a187552c-b1aa-446d-a2df-eea3e6213afa-kube-api-access-542s5\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927842 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927707 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-sys\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927842 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927737 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-lib-modules\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.927842 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-proc\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.928078 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-podres\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.928078 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.927876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a187552c-b1aa-446d-a2df-eea3e6213afa-lib-modules\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:09.936318 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:09.936286 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-542s5\" (UniqueName: \"kubernetes.io/projected/a187552c-b1aa-446d-a2df-eea3e6213afa-kube-api-access-542s5\") pod \"perf-node-gather-daemonset-fpslc\" (UID: \"a187552c-b1aa-446d-a2df-eea3e6213afa\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:10.062290 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.062254 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:10.226429 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.226402 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc"] Jun 02 05:21:10.400565 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.400533 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" event={"ID":"a187552c-b1aa-446d-a2df-eea3e6213afa","Type":"ContainerStarted","Data":"568a283f6b2ed3456e319500e63e4caca5d94d826308dd780916ed3bc20ba475"} Jun 02 05:21:10.400565 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.400569 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" event={"ID":"a187552c-b1aa-446d-a2df-eea3e6213afa","Type":"ContainerStarted","Data":"ca08a4a9c3a5bb4a04fc3e5417e1b985f7cf56cc6b4aa825eb77e30107e793eb"} Jun 02 05:21:10.400982 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.400678 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:10.419897 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.419847 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" podStartSLOduration=1.419831082 podStartE2EDuration="1.419831082s" podCreationTimestamp="2026-06-02 05:21:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:21:10.41888646 +0000 UTC m=+2318.201147912" watchObservedRunningTime="2026-06-02 05:21:10.419831082 +0000 UTC m=+2318.202092535" Jun 02 05:21:10.699377 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.699306 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5l44_f9b8947b-721e-4443-9565-f994b0749a0c/dns/0.log" Jun 02 05:21:10.720663 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.720636 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s5l44_f9b8947b-721e-4443-9565-f994b0749a0c/kube-rbac-proxy/0.log" Jun 02 05:21:10.783170 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:10.783141 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2dqnm_74a0ee00-cd9a-4498-b61f-f92d6a6ffbd7/dns-node-resolver/0.log" Jun 02 05:21:11.329348 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:11.329323 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tkmbg_aad941c8-a1aa-42b0-b94a-96ce43c6273d/node-ca/0.log" Jun 02 05:21:12.291082 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:12.291057 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77644847-v7d5v_8d98e289-530e-424c-93c0-d0b18fccfcca/kube-auth-proxy/0.log" Jun 02 05:21:12.457854 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:12.457822 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-565f6ff7c9-p25dv_39823f2c-324b-432b-b415-f80912340496/router/0.log" Jun 02 05:21:12.966176 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:12.966148 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h2nlw_8a0e601f-ccac-4d92-a601-394064cb97c0/serve-healthcheck-canary/0.log" Jun 02 05:21:13.502386 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:13.502360 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b9cdv_f4d74f24-1de3-4ad4-a07d-fafe43d6568f/kube-rbac-proxy/0.log" Jun 02 05:21:13.525151 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:13.525129 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b9cdv_f4d74f24-1de3-4ad4-a07d-fafe43d6568f/exporter/0.log" Jun 02 05:21:13.550780 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:13.550742 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-b9cdv_f4d74f24-1de3-4ad4-a07d-fafe43d6568f/extractor/0.log" Jun 02 05:21:15.898302 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:15.898274 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-d894bd765-qv2lj_ed38d32d-8429-4a83-b8d5-0ddd2f5bf2e6/maas-api/0.log" Jun 02 05:21:16.015627 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:16.015597 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-679b7f88b7-4t6h6_d8eee928-75b4-4e19-8ca5-586a3ebb1723/manager/0.log" Jun 02 05:21:16.244149 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:16.244072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-jpm9p_90c6c9d0-e82d-4247-8792-968eeb10f3d1/manager/0.log" Jun 02 05:21:16.260621 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:16.260594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-jpm9p_90c6c9d0-e82d-4247-8792-968eeb10f3d1/copy-manifests/0.log" Jun 02 05:21:16.418430 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:16.418356 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-fpslc" Jun 02 05:21:17.649311 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:17.649263 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f46596686-99hf6_91cf329b-bea0-4f86-bd24-0df5d343dd1d/manager/0.log" Jun 02 05:21:23.018241 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:23.018184 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-v76cb_75a21974-5053-42ba-9095-ca1cef397976/kube-storage-version-migrator-operator/1.log" Jun 02 05:21:23.019041 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:23.019022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-v76cb_75a21974-5053-42ba-9095-ca1cef397976/kube-storage-version-migrator-operator/0.log" Jun 02 05:21:24.184152 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.184126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/kube-multus-additional-cni-plugins/0.log" Jun 02 05:21:24.222174 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.222147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/egress-router-binary-copy/0.log" Jun 02 05:21:24.260404 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.260312 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/cni-plugins/0.log" Jun 02 05:21:24.295146 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.295116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/bond-cni-plugin/0.log" Jun 02 05:21:24.331109 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.331086 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/routeoverride-cni/0.log" Jun 02 05:21:24.367132 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.367104 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/whereabouts-cni-bincopy/0.log" Jun 02 05:21:24.387088 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.387066 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cnx4c_a2a9a55e-4ffe-4521-9018-d33f6f034b4e/whereabouts-cni/0.log" Jun 02 05:21:24.682732 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.682703 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dzwck_8050a471-4a99-4bd9-9aaf-e4ee1a535db0/kube-multus/0.log" Jun 02 05:21:24.859045 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.859020 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrjs7_b5b920bb-c69e-4df4-9978-67bc26f91798/network-metrics-daemon/0.log" Jun 02 05:21:24.879575 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:24.879546 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zrjs7_b5b920bb-c69e-4df4-9978-67bc26f91798/kube-rbac-proxy/0.log" Jun 02 05:21:26.201907 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:26.201789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-controller/0.log" Jun 02 05:21:26.222845 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:26.222815 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/0.log" Jun 02 05:21:26.235596 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:26.235576 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/ovn-acl-logging/1.log" Jun 02 05:21:26.255692 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:26.255665 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/kube-rbac-proxy-node/0.log" Jun 02 05:21:26.277354 ip-10-0-132-27 kubenswrapper[2563]: I0602 05:21:26.277322 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nmhf8_88285037-dc2e-405c-a1c6-d4358e2db5c2/kube-rbac-proxy-ovn-metrics/0.log"