Jun 05 11:37:17.794158 ip-10-0-140-113 systemd[1]: Starting Kubernetes Kubelet... Jun 05 11:37:18.233068 ip-10-0-140-113 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 11:37:18.233068 ip-10-0-140-113 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 11:37:18.233068 ip-10-0-140-113 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 11:37:18.233068 ip-10-0-140-113 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 11:37:18.233068 ip-10-0-140-113 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 11:37:18.235189 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.235095 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245772 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245797 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245815 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245820 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245824 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245828 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:37:18.245819 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245832 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245836 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245840 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245844 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245848 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245851 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245854 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245858 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245862 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245865 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245869 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245872 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245883 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245887 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245891 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245894 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245898 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245902 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245905 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245909 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:37:18.246228 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245912 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245916 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245920 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245924 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245928 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245933 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245937 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245940 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245944 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245948 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245952 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245956 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245961 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245965 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245969 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245973 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245977 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245982 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245985 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:37:18.246986 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245989 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245994 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.245998 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246002 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246006 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246012 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246018 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246022 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246026 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246030 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246035 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246039 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246044 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246048 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246052 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246056 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246061 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246065 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246069 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246073 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:37:18.247472 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246077 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246082 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246086 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246090 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246094 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246098 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246104 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246110 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246114 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246119 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246123 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246127 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246132 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246136 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246140 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246144 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246153 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246159 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246165 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:37:18.248197 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246170 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246175 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246179 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246183 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246187 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246191 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246197 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246203 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246208 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246213 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246217 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246221 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246226 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246231 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.246237 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248388 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248401 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248408 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248413 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:37:18.249018 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248417 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248422 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248427 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248431 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248436 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248440 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248444 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248448 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248452 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248456 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248461 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248465 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248470 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248477 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248484 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248488 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248493 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248497 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248501 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:37:18.249788 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248506 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248511 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248516 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248520 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248525 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248529 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248533 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248538 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248543 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248547 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248551 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248555 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248559 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248567 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248572 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248577 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248582 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248587 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248591 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248596 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:37:18.250718 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248600 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248604 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248609 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248613 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248618 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248622 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248626 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248631 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248635 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248640 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248645 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248649 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248653 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248657 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248661 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248666 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248670 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248674 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248678 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:37:18.251609 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248682 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248686 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248691 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248695 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248699 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248703 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248707 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248711 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248716 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248720 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248727 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248732 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248738 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248743 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248747 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248751 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248756 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248761 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248766 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:37:18.252189 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248771 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248777 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248782 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248786 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248791 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248840 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248847 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248852 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248857 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248862 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248867 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248871 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248875 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248879 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248884 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248888 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248892 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.248897 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249600 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249611 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:37:18.252708 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249617 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249629 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249634 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249639 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249644 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249648 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249653 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249657 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249661 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249665 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249670 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249675 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249679 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249683 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249689 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249693 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249697 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249701 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249705 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249710 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:37:18.253362 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249714 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249718 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249724 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249731 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249735 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249740 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249744 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249748 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249752 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249757 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249761 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249765 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249769 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249775 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249779 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249783 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249787 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249792 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249798 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:37:18.254108 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249821 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249825 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249830 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249834 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249839 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249852 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249857 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249862 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249869 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249873 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249878 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249882 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249886 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249890 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249895 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249899 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249903 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249908 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249912 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249916 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:37:18.254617 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249920 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249924 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249929 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249933 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249937 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249941 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249946 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249950 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249955 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249959 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249964 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249968 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249972 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249976 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249981 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249985 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249990 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249994 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.249998 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250002 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:37:18.255132 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250007 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250012 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250016 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250022 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250026 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250030 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250035 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250039 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250043 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250047 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250052 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250056 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250060 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250065 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250070 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250074 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250078 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.250082 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250192 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250204 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250215 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 11:37:18.255741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250222 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250229 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250234 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250241 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250248 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250253 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250258 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250264 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250270 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250276 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250280 2574 flags.go:64] FLAG: --cgroup-root="" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250285 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250290 2574 flags.go:64] FLAG: --client-ca-file="" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250295 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250300 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250307 2574 flags.go:64] FLAG: --cluster-domain="" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250312 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250318 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250323 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250328 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250335 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250339 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250344 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 11:37:18.256290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250349 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250354 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250360 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250365 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250370 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250375 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250381 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250387 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250392 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250397 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250402 2574 flags.go:64] FLAG: --enable-server="true" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250407 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250414 2574 flags.go:64] FLAG: --event-burst="100" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250419 2574 flags.go:64] FLAG: --event-qps="50" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250427 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250433 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250438 2574 flags.go:64] FLAG: --eviction-hard="" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250444 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250449 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250453 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250458 2574 flags.go:64] FLAG: --eviction-soft="" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250463 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250468 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250474 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250479 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 11:37:18.256940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250484 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250489 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250494 2574 flags.go:64] FLAG: --feature-gates="" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250500 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250505 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250509 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250514 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250519 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250524 2574 flags.go:64] FLAG: --help="false" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250529 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250541 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250545 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250550 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250556 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250562 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250567 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250571 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250576 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250581 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250585 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250590 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250597 2574 flags.go:64] FLAG: --kube-reserved="" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250602 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250607 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 11:37:18.257578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250612 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250616 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250621 2574 flags.go:64] FLAG: --lock-file="" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250625 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250630 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250635 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250644 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250649 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250654 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250659 2574 flags.go:64] FLAG: --logging-format="text" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250664 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250669 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250674 2574 flags.go:64] FLAG: --manifest-url="" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250678 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250685 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250690 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250698 2574 flags.go:64] FLAG: --max-pods="110" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250704 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250709 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250714 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250718 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250723 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250727 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250732 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250753 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 11:37:18.258199 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250759 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250764 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250769 2574 flags.go:64] FLAG: --pod-cidr="" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250774 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250783 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250790 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250795 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250817 2574 flags.go:64] FLAG: --port="10250" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250823 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250828 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08254ae3215376c8c" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250833 2574 flags.go:64] FLAG: --qos-reserved="" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250838 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250843 2574 flags.go:64] FLAG: --register-node="true" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250848 2574 flags.go:64] FLAG: --register-with-taints="" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250860 2574 flags.go:64] FLAG: --registry-burst="10" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250866 2574 flags.go:64] FLAG: --registry-qps="5" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250871 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250875 2574 flags.go:64] FLAG: --reserved-memory="" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250882 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250887 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250892 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250896 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250901 2574 flags.go:64] FLAG: --runonce="false" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250906 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250913 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 11:37:18.258900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250918 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250923 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250928 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250932 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250937 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250942 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250947 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250952 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250957 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250961 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250966 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250971 2574 flags.go:64] FLAG: --system-cgroups="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250979 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250988 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250993 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.250998 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251005 2574 flags.go:64] FLAG: --tls-min-version="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251010 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251014 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251019 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251024 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251029 2574 flags.go:64] FLAG: --v="2" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251036 2574 flags.go:64] FLAG: --version="false" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251043 2574 flags.go:64] FLAG: --vmodule="" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251049 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 11:37:18.259554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.251055 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251244 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251250 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251255 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251260 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251264 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251270 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251276 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251283 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251297 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251303 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251307 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251312 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251316 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251320 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251324 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251329 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251333 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251337 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:37:18.260281 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251343 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251349 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251354 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251359 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251365 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251371 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251375 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251380 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251384 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251388 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251393 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251397 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251402 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251408 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251413 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251417 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251421 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251425 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251430 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:37:18.260750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251436 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251440 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251444 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251449 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251453 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251457 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251461 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251466 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251470 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251474 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251478 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251483 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251488 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251494 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251498 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251502 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251506 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251511 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251515 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251519 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:37:18.261251 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251523 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251527 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251532 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251536 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251540 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251544 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251555 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251559 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251563 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251567 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251572 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251576 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251582 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251586 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251590 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251594 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251599 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251604 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251608 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251612 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:37:18.261755 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251616 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251620 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251623 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251628 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251632 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251638 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251642 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251646 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251651 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251655 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251660 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251664 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251668 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251673 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251677 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251681 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251685 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251689 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251694 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251699 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:37:18.262278 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251704 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.251708 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.252651 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.260523 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.260545 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.260567 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.260573 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260636 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260642 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260646 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260650 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260653 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260656 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260659 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:37:18.262773 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260662 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260665 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260667 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260670 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260673 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260675 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260678 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260681 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260683 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260686 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260688 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260691 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260695 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260699 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260702 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260705 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260707 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260710 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260713 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:37:18.263139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260716 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260719 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260723 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260727 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260731 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260734 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260737 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260739 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260742 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260745 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260747 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260750 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260753 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260755 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260758 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260761 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260764 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260767 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260770 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260772 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:37:18.263624 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260776 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260779 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260781 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260784 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260787 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260789 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260792 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260794 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260797 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260814 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260816 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260820 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260822 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260825 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260827 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260831 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260834 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260837 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260840 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260842 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:37:18.264138 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260845 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260848 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260851 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260853 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260855 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260858 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260861 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260863 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260866 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260869 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260871 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260873 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260876 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260879 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260881 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260883 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260886 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260888 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260891 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260893 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:37:18.264627 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260896 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260898 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260901 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260903 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260906 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260908 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260911 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260914 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260917 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260920 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260923 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260926 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.260928 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.260934 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261067 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:37:18.265139 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261073 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261076 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261079 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261082 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261085 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261090 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261094 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261097 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261100 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261102 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261105 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261107 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261110 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261112 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261115 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261117 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261120 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261123 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261126 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:37:18.265531 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261128 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261131 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261133 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261136 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261139 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261141 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261144 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261147 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261150 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261153 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261156 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261158 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261161 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261164 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261166 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261169 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261171 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261173 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261176 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261178 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261181 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:37:18.266019 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261183 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261186 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261188 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261190 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261193 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261195 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261199 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261203 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261206 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261209 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261211 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261214 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261216 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261219 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261222 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261224 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261227 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261229 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261232 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:37:18.266533 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261235 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261238 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261241 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261243 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261246 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261248 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261251 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261253 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261256 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261259 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261261 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261264 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261267 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261269 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261272 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261274 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261277 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261279 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261282 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261285 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:37:18.267020 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261287 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261290 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261293 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261295 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261298 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261300 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261303 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261305 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261307 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261310 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261313 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261316 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261318 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261321 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261324 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261326 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261330 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261334 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:37:18.267512 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:18.261337 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:37:18.268033 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.261342 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 11:37:18.268033 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.261518 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 11:37:18.268033 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.267525 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 11:37:18.269233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.269218 2574 server.go:1019] "Starting client certificate rotation" Jun 05 11:37:18.269378 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.269359 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 11:37:18.269412 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.269398 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 11:37:18.272336 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.272322 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 11:37:18.279978 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.279956 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 11:37:18.293026 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.293003 2574 log.go:25] "Validated CRI v1 runtime API" Jun 05 11:37:18.296933 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.296914 2574 log.go:25] "Validated CRI v1 image API" Jun 05 11:37:18.297775 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.297747 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 11:37:18.298871 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.298856 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 11:37:18.300370 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.300352 2574 fs.go:135] Filesystem UUIDs: map[0f5c22b1-c7eb-499f-8830-af9c3d7e70f2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fb9170b9-ea65-48c2-b88c-f46e21e15b99:/dev/nvme0n1p3] Jun 05 11:37:18.300417 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.300370 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 11:37:18.305774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.305645 2574 manager.go:216] Machine: {Timestamp:2026-06-05 11:37:18.304136724 +0000 UTC m=+0.378631236 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094413 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21aa186318d904298016010afb8374 SystemUUID:ec21aa18-6318-d904-2980-16010afb8374 BootID:70ffe1cf-5f14-4b77-acac-be3c464f6108 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:df:4d:83:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:df:4d:83:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:1e:7b:a9:4b:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 11:37:18.305774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.305767 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 11:37:18.305913 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.305874 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 11:37:18.309691 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.309652 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 11:37:18.309901 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.309695 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 11:37:18.310638 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.310625 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 11:37:18.310694 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.310644 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 11:37:18.310694 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.310654 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 11:37:18.311593 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.311579 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 11:37:18.312883 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.312869 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 11:37:18.317304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317286 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 05 11:37:18.317480 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317468 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 11:37:18.317544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317511 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 05 11:37:18.317544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317534 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 11:37:18.317634 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317550 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 11:37:18.317634 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317582 2574 kubelet.go:398] "Adding apiserver pod source" Jun 05 11:37:18.317634 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.317597 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 11:37:18.318065 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.318050 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 11:37:18.318133 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.318073 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 11:37:18.320636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.320607 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 11:37:18.322516 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.322501 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 11:37:18.322575 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.322533 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 11:37:18.324019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324005 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324023 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324029 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324034 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324043 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324049 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324057 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324062 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324069 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 11:37:18.324075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324074 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 11:37:18.324338 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324083 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 11:37:18.324338 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.324090 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 11:37:18.326499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.326483 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 11:37:18.326559 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.326501 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 11:37:18.329161 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.329078 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 11:37:18.329289 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.329201 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 11:37:18.331154 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.331134 2574 server.go:1268] "Started kubelet" Jun 05 11:37:18.331267 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.331231 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 11:37:18.331396 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.331262 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 11:37:18.331456 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.331421 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 11:37:18.332156 ip-10-0-140-113 systemd[1]: Started Kubernetes Kubelet. Jun 05 11:37:18.332697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.332599 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 05 11:37:18.334792 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.334778 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 11:37:18.338101 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.338080 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 11:37:18.339099 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.337979 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5327abe559 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.331094361 +0000 UTC m=+0.405588875,LastTimestamp:2026-06-05 11:37:18.331094361 +0000 UTC m=+0.405588875,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.339494 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.339472 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 11:37:18.343718 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.343698 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 11:37:18.343829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.343720 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 11:37:18.343829 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.343798 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:18.344545 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344525 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 11:37:18.344545 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344536 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 11:37:18.344697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344556 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 11:37:18.344697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344638 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 11:37:18.344697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344652 2574 factory.go:55] Registering systemd factory Jun 05 11:37:18.344697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344673 2574 factory.go:223] Registration of the systemd container factory successfully Jun 05 11:37:18.344926 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344727 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 05 11:37:18.344926 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344737 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 05 11:37:18.344926 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344923 2574 factory.go:153] Registering CRI-O factory Jun 05 11:37:18.345049 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344935 2574 factory.go:223] Registration of the crio container factory successfully Jun 05 11:37:18.345049 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344968 2574 factory.go:103] Registering Raw factory Jun 05 11:37:18.345049 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.344983 2574 manager.go:1196] Started watching for new ooms in manager Jun 05 11:37:18.345462 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.345436 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 11:37:18.345560 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.345516 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 11:37:18.346540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.346524 2574 manager.go:349] Starting recovery of all containers Jun 05 11:37:18.352271 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.352243 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 11:37:18.358475 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.358289 2574 manager.go:354] Recovery completed Jun 05 11:37:18.363571 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.363554 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.365514 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.365495 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.365631 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.365527 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.365631 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.365538 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.366104 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.366088 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 11:37:18.366104 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.366102 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 11:37:18.366214 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.366114 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.366214 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.366120 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 05 11:37:18.367478 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.367461 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.367555 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.367490 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.367555 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.367503 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.368138 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.368122 2574 policy_none.go:49] "None policy: Start" Jun 05 11:37:18.368138 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.368139 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 11:37:18.368270 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.368149 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 11:37:18.369758 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.369746 2574 policy_none.go:47] "Start" Jun 05 11:37:18.377035 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.376946 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.388111 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.388024 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.397303 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.397202 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.408011 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.367476721 +0000 UTC m=+0.441971236,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.408527 2574 manager.go:337] "Starting Device Plugin manager" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.408564 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.408577 2574 server.go:87] "Starting device plugin registration server" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.408922 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.408938 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.409030 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.409157 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.409168 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.409694 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.409753 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.415247 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.415291 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.415313 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.415345 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.416999 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.367496676 +0000 UTC m=+0.441991188,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.422997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.417168 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 11:37:18.428363 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.428285 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b985af\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.367507901 +0000 UTC m=+0.442002414,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.437769 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.437689 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c532cd03a0f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.417361423 +0000 UTC m=+0.491855926,LastTimestamp:2026-06-05 11:37:18.417361423 +0000 UTC m=+0.491855926,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.510121 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.510061 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.511061 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.511041 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.511141 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.511071 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.511141 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.511081 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.511141 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.511107 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.515782 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.515761 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal"] Jun 05 11:37:18.515852 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.515841 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.517427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.517410 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.517520 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.517441 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.517520 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.517455 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.520160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.520142 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.520269 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.520254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.520323 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.520295 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.521392 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.521378 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.521461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.521404 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.521461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.521414 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.521461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.521379 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.521561 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.521481 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.521561 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.521494 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.522248 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.522161 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.511059418 +0000 UTC m=+0.585553931,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.523658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.523643 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.523729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.523670 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.524836 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.524820 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.524927 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.524855 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.524927 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.524870 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.530934 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.530902 2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-140-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.531055 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.530990 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.511075633 +0000 UTC m=+0.585570146,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.543648 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.543566 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b985af\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.511084958 +0000 UTC m=+0.585579470,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.551756 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.551730 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-113.ec2.internal\" not found" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.553003 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.552983 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jun 05 11:37:18.553092 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.552959 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.517425241 +0000 UTC m=+0.591919753,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.555168 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.555100 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.517448174 +0000 UTC m=+0.591942690,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.556555 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.556537 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-113.ec2.internal\" not found" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.569713 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.569625 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b985af\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.517459599 +0000 UTC m=+0.591954111,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.579100 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.579018 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.521394761 +0000 UTC m=+0.595889273,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.587434 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.587355 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.521409297 +0000 UTC m=+0.595903808,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.596545 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.596465 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b985af\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.52141791 +0000 UTC m=+0.595912421,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.605184 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.605102 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.521467055 +0000 UTC m=+0.595961572,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.614399 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.614321 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.521488776 +0000 UTC m=+0.595983290,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.622235 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.622138 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b985af\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.521497975 +0000 UTC m=+0.595992490,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.630185 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.630110 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.524836207 +0000 UTC m=+0.599330722,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.638300 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.638219 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.524862105 +0000 UTC m=+0.599356618,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.645620 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.645582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/531d6fda740b2e726b29bfe091a1a30d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal\" (UID: \"531d6fda740b2e726b29bfe091a1a30d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.645620 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.645619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/531d6fda740b2e726b29bfe091a1a30d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal\" (UID: \"531d6fda740b2e726b29bfe091a1a30d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.645819 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.645638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbdbf1b7c33db656b59a4aa42b0e098f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-113.ec2.internal\" (UID: \"bbdbf1b7c33db656b59a4aa42b0e098f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.645819 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.645576 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b985af\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b985af default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365541807 +0000 UTC m=+0.440036319,LastTimestamp:2026-06-05 11:37:18.524875594 +0000 UTC m=+0.599370107,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.731762 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.731728 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:18.732841 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.732821 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:18.732942 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.732849 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:18.732942 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.732860 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:18.732942 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.732889 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.740780 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.740693 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b914f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b914f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365512944 +0000 UTC m=+0.440007456,LastTimestamp:2026-06-05 11:37:18.732835486 +0000 UTC m=+0.807330000,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.746608 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.746582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/531d6fda740b2e726b29bfe091a1a30d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal\" (UID: \"531d6fda740b2e726b29bfe091a1a30d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.746761 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.746613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbdbf1b7c33db656b59a4aa42b0e098f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-113.ec2.internal\" (UID: \"bbdbf1b7c33db656b59a4aa42b0e098f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.746761 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.746638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/531d6fda740b2e726b29bfe091a1a30d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal\" (UID: \"531d6fda740b2e726b29bfe091a1a30d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.746761 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.746681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/531d6fda740b2e726b29bfe091a1a30d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal\" (UID: \"531d6fda740b2e726b29bfe091a1a30d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.746761 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.746693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bbdbf1b7c33db656b59a4aa42b0e098f-config\") pod \"kube-apiserver-proxy-ip-10-0-140-113.ec2.internal\" (UID: \"bbdbf1b7c33db656b59a4aa42b0e098f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.746761 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.746693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/531d6fda740b2e726b29bfe091a1a30d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal\" (UID: \"531d6fda740b2e726b29bfe091a1a30d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.749288 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.749260 2574 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-140-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.749392 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.749321 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-113.ec2.internal.18b62c5329b95d73\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-113.ec2.internal.18b62c5329b95d73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-113.ec2.internal,UID:ip-10-0-140-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-113.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-113.ec2.internal,},FirstTimestamp:2026-06-05 11:37:18.365531507 +0000 UTC m=+0.440026019,LastTimestamp:2026-06-05 11:37:18.732854158 +0000 UTC m=+0.807348669,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-113.ec2.internal,}" Jun 05 11:37:18.780762 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.780689 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q8bxt" Jun 05 11:37:18.785744 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.785729 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q8bxt" Jun 05 11:37:18.857613 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.857570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.863977 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:18.863952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" Jun 05 11:37:18.964966 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:18.964933 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-113.ec2.internal\" not found" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:19.149846 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.149812 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:19.151102 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.151083 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:19.151160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.151125 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:19.151160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.151136 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:19.151224 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.151165 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:19.160474 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.160441 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-113.ec2.internal" Jun 05 11:37:19.160474 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.160480 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-113.ec2.internal\": node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.172522 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.172495 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.268933 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.268884 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 11:37:19.273049 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.273024 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.355774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.355741 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:37:19.374180 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.374149 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.458896 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:19.458858 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531d6fda740b2e726b29bfe091a1a30d.slice/crio-d557db6cbe4b25e98e7cfca11cc446e48a069e181316f4801a9887ac60525950 WatchSource:0}: Error finding container d557db6cbe4b25e98e7cfca11cc446e48a069e181316f4801a9887ac60525950: Status 404 returned error can't find the container with id d557db6cbe4b25e98e7cfca11cc446e48a069e181316f4801a9887ac60525950 Jun 05 11:37:19.459116 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:19.459098 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbdbf1b7c33db656b59a4aa42b0e098f.slice/crio-74e5dc3fffb39f2f42018b71c5aa342ba163d2ccea99d1eb74afbaf2a314db76 WatchSource:0}: Error finding container 74e5dc3fffb39f2f42018b71c5aa342ba163d2ccea99d1eb74afbaf2a314db76: Status 404 returned error can't find the container with id 74e5dc3fffb39f2f42018b71c5aa342ba163d2ccea99d1eb74afbaf2a314db76 Jun 05 11:37:19.465439 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.465419 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 11:37:19.474246 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.474221 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.553705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.553668 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:37:19.554900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.554877 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:37:19.555019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.554914 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:37:19.555019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.554930 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:37:19.574902 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.574858 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.587057 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.587029 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:37:19.588749 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.588732 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:37:19.675758 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:19.675722 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-113.ec2.internal\" not found" Jun 05 11:37:19.683022 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.682999 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:37:19.744211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.744108 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" Jun 05 11:37:19.755093 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.755072 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 11:37:19.756203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.756187 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" Jun 05 11:37:19.763839 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.763824 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 11:37:19.793253 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.793212 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 11:32:18 +0000 UTC" deadline="2028-01-02 03:44:31.01302336 +0000 UTC" Jun 05 11:37:19.793407 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:19.793250 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13816h7m11.219778718s" Jun 05 11:37:20.318877 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.318840 2574 apiserver.go:52] "Watching apiserver" Jun 05 11:37:20.326512 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.326485 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 11:37:20.330573 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.330526 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal","openshift-multus/network-metrics-daemon-fbfkh","openshift-network-diagnostics/network-check-target-hkvws","openshift-network-operator/iptables-alerter-p69r9","kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal","openshift-dns/node-resolver-vk7ss","openshift-image-registry/node-ca-xvw5s","openshift-multus/multus-additional-cni-plugins-pxdbz","openshift-multus/multus-gxbr2","openshift-ovn-kubernetes/ovnkube-node-fxspx","kube-system/global-pull-secret-syncer-2wm2q","kube-system/konnectivity-agent-kjhcr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl","openshift-cluster-node-tuning-operator/tuned-99x4q"] Jun 05 11:37:20.333191 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.333167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.333349 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.333263 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:20.336574 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.336546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:20.336707 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.336623 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:20.338633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.338608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.340696 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.340673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.341001 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.340978 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.341119 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.341105 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 11:37:20.341184 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.341129 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rfcm4\"" Jun 05 11:37:20.341184 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.341129 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.342945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.342921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s48cw\"" Jun 05 11:37:20.343043 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.342926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.343500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.343481 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.343589 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.343506 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.344350 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.344332 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 11:37:20.345312 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.345154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.345407 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.345316 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 11:37:20.345407 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.345325 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jnn6k\"" Jun 05 11:37:20.345407 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.345358 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.345554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.345317 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.347283 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.347264 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.347373 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.347323 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 11:37:20.347613 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.347553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.347694 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.347556 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fz8jm\"" Jun 05 11:37:20.347757 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.347692 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.347757 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.347559 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 11:37:20.349741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.349491 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 11:37:20.349741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.349493 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 11:37:20.349741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.349628 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wtrmc\"" Jun 05 11:37:20.351058 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.351039 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.353242 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.353216 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8hnkg\"" Jun 05 11:37:20.353242 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.353228 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 11:37:20.353557 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.353538 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.353994 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.353904 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.354062 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.354031 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:20.354665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.354340 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 11:37:20.354665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.354361 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.354665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.354410 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 11:37:20.354665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.354560 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 11:37:20.354665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.354622 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 11:37:20.355704 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9543d026-5bb4-40b8-a75a-3e01b64ad205-tmp-dir\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.355822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stcrx\" (UniqueName: \"kubernetes.io/projected/649b89ed-77fc-4a6c-9088-756726e5d6f2-kube-api-access-stcrx\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.355822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.355822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/260417d1-ba5c-4e80-a7bb-b97b8057b620-iptables-alerter-script\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.355822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9543d026-5bb4-40b8-a75a-3e01b64ad205-hosts-file\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hxp7\" (UniqueName: \"kubernetes.io/projected/9543d026-5bb4-40b8-a75a-3e01b64ad205-kube-api-access-7hxp7\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-system-cni-dir\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thn5\" (UniqueName: \"kubernetes.io/projected/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-kube-api-access-5thn5\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/260417d1-ba5c-4e80-a7bb-b97b8057b620-host-slash\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/649b89ed-77fc-4a6c-9088-756726e5d6f2-host\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.355996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-cnibin\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-os-release\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356157 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.356422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mg5\" (UniqueName: \"kubernetes.io/projected/260417d1-ba5c-4e80-a7bb-b97b8057b620-kube-api-access-b7mg5\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.356588 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356588 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssvx4\" (UniqueName: \"kubernetes.io/projected/4a56e121-28b7-485d-a634-97c32f976cd1-kube-api-access-ssvx4\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.356673 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/649b89ed-77fc-4a6c-9088-756726e5d6f2-serviceca\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.356721 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.356679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:20.358404 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.358355 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7wbs7\"" Jun 05 11:37:20.358636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.358619 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 11:37:20.358826 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.358794 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 11:37:20.358940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.358927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.361016 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.360996 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.361129 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.361112 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 11:37:20.361191 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.361139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vfcq6\"" Jun 05 11:37:20.361300 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.361275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.362504 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.362487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.365461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.365438 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxck6\"" Jun 05 11:37:20.365693 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.365671 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 11:37:20.365781 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.365723 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 11:37:20.419973 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.419912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" event={"ID":"531d6fda740b2e726b29bfe091a1a30d","Type":"ContainerStarted","Data":"d557db6cbe4b25e98e7cfca11cc446e48a069e181316f4801a9887ac60525950"} Jun 05 11:37:20.421038 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.421012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" event={"ID":"bbdbf1b7c33db656b59a4aa42b0e098f","Type":"ContainerStarted","Data":"74e5dc3fffb39f2f42018b71c5aa342ba163d2ccea99d1eb74afbaf2a314db76"} Jun 05 11:37:20.445985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.445950 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 11:37:20.457374 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hxp7\" (UniqueName: \"kubernetes.io/projected/9543d026-5bb4-40b8-a75a-3e01b64ad205-kube-api-access-7hxp7\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.457374 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-system-cni-dir\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-multus-certs\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-system-cni-dir\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-tmp\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.457601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-systemd\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-ovn\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457639 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-ovnkube-script-lib\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mg5\" (UniqueName: \"kubernetes.io/projected/260417d1-ba5c-4e80-a7bb-b97b8057b620-kube-api-access-b7mg5\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssvx4\" (UniqueName: \"kubernetes.io/projected/4a56e121-28b7-485d-a634-97c32f976cd1-kube-api-access-ssvx4\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-kubernetes\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.458032 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.457996 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-run\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d05d6a3-14b1-472b-a433-1346cd4c59c6-dbus\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458150 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysctl-conf\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-slash\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-var-lib-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g6rs\" (UniqueName: \"kubernetes.io/projected/2ed0c269-13ba-471f-a756-35fdd4b93436-kube-api-access-5g6rs\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.458353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9543d026-5bb4-40b8-a75a-3e01b64ad205-hosts-file\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.458374 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e77f1e8-5dcb-4242-bbac-eea7a89026ce-agent-certs\") pod \"konnectivity-agent-kjhcr\" (UID: \"8e77f1e8-5dcb-4242-bbac-eea7a89026ce\") " pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-system-cni-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.458476 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:37:20.958454257 +0000 UTC m=+3.032948779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458471 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9543d026-5bb4-40b8-a75a-3e01b64ad205-hosts-file\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-etc-kubernetes\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thn5\" (UniqueName: \"kubernetes.io/projected/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-kube-api-access-5thn5\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/260417d1-ba5c-4e80-a7bb-b97b8057b620-host-slash\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-os-release\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-lib-modules\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-kubelet\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/260417d1-ba5c-4e80-a7bb-b97b8057b620-host-slash\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-systemd-units\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-os-release\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.458829 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-registration-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-netns\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-daemon-config\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/649b89ed-77fc-4a6c-9088-756726e5d6f2-serviceca\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9543d026-5bb4-40b8-a75a-3e01b64ad205-tmp-dir\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysconfig\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.458982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-log-socket\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzz79\" (UniqueName: \"kubernetes.io/projected/f9c9b7e9-6677-4e11-831c-f4e2d452da64-kube-api-access-wzz79\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-sys\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-kubelet\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459081 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-node-log\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-cni-netd\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-sys-fs\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-cnibin\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-modprobe-d\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-socket-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-etc-selinux\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.459544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/649b89ed-77fc-4a6c-9088-756726e5d6f2-serviceca\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4xgl\" (UniqueName: \"kubernetes.io/projected/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-kube-api-access-f4xgl\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459346 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a56e121-28b7-485d-a634-97c32f976cd1-cnibin\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-cni-bin\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-hostroot\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459441 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-env-overrides\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stcrx\" (UniqueName: \"kubernetes.io/projected/649b89ed-77fc-4a6c-9088-756726e5d6f2-kube-api-access-stcrx\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459526 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-socket-dir-parent\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-conf-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pjnl\" (UniqueName: \"kubernetes.io/projected/ca3451b1-3895-4753-9c74-16d6fc50e744-kube-api-access-2pjnl\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-run-netns\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-etc-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-k8s-cni-cncf-io\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9543d026-5bb4-40b8-a75a-3e01b64ad205-tmp-dir\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/260417d1-ba5c-4e80-a7bb-b97b8057b620-iptables-alerter-script\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysctl-d\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.460360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-var-lib-kubelet\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-tuned\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-os-release\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459848 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ed0c269-13ba-471f-a756-35fdd4b93436-ovn-node-metrics-cert\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/649b89ed-77fc-4a6c-9088-756726e5d6f2-host\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-host\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/649b89ed-77fc-4a6c-9088-756726e5d6f2-host\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.459988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-cni-bin\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460014 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-ovnkube-config\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e77f1e8-5dcb-4242-bbac-eea7a89026ce-konnectivity-ca\") pod \"konnectivity-agent-kjhcr\" (UID: \"8e77f1e8-5dcb-4242-bbac-eea7a89026ce\") " pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-device-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca3451b1-3895-4753-9c74-16d6fc50e744-cni-binary-copy\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-cni-multus\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d05d6a3-14b1-472b-a433-1346cd4c59c6-kubelet-config\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.460985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-systemd\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.461534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-cni-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.461534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/260417d1-ba5c-4e80-a7bb-b97b8057b620-iptables-alerter-script\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.461534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-cnibin\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.461534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.460458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4a56e121-28b7-485d-a634-97c32f976cd1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.465524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.465483 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 11:37:20.465874 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.465847 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:20.465874 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.465870 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:20.466067 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.465883 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:20.466067 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.465953 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:37:20.965930147 +0000 UTC m=+3.040424647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:20.469794 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.469763 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hxp7\" (UniqueName: \"kubernetes.io/projected/9543d026-5bb4-40b8-a75a-3e01b64ad205-kube-api-access-7hxp7\") pod \"node-resolver-vk7ss\" (UID: \"9543d026-5bb4-40b8-a75a-3e01b64ad205\") " pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.469794 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.469774 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stcrx\" (UniqueName: \"kubernetes.io/projected/649b89ed-77fc-4a6c-9088-756726e5d6f2-kube-api-access-stcrx\") pod \"node-ca-xvw5s\" (UID: \"649b89ed-77fc-4a6c-9088-756726e5d6f2\") " pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.469996 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.469771 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssvx4\" (UniqueName: \"kubernetes.io/projected/4a56e121-28b7-485d-a634-97c32f976cd1-kube-api-access-ssvx4\") pod \"multus-additional-cni-plugins-pxdbz\" (UID: \"4a56e121-28b7-485d-a634-97c32f976cd1\") " pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.469996 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.469775 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mg5\" (UniqueName: \"kubernetes.io/projected/260417d1-ba5c-4e80-a7bb-b97b8057b620-kube-api-access-b7mg5\") pod \"iptables-alerter-p69r9\" (UID: \"260417d1-ba5c-4e80-a7bb-b97b8057b620\") " pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.469996 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.469816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thn5\" (UniqueName: \"kubernetes.io/projected/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-kube-api-access-5thn5\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.561480 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e77f1e8-5dcb-4242-bbac-eea7a89026ce-agent-certs\") pod \"konnectivity-agent-kjhcr\" (UID: \"8e77f1e8-5dcb-4242-bbac-eea7a89026ce\") " pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.561480 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-system-cni-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.561480 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-etc-kubernetes\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-lib-modules\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-kubelet\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-systemd-units\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-etc-kubernetes\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-registration-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-netns\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-kubelet\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561671 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-systemd-units\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-daemon-config\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-system-cni-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-netns\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysconfig\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-registration-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-lib-modules\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-log-socket\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.562280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561880 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysconfig\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzz79\" (UniqueName: \"kubernetes.io/projected/f9c9b7e9-6677-4e11-831c-f4e2d452da64-kube-api-access-wzz79\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-sys\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561943 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-log-socket\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-kubelet\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.561981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-node-log\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-cni-netd\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-sys\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-sys-fs\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-modprobe-d\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-node-log\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-cni-netd\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562071 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-socket-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-kubelet\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-etc-selinux\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562141 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-sys-fs\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4xgl\" (UniqueName: \"kubernetes.io/projected/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-kube-api-access-f4xgl\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.563233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-socket-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-cni-bin\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-etc-selinux\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-hostroot\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-modprobe-d\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-env-overrides\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-socket-dir-parent\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-conf-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.562385 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pjnl\" (UniqueName: \"kubernetes.io/projected/ca3451b1-3895-4753-9c74-16d6fc50e744-kube-api-access-2pjnl\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-run-netns\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.562442 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:21.062423688 +0000 UTC m=+3.136918194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-cni-bin\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-run-netns\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-daemon-config\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562505 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-conf-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-socket-dir-parent\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-hostroot\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-etc-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-k8s-cni-cncf-io\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysctl-d\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-var-lib-kubelet\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562697 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-etc-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562724 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-tuned\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-k8s-cni-cncf-io\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-os-release\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562769 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-env-overrides\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562788 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-var-lib-kubelet\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysctl-d\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562852 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562873 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-os-release\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ed0c269-13ba-471f-a756-35fdd4b93436-ovn-node-metrics-cert\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-host\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.564882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-cni-bin\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.562983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-ovnkube-config\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-host\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-cni-bin\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e77f1e8-5dcb-4242-bbac-eea7a89026ce-konnectivity-ca\") pod \"konnectivity-agent-kjhcr\" (UID: \"8e77f1e8-5dcb-4242-bbac-eea7a89026ce\") " pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-device-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563105 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca3451b1-3895-4753-9c74-16d6fc50e744-cni-binary-copy\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-cni-multus\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d05d6a3-14b1-472b-a433-1346cd4c59c6-kubelet-config\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-systemd\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-cni-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-cnibin\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-multus-certs\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-tmp\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-systemd\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.565760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-ovn\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-ovnkube-script-lib\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-kubernetes\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-multus-cni-dir\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-run\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-ovnkube-config\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563599 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563605 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-kubernetes\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563616 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d05d6a3-14b1-472b-a433-1346cd4c59c6-dbus\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysctl-conf\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-cnibin\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-slash\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-host-slash\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d05d6a3-14b1-472b-a433-1346cd4c59c6-kubelet-config\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-var-lib-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-systemd\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-run\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g6rs\" (UniqueName: \"kubernetes.io/projected/2ed0c269-13ba-471f-a756-35fdd4b93436-kube-api-access-5g6rs\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.566500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d05d6a3-14b1-472b-a433-1346cd4c59c6-dbus\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8e77f1e8-5dcb-4242-bbac-eea7a89026ce-konnectivity-ca\") pod \"konnectivity-agent-kjhcr\" (UID: \"8e77f1e8-5dcb-4242-bbac-eea7a89026ce\") " pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.563657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f9c9b7e9-6677-4e11-831c-f4e2d452da64-device-dir\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564039 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-var-lib-openvswitch\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-sysctl-conf\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564084 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-var-lib-cni-multus\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564110 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-systemd\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca3451b1-3895-4753-9c74-16d6fc50e744-host-run-multus-certs\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ed0c269-13ba-471f-a756-35fdd4b93436-run-ovn\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.564462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ed0c269-13ba-471f-a756-35fdd4b93436-ovnkube-script-lib\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.565024 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca3451b1-3895-4753-9c74-16d6fc50e744-cni-binary-copy\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.565256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-etc-tuned\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.565333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8e77f1e8-5dcb-4242-bbac-eea7a89026ce-agent-certs\") pod \"konnectivity-agent-kjhcr\" (UID: \"8e77f1e8-5dcb-4242-bbac-eea7a89026ce\") " pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.565795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ed0c269-13ba-471f-a756-35fdd4b93436-ovn-node-metrics-cert\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.567401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.566209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-tmp\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.571319 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.571122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzz79\" (UniqueName: \"kubernetes.io/projected/f9c9b7e9-6677-4e11-831c-f4e2d452da64-kube-api-access-wzz79\") pod \"aws-ebs-csi-driver-node-gzhnl\" (UID: \"f9c9b7e9-6677-4e11-831c-f4e2d452da64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.571319 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.571256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4xgl\" (UniqueName: \"kubernetes.io/projected/ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f-kube-api-access-f4xgl\") pod \"tuned-99x4q\" (UID: \"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f\") " pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.571519 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.571499 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pjnl\" (UniqueName: \"kubernetes.io/projected/ca3451b1-3895-4753-9c74-16d6fc50e744-kube-api-access-2pjnl\") pod \"multus-gxbr2\" (UID: \"ca3451b1-3895-4753-9c74-16d6fc50e744\") " pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.571602 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.571586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g6rs\" (UniqueName: \"kubernetes.io/projected/2ed0c269-13ba-471f-a756-35fdd4b93436-kube-api-access-5g6rs\") pod \"ovnkube-node-fxspx\" (UID: \"2ed0c269-13ba-471f-a756-35fdd4b93436\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.649917 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.649871 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p69r9" Jun 05 11:37:20.658357 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.658332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vk7ss" Jun 05 11:37:20.668383 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.668347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xvw5s" Jun 05 11:37:20.673167 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.673144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" Jun 05 11:37:20.679929 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.679902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gxbr2" Jun 05 11:37:20.686851 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.686825 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:20.693758 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.693736 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:20.700590 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.700560 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" Jun 05 11:37:20.707443 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.707419 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99x4q" Jun 05 11:37:20.966729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.966626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:20.966729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:20.966681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:20.966965 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.966814 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:20.966965 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.966852 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:20.966965 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.966866 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:20.966965 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.966822 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:20.967104 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.966976 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:37:21.966926279 +0000 UTC m=+4.041420792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:20.967104 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:20.966999 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:37:21.966988026 +0000 UTC m=+4.041482536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:21.067844 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.067791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:21.068029 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.067943 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:21.068029 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.068026 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:22.068004661 +0000 UTC m=+4.142499169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:21.298398 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.298376 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c9b7e9_6677_4e11_831c_f4e2d452da64.slice/crio-2521f9b826a362af7c9d9bfa23b7bf7aeaf2c0488466e017fdb3496f86eedeba WatchSource:0}: Error finding container 2521f9b826a362af7c9d9bfa23b7bf7aeaf2c0488466e017fdb3496f86eedeba: Status 404 returned error can't find the container with id 2521f9b826a362af7c9d9bfa23b7bf7aeaf2c0488466e017fdb3496f86eedeba Jun 05 11:37:21.318064 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.317976 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e77f1e8_5dcb_4242_bbac_eea7a89026ce.slice/crio-8379f0ccc2d075f7335bf4e8f93c7629dcf7a23362436b763719302d346c0257 WatchSource:0}: Error finding container 8379f0ccc2d075f7335bf4e8f93c7629dcf7a23362436b763719302d346c0257: Status 404 returned error can't find the container with id 8379f0ccc2d075f7335bf4e8f93c7629dcf7a23362436b763719302d346c0257 Jun 05 11:37:21.320397 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.320374 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a56e121_28b7_485d_a634_97c32f976cd1.slice/crio-1381e9de542252db9073298558bd8ef5542f65d2ecbb40287a9926c0e58f606e WatchSource:0}: Error finding container 1381e9de542252db9073298558bd8ef5542f65d2ecbb40287a9926c0e58f606e: Status 404 returned error can't find the container with id 1381e9de542252db9073298558bd8ef5542f65d2ecbb40287a9926c0e58f606e Jun 05 11:37:21.325993 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.325968 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9543d026_5bb4_40b8_a75a_3e01b64ad205.slice/crio-fa6cbb43836cf6c4ff072bc6f88bf8f126444636b066e5c763d97e1e2ae51937 WatchSource:0}: Error finding container fa6cbb43836cf6c4ff072bc6f88bf8f126444636b066e5c763d97e1e2ae51937: Status 404 returned error can't find the container with id fa6cbb43836cf6c4ff072bc6f88bf8f126444636b066e5c763d97e1e2ae51937 Jun 05 11:37:21.328480 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.328231 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed0c269_13ba_471f_a756_35fdd4b93436.slice/crio-1668b3f4e5f0719a9af6079b9a7de6b8fd27a735d7f5733e6fd5cb09521913c2 WatchSource:0}: Error finding container 1668b3f4e5f0719a9af6079b9a7de6b8fd27a735d7f5733e6fd5cb09521913c2: Status 404 returned error can't find the container with id 1668b3f4e5f0719a9af6079b9a7de6b8fd27a735d7f5733e6fd5cb09521913c2 Jun 05 11:37:21.329508 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.329479 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad905d2f_3bcf_49c4_8315_1b3d5a0cbb7f.slice/crio-3ef6876ece5c4653906c3c05e106f14f66b5dbd92ba591012c4f60204e2b214a WatchSource:0}: Error finding container 3ef6876ece5c4653906c3c05e106f14f66b5dbd92ba591012c4f60204e2b214a: Status 404 returned error can't find the container with id 3ef6876ece5c4653906c3c05e106f14f66b5dbd92ba591012c4f60204e2b214a Jun 05 11:37:21.331314 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.331274 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260417d1_ba5c_4e80_a7bb_b97b8057b620.slice/crio-0d6fc910fa9c83ea7293c413e6b3a86db34ea41016a51b303bc2fb58003c5a03 WatchSource:0}: Error finding container 0d6fc910fa9c83ea7293c413e6b3a86db34ea41016a51b303bc2fb58003c5a03: Status 404 returned error can't find the container with id 0d6fc910fa9c83ea7293c413e6b3a86db34ea41016a51b303bc2fb58003c5a03 Jun 05 11:37:21.333235 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.333173 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649b89ed_77fc_4a6c_9088_756726e5d6f2.slice/crio-0d36df48e02c22592057fd8cb008d9c206e58225b7223e5fd7e23774961a6a75 WatchSource:0}: Error finding container 0d36df48e02c22592057fd8cb008d9c206e58225b7223e5fd7e23774961a6a75: Status 404 returned error can't find the container with id 0d36df48e02c22592057fd8cb008d9c206e58225b7223e5fd7e23774961a6a75 Jun 05 11:37:21.335162 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:21.334592 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3451b1_3895_4753_9c74_16d6fc50e744.slice/crio-adda46d96fa0323ae187aef7210f3bea39d817948fdf0171da6095e7c5fb3e36 WatchSource:0}: Error finding container adda46d96fa0323ae187aef7210f3bea39d817948fdf0171da6095e7c5fb3e36: Status 404 returned error can't find the container with id adda46d96fa0323ae187aef7210f3bea39d817948fdf0171da6095e7c5fb3e36 Jun 05 11:37:21.424590 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.424378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjhcr" event={"ID":"8e77f1e8-5dcb-4242-bbac-eea7a89026ce","Type":"ContainerStarted","Data":"8379f0ccc2d075f7335bf4e8f93c7629dcf7a23362436b763719302d346c0257"} Jun 05 11:37:21.426612 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.426549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" event={"ID":"bbdbf1b7c33db656b59a4aa42b0e098f","Type":"ContainerStarted","Data":"926621ad6e451e19ff8c40246dde58897bbc92ff8df8aab1620aea529755a583"} Jun 05 11:37:21.427900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.427877 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxbr2" event={"ID":"ca3451b1-3895-4753-9c74-16d6fc50e744","Type":"ContainerStarted","Data":"adda46d96fa0323ae187aef7210f3bea39d817948fdf0171da6095e7c5fb3e36"} Jun 05 11:37:21.429070 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.429049 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvw5s" event={"ID":"649b89ed-77fc-4a6c-9088-756726e5d6f2","Type":"ContainerStarted","Data":"0d36df48e02c22592057fd8cb008d9c206e58225b7223e5fd7e23774961a6a75"} Jun 05 11:37:21.430339 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.430309 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p69r9" event={"ID":"260417d1-ba5c-4e80-a7bb-b97b8057b620","Type":"ContainerStarted","Data":"0d6fc910fa9c83ea7293c413e6b3a86db34ea41016a51b303bc2fb58003c5a03"} Jun 05 11:37:21.431463 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.431440 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"1668b3f4e5f0719a9af6079b9a7de6b8fd27a735d7f5733e6fd5cb09521913c2"} Jun 05 11:37:21.432554 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.432531 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vk7ss" event={"ID":"9543d026-5bb4-40b8-a75a-3e01b64ad205","Type":"ContainerStarted","Data":"fa6cbb43836cf6c4ff072bc6f88bf8f126444636b066e5c763d97e1e2ae51937"} Jun 05 11:37:21.433546 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.433527 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" event={"ID":"f9c9b7e9-6677-4e11-831c-f4e2d452da64","Type":"ContainerStarted","Data":"2521f9b826a362af7c9d9bfa23b7bf7aeaf2c0488466e017fdb3496f86eedeba"} Jun 05 11:37:21.434479 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.434461 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99x4q" event={"ID":"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f","Type":"ContainerStarted","Data":"3ef6876ece5c4653906c3c05e106f14f66b5dbd92ba591012c4f60204e2b214a"} Jun 05 11:37:21.435577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.435549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerStarted","Data":"1381e9de542252db9073298558bd8ef5542f65d2ecbb40287a9926c0e58f606e"} Jun 05 11:37:21.438731 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.438691 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-113.ec2.internal" podStartSLOduration=2.438679183 podStartE2EDuration="2.438679183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:21.43841075 +0000 UTC m=+3.512905271" watchObservedRunningTime="2026-06-05 11:37:21.438679183 +0000 UTC m=+3.513173704" Jun 05 11:37:21.781335 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.779840 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-64bqc" Jun 05 11:37:21.786338 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.786014 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-64bqc" Jun 05 11:37:21.976734 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.976643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:21.976734 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:21.976703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:21.976980 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.976886 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:21.976980 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.976952 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:37:23.976932855 +0000 UTC m=+6.051427369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:21.977425 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.977404 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:21.977546 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.977430 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:21.977546 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.977443 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:21.977546 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:21.977491 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:37:23.977475001 +0000 UTC m=+6.051969517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:22.077820 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.077765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:22.078003 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:22.077933 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:22.078003 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:22.077995 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:24.077977234 +0000 UTC m=+6.152471737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:22.419020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.418139 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:22.419020 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:22.418280 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:22.419020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.418365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:22.419020 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:22.418452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:22.419020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.418526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:22.419020 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:22.418594 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:22.474521 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.474484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" event={"ID":"531d6fda740b2e726b29bfe091a1a30d","Type":"ContainerDied","Data":"2227d1be857eab2371685bf5c6b74e3b943cb4be751ebd4336aa5f82d4178fd7"} Jun 05 11:37:22.474680 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.474544 2574 generic.go:356] "Generic (PLEG): container finished" podID="531d6fda740b2e726b29bfe091a1a30d" containerID="2227d1be857eab2371685bf5c6b74e3b943cb4be751ebd4336aa5f82d4178fd7" exitCode=0 Jun 05 11:37:22.790378 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.790331 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 11:32:21 +0000 UTC" deadline="2028-02-26 12:28:17.884318058 +0000 UTC" Jun 05 11:37:22.790378 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:22.790377 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15144h50m55.09394614s" Jun 05 11:37:23.488125 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:23.487396 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" event={"ID":"531d6fda740b2e726b29bfe091a1a30d","Type":"ContainerStarted","Data":"96fd0379d693f826d1b9e9b145551e3faedf80387028712e66d05af693dac97a"} Jun 05 11:37:23.792451 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:23.792314 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 11:32:21 +0000 UTC" deadline="2028-02-18 16:46:45.786023224 +0000 UTC" Jun 05 11:37:23.792451 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:23.792353 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14957h9m21.993674378s" Jun 05 11:37:23.994008 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:23.993971 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:23.994192 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:23.994025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:23.994271 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:23.994210 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:23.994323 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:23.994279 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:37:27.994259664 +0000 UTC m=+10.068754179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:23.994726 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:23.994706 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:23.994853 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:23.994733 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:23.994853 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:23.994745 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:23.994853 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:23.994793 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:37:27.994777672 +0000 UTC m=+10.069272174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:24.095080 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:24.095042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:24.095275 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:24.095175 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:24.095275 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:24.095236 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:28.095219017 +0000 UTC m=+10.169713531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:24.416292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:24.416111 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:24.416292 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:24.416275 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:24.416509 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:24.416310 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:24.416509 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:24.416419 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:24.416509 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:24.416444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:24.416651 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:24.416506 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:26.416434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:26.416391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:26.416897 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:26.416391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:26.416897 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:26.416621 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:26.416897 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:26.416637 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:26.416897 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:26.416734 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:26.416897 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:26.416853 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:28.032420 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:28.032369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:28.032888 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:28.032429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:28.032888 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.032593 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:28.032888 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.032660 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:37:36.03263974 +0000 UTC m=+18.107134245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:28.033089 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.033068 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:28.033158 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.033095 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:28.033158 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.033109 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:28.033257 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.033168 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:37:36.033150776 +0000 UTC m=+18.107645280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:28.132900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:28.132842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:28.133083 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.133016 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:28.133152 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.133088 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:36.133069097 +0000 UTC m=+18.207563596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:28.416605 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:28.416573 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:28.416874 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:28.416651 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:28.416874 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.416754 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:28.417091 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:28.417061 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:28.417256 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.417230 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:28.417352 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:28.417327 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:30.415903 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:30.415864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:30.416469 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:30.416007 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:30.416469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:30.415864 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:30.416469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:30.416020 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:30.416469 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:30.416098 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:30.416469 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:30.416191 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:32.416391 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:32.416354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:32.416889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:32.416354 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:32.416889 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:32.416491 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:32.416889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:32.416371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:32.416889 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:32.416580 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:32.416889 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:32.416632 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:34.415931 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:34.415888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:34.416375 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:34.415888 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:34.416375 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:34.416027 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:34.416375 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:34.416118 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:34.416375 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:34.415901 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:34.416375 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:34.416217 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:36.094355 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:36.094313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:36.094369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.094510 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.094543 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.094555 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.094518 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.094614 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:37:52.094593332 +0000 UTC m=+34.169087835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:36.094879 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.094695 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:37:52.094676349 +0000 UTC m=+34.169171044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:36.195822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:36.195774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:36.195998 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.195919 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:36.196056 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.195999 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:52.195979642 +0000 UTC m=+34.270474214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:36.416217 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:36.416054 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:36.416217 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:36.416101 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:36.416217 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:36.416054 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:36.416217 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.416207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:36.416540 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.416335 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:36.416540 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:36.416421 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:38.416304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:38.416275 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:38.416833 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:38.416376 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:38.416833 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:38.416413 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:38.416833 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:38.416514 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:38.416833 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:38.416569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:38.416833 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:38.416647 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:40.416108 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.415788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:40.416521 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:40.416176 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:40.416521 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.415957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:40.416521 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:40.416262 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:40.416521 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.415789 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:40.416521 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:40.416342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:40.523203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.523158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gxbr2" event={"ID":"ca3451b1-3895-4753-9c74-16d6fc50e744","Type":"ContainerStarted","Data":"8b6192de5a4aca07a000b7d8eb5c65cc3bb6c8dd6a2273ebcb8f03f00742db36"} Jun 05 11:37:40.526353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.526031 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xvw5s" event={"ID":"649b89ed-77fc-4a6c-9088-756726e5d6f2","Type":"ContainerStarted","Data":"ba7e0f71b1ac877994740925fb07bba0b0bcfa03f2cdf32f870f6721bc00d06f"} Jun 05 11:37:40.528409 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.528381 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"0cd2c8ae349dbeefae30550b467ec5a59f0acba233e310d9c0f89f004060f29e"} Jun 05 11:37:40.529713 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.529693 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vk7ss" event={"ID":"9543d026-5bb4-40b8-a75a-3e01b64ad205","Type":"ContainerStarted","Data":"a84df42475f6b5917532c556f8b53689f7a48a1e55d328d8d5d3042bd63dcc3f"} Jun 05 11:37:40.531087 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.531057 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" event={"ID":"f9c9b7e9-6677-4e11-831c-f4e2d452da64","Type":"ContainerStarted","Data":"dd64d5edfb2fbf39bf6f5a63ddbd55b11f64b27945b4186571d034a1f1214ca0"} Jun 05 11:37:40.532386 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.532362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99x4q" event={"ID":"ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f","Type":"ContainerStarted","Data":"ae6b0582a9344f25b0416fdf86090878a9f1a599aa465cab8c164822f313b8b8"} Jun 05 11:37:40.533719 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.533699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerStarted","Data":"9270c18779dfb55b880c0b06a4d9c6afe2e312cd155de5a92b27384badef6deb"} Jun 05 11:37:40.534972 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.534952 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kjhcr" event={"ID":"8e77f1e8-5dcb-4242-bbac-eea7a89026ce","Type":"ContainerStarted","Data":"37f697d9e274ea8d2db90323661a7a308abdc1bdfbd9576e7de0fa729664d6b4"} Jun 05 11:37:40.538746 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.538707 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gxbr2" podStartSLOduration=2.64285491 podStartE2EDuration="21.53869665s" totalImagesPullingTime="18.89584174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:40.538446685 +0000 UTC m=+22.612941196" watchObservedRunningTime="2026-06-05 11:37:40.53869665 +0000 UTC m=+22.613191170" Jun 05 11:37:40.539192 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.539158 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-113.ec2.internal" podStartSLOduration=21.539149011 podStartE2EDuration="21.539149011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:23.502855162 +0000 UTC m=+5.577349684" watchObservedRunningTime="2026-06-05 11:37:40.539149011 +0000 UTC m=+22.613643531" Jun 05 11:37:40.551534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.551490 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vk7ss" podStartSLOduration=2.6744732620000002 podStartE2EDuration="21.551472671s" totalImagesPullingTime="18.876999409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:40.551455355 +0000 UTC m=+22.625949876" watchObservedRunningTime="2026-06-05 11:37:40.551472671 +0000 UTC m=+22.625967192" Jun 05 11:37:40.563834 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.563772 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xvw5s" podStartSLOduration=2.693911394 podStartE2EDuration="21.56375675s" totalImagesPullingTime="18.869845356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:40.563694143 +0000 UTC m=+22.638188663" watchObservedRunningTime="2026-06-05 11:37:40.56375675 +0000 UTC m=+22.638251271" Jun 05 11:37:40.594626 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.594568 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kjhcr" podStartSLOduration=7.513265013 podStartE2EDuration="21.594541682s" totalImagesPullingTime="14.081276669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:40.594435795 +0000 UTC m=+22.668930317" watchObservedRunningTime="2026-06-05 11:37:40.594541682 +0000 UTC m=+22.669036205" Jun 05 11:37:40.610014 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.609959 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-99x4q" podStartSLOduration=2.734023622 podStartE2EDuration="21.609941333s" totalImagesPullingTime="18.875917711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:40.609539776 +0000 UTC m=+22.684034320" watchObservedRunningTime="2026-06-05 11:37:40.609941333 +0000 UTC m=+22.684435884" Jun 05 11:37:40.687583 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:40.687558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:41.210475 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.210159 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:41.263475 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.263445 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:41.539358 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.539328 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a56e121-28b7-485d-a634-97c32f976cd1" containerID="9270c18779dfb55b880c0b06a4d9c6afe2e312cd155de5a92b27384badef6deb" exitCode=0 Jun 05 11:37:41.540240 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.539418 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerDied","Data":"9270c18779dfb55b880c0b06a4d9c6afe2e312cd155de5a92b27384badef6deb"} Jun 05 11:37:41.540850 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.540826 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p69r9" event={"ID":"260417d1-ba5c-4e80-a7bb-b97b8057b620","Type":"ContainerStarted","Data":"c3611e03a568e91453071709033df7a8ff856bd257bd836c319f17cca8efd4f5"} Jun 05 11:37:41.546448 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.546425 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:37:41.546780 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.546759 2574 generic.go:356] "Generic (PLEG): container finished" podID="2ed0c269-13ba-471f-a756-35fdd4b93436" containerID="9f150c18f2b6ebf2bd95980ecc6eac8daf940b92f13129df7dfeea597049e59b" exitCode=1 Jun 05 11:37:41.546900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.546876 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"2dee64859067ab463fa175e4cf405f5fd65af9a33ddfe97be391eda62a10e2ac"} Jun 05 11:37:41.547004 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.546990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"3de1901333672945333771f533bff152a420292cc2820756fa8aead8459829fa"} Jun 05 11:37:41.547062 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.547046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"5601b6fb1ca43a1d792213332f071e6d594843b84b7101b5006537485cb5d2cc"} Jun 05 11:37:41.547116 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.547098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"3aa37616f23847b02e600d222df9a1e168283f4be3ec626d4fa626477bb98ce7"} Jun 05 11:37:41.547170 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.547148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerDied","Data":"9f150c18f2b6ebf2bd95980ecc6eac8daf940b92f13129df7dfeea597049e59b"} Jun 05 11:37:41.574016 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.573974 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p69r9" podStartSLOduration=3.7029533 podStartE2EDuration="22.573959625s" totalImagesPullingTime="18.871006325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:41.573937657 +0000 UTC m=+23.648432188" watchObservedRunningTime="2026-06-05 11:37:41.573959625 +0000 UTC m=+23.648454145" Jun 05 11:37:41.775023 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.774979 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 11:37:41.882552 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:41.882519 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:42.152261 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.152230 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:42.198914 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.198878 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:42.279174 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.279137 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:42.415862 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.415768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:42.416022 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.415768 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:42.416022 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:42.415962 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:42.416022 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.415794 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:42.416175 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:42.416057 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:42.416226 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:42.416146 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:42.421610 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.421510 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T11:37:41.775003314Z","UUID":"ee4feb17-9dce-42c8-b0a1-74a0eedbc4fc","Handler":null,"Name":"","Endpoint":""} Jun 05 11:37:42.423304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.423280 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 11:37:42.423444 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.423326 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 11:37:42.513820 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.513769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:42.552211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:42.552173 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" event={"ID":"f9c9b7e9-6677-4e11-831c-f4e2d452da64","Type":"ContainerStarted","Data":"07d3034ad99328f8c62e3e820f0510a32a29f54793496f0915c249202cfe59bd"} Jun 05 11:37:43.561104 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:43.561075 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:37:43.561534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:43.561507 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"cc7442a6f53026494dbdfa7650e1f872be4d221f5130879b5841088cc9ad0805"} Jun 05 11:37:43.563748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:43.563716 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" event={"ID":"f9c9b7e9-6677-4e11-831c-f4e2d452da64","Type":"ContainerStarted","Data":"f65e3999c20b0ceff71905402d2c056f999b3f5e9d00c03aebfbc61586bc5244"} Jun 05 11:37:43.581054 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:43.580996 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gzhnl" podStartSLOduration=3.370548857 podStartE2EDuration="24.580980826s" totalImagesPullingTime="21.210431969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:43.579968058 +0000 UTC m=+25.654462600" watchObservedRunningTime="2026-06-05 11:37:43.580980826 +0000 UTC m=+25.655475347" Jun 05 11:37:44.416132 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:44.415922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:44.416343 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:44.416236 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:44.416343 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:44.415922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:44.416456 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:44.416346 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:44.416456 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:44.415922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:44.416456 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:44.416421 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:44.580673 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:44.580635 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:44.581434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:44.581410 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:45.571417 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:45.571394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:37:45.572839 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:45.572793 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kjhcr" Jun 05 11:37:45.649604 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:45.649565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:46.416498 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.416311 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:46.416673 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.416316 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:46.416673 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:46.416592 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:46.416673 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.416339 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:46.416673 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:46.416657 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:46.417005 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:46.416703 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:46.580020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.579989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:37:46.580417 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.580390 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"b8d6711b3e21a5368dca69c576f515a7a8163f84fdc9a17e4bf5973404adbe06"} Jun 05 11:37:46.580637 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.580610 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:46.580844 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.580829 2574 scope.go:117] "RemoveContainer" containerID="9f150c18f2b6ebf2bd95980ecc6eac8daf940b92f13129df7dfeea597049e59b" Jun 05 11:37:46.582382 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.582361 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a56e121-28b7-485d-a634-97c32f976cd1" containerID="1fd948148614002eaea42f07b6ecb8105659f70ee422c7c4c40ab99c4e9544b9" exitCode=0 Jun 05 11:37:46.582474 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.582422 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerDied","Data":"1fd948148614002eaea42f07b6ecb8105659f70ee422c7c4c40ab99c4e9544b9"} Jun 05 11:37:46.597880 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:46.597844 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:47.588868 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.588841 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:37:47.589208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.589177 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" event={"ID":"2ed0c269-13ba-471f-a756-35fdd4b93436","Type":"ContainerStarted","Data":"70e0a4b6586ced01683b377e2cfe27861e388c71557d28fc02ae933924ac8852"} Jun 05 11:37:47.589365 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.589346 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:47.589492 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.589398 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:47.605379 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.605351 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:37:47.642321 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.642272 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" podStartSLOduration=9.704956998 podStartE2EDuration="28.642254778s" totalImagesPullingTime="18.93729778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:47.617444603 +0000 UTC m=+29.691939123" watchObservedRunningTime="2026-06-05 11:37:47.642254778 +0000 UTC m=+29.716749337" Jun 05 11:37:47.734623 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.734593 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2wm2q"] Jun 05 11:37:47.734769 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.734730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:47.734849 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:47.734826 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:47.737968 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.737927 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbfkh"] Jun 05 11:37:47.738129 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.738066 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:47.738188 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:47.738164 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:47.738518 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.738497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hkvws"] Jun 05 11:37:47.738610 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:47.738599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:47.738703 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:47.738684 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:48.593013 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:48.592834 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a56e121-28b7-485d-a634-97c32f976cd1" containerID="14ebb8854c0a663649024972e8e978231378f7cafebe88815b9c17afd607297a" exitCode=0 Jun 05 11:37:48.593414 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:48.592896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerDied","Data":"14ebb8854c0a663649024972e8e978231378f7cafebe88815b9c17afd607297a"} Jun 05 11:37:49.415748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:49.415721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:49.415935 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:49.415840 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:49.415935 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:49.415879 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:49.416063 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:49.415884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:49.416063 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:49.416005 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:49.416122 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:49.416072 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:50.599996 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:50.599958 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a56e121-28b7-485d-a634-97c32f976cd1" containerID="3e744c144c58d020709b42bacc05968d0275947a1d0839e833eee2b695f876c0" exitCode=0 Jun 05 11:37:50.600655 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:50.600003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerDied","Data":"3e744c144c58d020709b42bacc05968d0275947a1d0839e833eee2b695f876c0"} Jun 05 11:37:51.415544 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:51.415510 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:51.415748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:51.415608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:51.415748 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:51.415613 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hkvws" podUID="a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b" Jun 05 11:37:51.415748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:51.415711 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:51.415748 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:51.415711 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2wm2q" podUID="4d05d6a3-14b1-472b-a433-1346cd4c59c6" Jun 05 11:37:51.415916 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:51.415785 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:37:52.104649 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:52.104609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:52.104656 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.104757 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.104773 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.104788 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.104816 2574 projected.go:196] Error preparing data for projected volume kube-api-access-5cprg for pod openshift-network-diagnostics/network-check-target-hkvws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.104843 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:38:24.104820853 +0000 UTC m=+66.179315366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:37:52.105166 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.104860 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg podName:a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b nodeName:}" failed. No retries permitted until 2026-06-05 11:38:24.104849422 +0000 UTC m=+66.179343934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5cprg" (UniqueName: "kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg") pod "network-check-target-hkvws" (UID: "a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:37:52.206023 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:52.205986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:52.206209 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.206101 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:52.206209 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:52.206153 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret podName:4d05d6a3-14b1-472b-a433-1346cd4c59c6 nodeName:}" failed. No retries permitted until 2026-06-05 11:38:24.206139731 +0000 UTC m=+66.280634229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret") pod "global-pull-secret-syncer-2wm2q" (UID: "4d05d6a3-14b1-472b-a433-1346cd4c59c6") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:37:53.264916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.264839 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-113.ec2.internal" event="NodeReady" Jun 05 11:37:53.265275 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.264971 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 11:37:53.305076 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.305039 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dj7tz"] Jun 05 11:37:53.329275 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.329247 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zb52s"] Jun 05 11:37:53.329460 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.329377 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.331645 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.331621 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k9md6\"" Jun 05 11:37:53.331782 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.331669 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 11:37:53.331782 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.331674 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 11:37:53.343793 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.343760 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dj7tz"] Jun 05 11:37:53.343793 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.343795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zb52s"] Jun 05 11:37:53.343983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.343900 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.346019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.345974 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5bdwv\"" Jun 05 11:37:53.346220 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.346167 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 11:37:53.346220 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.346190 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 11:37:53.346347 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.346276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 11:37:53.405016 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.404982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:53.415603 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415539 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:37:53.415603 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415562 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:37:53.415842 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:37:53.415842 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.415842 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d01785c-b05f-4d1f-bf80-e06495018f32-config-volume\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.415842 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d01785c-b05f-4d1f-bf80-e06495018f32-tmp-dir\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.415842 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415836 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c797253a-99fe-4114-8ebe-c9a2ea31b2c8-cert\") pod \"ingress-canary-zb52s\" (UID: \"c797253a-99fe-4114-8ebe-c9a2ea31b2c8\") " pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.416094 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.415860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tb4h\" (UniqueName: \"kubernetes.io/projected/c797253a-99fe-4114-8ebe-c9a2ea31b2c8-kube-api-access-5tb4h\") pod \"ingress-canary-zb52s\" (UID: \"c797253a-99fe-4114-8ebe-c9a2ea31b2c8\") " pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.416094 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.416030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glmqq\" (UniqueName: \"kubernetes.io/projected/3d01785c-b05f-4d1f-bf80-e06495018f32-kube-api-access-glmqq\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.418120 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.418096 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 11:37:53.418296 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.418273 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 11:37:53.418413 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.418310 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 11:37:53.418413 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.418385 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92wv4\"" Jun 05 11:37:53.418593 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.418569 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 11:37:53.418705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.418622 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k8g9r\"" Jun 05 11:37:53.454741 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.454713 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:53.516886 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.516781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d01785c-b05f-4d1f-bf80-e06495018f32-config-volume\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.516886 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.516848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d01785c-b05f-4d1f-bf80-e06495018f32-tmp-dir\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.516886 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.516875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c797253a-99fe-4114-8ebe-c9a2ea31b2c8-cert\") pod \"ingress-canary-zb52s\" (UID: \"c797253a-99fe-4114-8ebe-c9a2ea31b2c8\") " pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.517160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.516893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tb4h\" (UniqueName: \"kubernetes.io/projected/c797253a-99fe-4114-8ebe-c9a2ea31b2c8-kube-api-access-5tb4h\") pod \"ingress-canary-zb52s\" (UID: \"c797253a-99fe-4114-8ebe-c9a2ea31b2c8\") " pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.517160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.516959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glmqq\" (UniqueName: \"kubernetes.io/projected/3d01785c-b05f-4d1f-bf80-e06495018f32-kube-api-access-glmqq\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.517160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.517024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.517160 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:53.517125 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:37:53.517346 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:53.517185 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:54.017165754 +0000 UTC m=+36.091660257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:37:53.517346 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.517201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d01785c-b05f-4d1f-bf80-e06495018f32-tmp-dir\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.517423 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.517383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d01785c-b05f-4d1f-bf80-e06495018f32-config-volume\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.521037 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.521019 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c797253a-99fe-4114-8ebe-c9a2ea31b2c8-cert\") pod \"ingress-canary-zb52s\" (UID: \"c797253a-99fe-4114-8ebe-c9a2ea31b2c8\") " pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.524905 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.524875 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glmqq\" (UniqueName: \"kubernetes.io/projected/3d01785c-b05f-4d1f-bf80-e06495018f32-kube-api-access-glmqq\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:53.525176 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.525156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tb4h\" (UniqueName: \"kubernetes.io/projected/c797253a-99fe-4114-8ebe-c9a2ea31b2c8-kube-api-access-5tb4h\") pod \"ingress-canary-zb52s\" (UID: \"c797253a-99fe-4114-8ebe-c9a2ea31b2c8\") " pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:53.653900 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:53.653850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zb52s" Jun 05 11:37:54.021740 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:54.021698 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:54.021956 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:54.021881 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:37:54.022022 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:54.021963 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:55.02193894 +0000 UTC m=+37.096433440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:37:55.028610 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.028571 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:55.031488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.031459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:55.031638 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:55.031618 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:37:55.031731 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:55.031714 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:37:57.031693714 +0000 UTC m=+39.106188220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:37:55.085215 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.085180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:55.190705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.190471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:55.224528 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.224492 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zb52s"] Jun 05 11:37:55.229333 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:37:55.229302 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc797253a_99fe_4114_8ebe_c9a2ea31b2c8.slice/crio-182d89abf4d3000305254380f873ddc3b041f1cdb33143eb4e51a2b46f97a2dd WatchSource:0}: Error finding container 182d89abf4d3000305254380f873ddc3b041f1cdb33143eb4e51a2b46f97a2dd: Status 404 returned error can't find the container with id 182d89abf4d3000305254380f873ddc3b041f1cdb33143eb4e51a2b46f97a2dd Jun 05 11:37:55.594296 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.594158 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:55.614578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.614544 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a56e121-28b7-485d-a634-97c32f976cd1" containerID="91005f7511e621daeef0c8c07bacc9996ed8a18b9c631e091ca2a5b7ad70b239" exitCode=0 Jun 05 11:37:55.614755 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.614623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerDied","Data":"91005f7511e621daeef0c8c07bacc9996ed8a18b9c631e091ca2a5b7ad70b239"} Jun 05 11:37:55.615838 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.615796 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zb52s" event={"ID":"c797253a-99fe-4114-8ebe-c9a2ea31b2c8","Type":"ContainerStarted","Data":"182d89abf4d3000305254380f873ddc3b041f1cdb33143eb4e51a2b46f97a2dd"} Jun 05 11:37:55.639357 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.639325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:55.920997 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:55.920912 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:56.622695 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:56.622655 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a56e121-28b7-485d-a634-97c32f976cd1" containerID="366552abeb29af2a65ec77a4c5dc1360dfd3e7d3439c1b7bc88a2df4b899b8fd" exitCode=0 Jun 05 11:37:56.623255 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:56.622725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerDied","Data":"366552abeb29af2a65ec77a4c5dc1360dfd3e7d3439c1b7bc88a2df4b899b8fd"} Jun 05 11:37:56.628558 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:56.628514 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:56.684145 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:56.684099 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:56.810376 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:56.810343 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:57.048326 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.048136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:37:57.048326 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:57.048317 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:37:57.048561 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:37:57.048416 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:38:01.048395018 +0000 UTC m=+43.122889520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:37:57.625515 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.625481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:57.629598 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.629562 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" event={"ID":"4a56e121-28b7-485d-a634-97c32f976cd1","Type":"ContainerStarted","Data":"166474fcbd4ba7ab960c79f3dbb00a6985be33ee10d53e20c496fa4c43cc4f5a"} Jun 05 11:37:57.631112 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.631076 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zb52s" event={"ID":"c797253a-99fe-4114-8ebe-c9a2ea31b2c8","Type":"ContainerStarted","Data":"f624bdead4b4870ddcb22c19b73e6268d29aaacd1de3e0d5074bc75b2a096878"} Jun 05 11:37:57.652094 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.652039 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxdbz" podStartSLOduration=9.111319014 podStartE2EDuration="38.652024329s" totalImagesPullingTime="29.540705315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:57.65087434 +0000 UTC m=+39.725368861" watchObservedRunningTime="2026-06-05 11:37:57.652024329 +0000 UTC m=+39.726518849" Jun 05 11:37:57.667472 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.667419 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zb52s" podStartSLOduration=3.0438387 podStartE2EDuration="4.667401071s" totalImagesPullingTime="1.623562371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:37:57.666637522 +0000 UTC m=+39.741132043" watchObservedRunningTime="2026-06-05 11:37:57.667401071 +0000 UTC m=+39.741895591" Jun 05 11:37:57.727024 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.726989 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:57.968709 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:57.968594 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:58.072343 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:58.072309 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:37:58.119389 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:37:58.119338 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:00.427018 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:00.426963 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:01.076747 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:01.076691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:38:01.076922 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:01.076850 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:38:01.076922 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:01.076905 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:38:09.07689033 +0000 UTC m=+51.151384830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:38:01.409303 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:01.409273 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:01.509761 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:01.509730 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:02.645820 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:02.645766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:06.877740 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:06.877681 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:06.979219 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:06.979180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:09.134985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:09.134944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:38:09.135434 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:09.135111 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:38:09.135434 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:09.135204 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:38:25.135176523 +0000 UTC m=+67.209671026 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:38:09.509539 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:09.509461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:09.610302 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:09.610268 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:11.963015 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:11.962981 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:12.064210 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:12.064177 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:12.112668 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:12.112641 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:19.606582 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:19.606545 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxspx" Jun 05 11:38:20.193893 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:20.193857 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:20.241730 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:20.241679 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:21.107233 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:21.107180 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:24.140651 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.140605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:38:24.140651 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.140654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:38:24.143700 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.143675 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 11:38:24.143844 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.143733 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 11:38:24.151594 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:24.151561 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 11:38:24.151728 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:24.151668 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:39:28.151646347 +0000 UTC m=+130.226140863 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : secret "metrics-daemon-secret" not found Jun 05 11:38:24.154267 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.154249 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 11:38:24.166155 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.166123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cprg\" (UniqueName: \"kubernetes.io/projected/a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b-kube-api-access-5cprg\") pod \"network-check-target-hkvws\" (UID: \"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b\") " pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:38:24.241748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.241715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:38:24.244194 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.244172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 11:38:24.254999 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.254968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d05d6a3-14b1-472b-a433-1346cd4c59c6-original-pull-secret\") pod \"global-pull-secret-syncer-2wm2q\" (UID: \"4d05d6a3-14b1-472b-a433-1346cd4c59c6\") " pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:38:24.330363 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.330326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92wv4\"" Jun 05 11:38:24.334208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.334186 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2wm2q" Jun 05 11:38:24.337591 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.337564 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:38:24.468069 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.468040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hkvws"] Jun 05 11:38:24.471240 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:38:24.471202 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a01e4e_dbfe_4a7b_8212_59eab3fbaf9b.slice/crio-1fc42a2c2022375b5a8f410fd0eda3edbad2e8fa8478c4ca31e7801578ba508f WatchSource:0}: Error finding container 1fc42a2c2022375b5a8f410fd0eda3edbad2e8fa8478c4ca31e7801578ba508f: Status 404 returned error can't find the container with id 1fc42a2c2022375b5a8f410fd0eda3edbad2e8fa8478c4ca31e7801578ba508f Jun 05 11:38:24.498295 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.498266 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2wm2q"] Jun 05 11:38:24.503173 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:38:24.503143 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d05d6a3_14b1_472b_a433_1346cd4c59c6.slice/crio-b5e794196119befe586cdb09aa731ea0b771766d0bda39f905fcf9e9350db33d WatchSource:0}: Error finding container b5e794196119befe586cdb09aa731ea0b771766d0bda39f905fcf9e9350db33d: Status 404 returned error can't find the container with id b5e794196119befe586cdb09aa731ea0b771766d0bda39f905fcf9e9350db33d Jun 05 11:38:24.697007 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.696916 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hkvws" event={"ID":"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b","Type":"ContainerStarted","Data":"1fc42a2c2022375b5a8f410fd0eda3edbad2e8fa8478c4ca31e7801578ba508f"} Jun 05 11:38:24.697850 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:24.697828 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2wm2q" event={"ID":"4d05d6a3-14b1-472b-a433-1346cd4c59c6","Type":"ContainerStarted","Data":"b5e794196119befe586cdb09aa731ea0b771766d0bda39f905fcf9e9350db33d"} Jun 05 11:38:25.149815 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:25.149763 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:38:25.150274 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:25.149914 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:38:25.150274 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:25.149982 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:38:57.149962075 +0000 UTC m=+99.224456587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:38:29.713765 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:29.713725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hkvws" event={"ID":"a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b","Type":"ContainerStarted","Data":"26550009a6b627f79ee973e2fa58d1b5d6a933b7c0dcfc3fdd868cbe80516f6d"} Jun 05 11:38:29.714242 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:29.713861 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:38:29.715217 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:29.715184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2wm2q" event={"ID":"4d05d6a3-14b1-472b-a433-1346cd4c59c6","Type":"ContainerStarted","Data":"57d9eec5cab3db0b4a3821ebd342a718cbf65421d09b4de0dd06ef60bd50263d"} Jun 05 11:38:29.728889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:29.728835 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hkvws" podStartSLOduration=66.369070264 podStartE2EDuration="1m10.728785852s" totalImagesPullingTime="4.359715588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:38:29.727679506 +0000 UTC m=+71.802174025" watchObservedRunningTime="2026-06-05 11:38:29.728785852 +0000 UTC m=+71.803280370" Jun 05 11:38:29.740395 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:29.740279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2wm2q" podStartSLOduration=66.409150693 podStartE2EDuration="1m10.740257844s" totalImagesPullingTime="4.331107151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:38:29.739664035 +0000 UTC m=+71.814158557" watchObservedRunningTime="2026-06-05 11:38:29.740257844 +0000 UTC m=+71.814752365" Jun 05 11:38:33.325064 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:33.325026 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:33.425094 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:33.425064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:33.695632 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:33.695547 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:38:57.175129 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:38:57.175087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:38:57.175590 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:57.175214 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:38:57.175590 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:38:57.175295 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:01.175280674 +0000 UTC m=+163.249775173 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:39:00.719639 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:39:00.719608 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hkvws" Jun 05 11:39:28.190008 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:39:28.189952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:39:28.190500 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:39:28.190096 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 11:39:28.190500 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:39:28.190151 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs podName:25aae35a-c484-4f93-b3d8-c2eb441b1e6d nodeName:}" failed. No retries permitted until 2026-06-05 11:41:30.190137496 +0000 UTC m=+252.264631999 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs") pod "network-metrics-daemon-fbfkh" (UID: "25aae35a-c484-4f93-b3d8-c2eb441b1e6d") : secret "metrics-daemon-secret" not found Jun 05 11:39:56.340644 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:39:56.340585 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dj7tz" podUID="3d01785c-b05f-4d1f-bf80-e06495018f32" Jun 05 11:39:56.440447 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:39:56.440399 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fbfkh" podUID="25aae35a-c484-4f93-b3d8-c2eb441b1e6d" Jun 05 11:39:56.924226 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:39:56.924199 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dj7tz" Jun 05 11:40:01.225648 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:01.225597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:40:01.226168 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:01.225721 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 11:40:01.226168 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:01.225789 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls podName:3d01785c-b05f-4d1f-bf80-e06495018f32 nodeName:}" failed. No retries permitted until 2026-06-05 11:42:03.225772399 +0000 UTC m=+285.300266900 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls") pod "dns-default-dj7tz" (UID: "3d01785c-b05f-4d1f-bf80-e06495018f32") : secret "dns-default-metrics-tls" not found Jun 05 11:40:08.417353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:08.417316 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:40:15.773445 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:15.773404 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:18.121696 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:18.121660 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:53.232182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:53.232148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:54.957501 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.957461 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x"] Jun 05 11:40:54.960528 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.960369 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" Jun 05 11:40:54.961179 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.961151 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn"] Jun 05 11:40:54.963316 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.963295 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w4kbs\"" Jun 05 11:40:54.964042 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.964024 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-nwlz8"] Jun 05 11:40:54.964135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.964123 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:54.966332 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.966309 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 11:40:54.966444 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.966313 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 11:40:54.966565 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.966546 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 11:40:54.966650 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.966631 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fsdtg\"" Jun 05 11:40:54.968870 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.968843 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:54.971429 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.971395 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kdwcz\"" Jun 05 11:40:54.971574 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.971429 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 11:40:54.972224 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.972198 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 11:40:54.972325 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.972275 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 11:40:54.972325 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.972308 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 11:40:54.973304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.973277 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x"] Jun 05 11:40:54.977989 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.977960 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 11:40:54.978984 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.978950 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn"] Jun 05 11:40:54.981643 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:54.981620 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nwlz8"] Jun 05 11:40:55.064378 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.064347 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-858bfd5f6d-vrwcx"] Jun 05 11:40:55.067478 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.067457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d5c5d4965-2thf6"] Jun 05 11:40:55.067605 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.067588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.070021 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.069988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 11:40:55.070155 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.070107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 11:40:55.070224 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.070207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.070743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.070728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s879k\"" Jun 05 11:40:55.071281 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.071259 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 11:40:55.073525 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.073499 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 11:40:55.073633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.073566 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 11:40:55.073633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.073578 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 11:40:55.073633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.073626 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 11:40:55.073783 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.073680 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 11:40:55.073889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.073875 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 11:40:55.074620 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.074607 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8rtpb\"" Jun 05 11:40:55.076325 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.076305 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 11:40:55.082479 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.082271 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5c5d4965-2thf6"] Jun 05 11:40:55.087595 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.087570 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858bfd5f6d-vrwcx"] Jun 05 11:40:55.108499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krpms\" (UniqueName: \"kubernetes.io/projected/7e951429-325b-4890-9d67-9436e1ae0f4f-kube-api-access-krpms\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.108699 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e951429-325b-4890-9d67-9436e1ae0f4f-service-ca-bundle\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.108699 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65xq\" (UniqueName: \"kubernetes.io/projected/135738b1-5478-4138-864c-140794eb5180-kube-api-access-q65xq\") pod \"network-check-source-dbd9cf844-wr87x\" (UID: \"135738b1-5478-4138-864c-140794eb5180\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" Jun 05 11:40:55.108699 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:55.108699 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e951429-325b-4890-9d67-9436e1ae0f4f-snapshots\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.108699 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e951429-325b-4890-9d67-9436e1ae0f4f-serving-cert\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.108699 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e951429-325b-4890-9d67-9436e1ae0f4f-tmp\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.109041 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e951429-325b-4890-9d67-9436e1ae0f4f-trusted-ca-bundle\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.109041 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.108831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vwr\" (UniqueName: \"kubernetes.io/projected/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-kube-api-access-g7vwr\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:55.209291 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:55.209291 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-trusted-ca\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.209291 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209252 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e951429-325b-4890-9d67-9436e1ae0f4f-tmp\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.209291 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e951429-325b-4890-9d67-9436e1ae0f4f-trusted-ca-bundle\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209332 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vwr\" (UniqueName: \"kubernetes.io/projected/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-kube-api-access-g7vwr\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.209357 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-default-certificate\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2jsl\" (UniqueName: \"kubernetes.io/projected/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-kube-api-access-w2jsl\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.209442 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls podName:ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a nodeName:}" failed. No retries permitted until 2026-06-05 11:40:55.709418541 +0000 UTC m=+217.783913045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-69ldn" (UID: "ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a") : secret "samples-operator-tls" not found Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/885a9c96-f457-40b8-9aad-4a94455e9353-ca-trust-extracted\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-stats-auth\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krpms\" (UniqueName: \"kubernetes.io/projected/7e951429-325b-4890-9d67-9436e1ae0f4f-kube-api-access-krpms\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.209564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209554 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e951429-325b-4890-9d67-9436e1ae0f4f-service-ca-bundle\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-installation-pull-secrets\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65xq\" (UniqueName: \"kubernetes.io/projected/135738b1-5478-4138-864c-140794eb5180-kube-api-access-q65xq\") pod \"network-check-source-dbd9cf844-wr87x\" (UID: \"135738b1-5478-4138-864c-140794eb5180\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e951429-325b-4890-9d67-9436e1ae0f4f-snapshots\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e951429-325b-4890-9d67-9436e1ae0f4f-tmp\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-image-registry-private-configuration\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbp7\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-kube-api-access-5pbp7\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-registry-certificates\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209890 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e951429-325b-4890-9d67-9436e1ae0f4f-serving-cert\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.210019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.209978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-bound-sa-token\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.210481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.210226 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e951429-325b-4890-9d67-9436e1ae0f4f-trusted-ca-bundle\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.210481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.210253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e951429-325b-4890-9d67-9436e1ae0f4f-snapshots\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.210481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.210265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e951429-325b-4890-9d67-9436e1ae0f4f-service-ca-bundle\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.212223 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.212203 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e951429-325b-4890-9d67-9436e1ae0f4f-serving-cert\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.219672 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.219640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krpms\" (UniqueName: \"kubernetes.io/projected/7e951429-325b-4890-9d67-9436e1ae0f4f-kube-api-access-krpms\") pod \"insights-operator-896549976-nwlz8\" (UID: \"7e951429-325b-4890-9d67-9436e1ae0f4f\") " pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.219822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.219718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vwr\" (UniqueName: \"kubernetes.io/projected/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-kube-api-access-g7vwr\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:55.219822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.219716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65xq\" (UniqueName: \"kubernetes.io/projected/135738b1-5478-4138-864c-140794eb5180-kube-api-access-q65xq\") pod \"network-check-source-dbd9cf844-wr87x\" (UID: \"135738b1-5478-4138-864c-140794eb5180\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" Jun 05 11:40:55.240039 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.240006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:55.275292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.275238 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" Jun 05 11:40:55.288586 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.288548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-nwlz8" Jun 05 11:40:55.310908 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.310874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-registry-certificates\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.310918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.311075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.310944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-bound-sa-token\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.310998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-trusted-ca\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311030 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-default-certificate\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.311075 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2jsl\" (UniqueName: \"kubernetes.io/projected/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-kube-api-access-w2jsl\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.311075 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.311057 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/885a9c96-f457-40b8-9aad-4a94455e9353-ca-trust-extracted\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.311148 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:40:55.811123955 +0000 UTC m=+217.885618471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : secret "router-metrics-certs-default" not found Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-stats-auth\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-installation-pull-secrets\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-image-registry-private-configuration\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbp7\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-kube-api-access-5pbp7\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311367 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.311877 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.311490 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 11:40:55.311877 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.311497 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:40:55.811478162 +0000 UTC m=+217.885972665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : configmap references non-existent config key: service-ca.crt Jun 05 11:40:55.311877 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.311503 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858bfd5f6d-vrwcx: secret "image-registry-tls" not found Jun 05 11:40:55.311877 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.311548 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls podName:885a9c96-f457-40b8-9aad-4a94455e9353 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:55.811536627 +0000 UTC m=+217.886031129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls") pod "image-registry-858bfd5f6d-vrwcx" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353") : secret "image-registry-tls" not found Jun 05 11:40:55.311877 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-registry-certificates\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.312148 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.311921 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/885a9c96-f457-40b8-9aad-4a94455e9353-ca-trust-extracted\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.312897 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.312872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-trusted-ca\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.314159 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.314138 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-installation-pull-secrets\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.314270 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.314225 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-stats-auth\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.314380 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.314359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-image-registry-private-configuration\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.314646 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.314625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-default-certificate\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.321678 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.321648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbp7\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-kube-api-access-5pbp7\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.321821 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.321736 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2jsl\" (UniqueName: \"kubernetes.io/projected/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-kube-api-access-w2jsl\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.321888 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.321867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-bound-sa-token\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.342409 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.342325 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:55.409789 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.409750 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x"] Jun 05 11:40:55.413561 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:40:55.413527 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod135738b1_5478_4138_864c_140794eb5180.slice/crio-88d96dc5ecb30681a4e830ae4b277bf5a143024d4db4a88800839f9d2f85e82f WatchSource:0}: Error finding container 88d96dc5ecb30681a4e830ae4b277bf5a143024d4db4a88800839f9d2f85e82f: Status 404 returned error can't find the container with id 88d96dc5ecb30681a4e830ae4b277bf5a143024d4db4a88800839f9d2f85e82f Jun 05 11:40:55.428500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.428473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-nwlz8"] Jun 05 11:40:55.431432 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:40:55.431401 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e951429_325b_4890_9d67_9436e1ae0f4f.slice/crio-ec4ab9a6cb12f6e21a89348610fed4a9b0e792f87733015354e5d9bd726c0372 WatchSource:0}: Error finding container ec4ab9a6cb12f6e21a89348610fed4a9b0e792f87733015354e5d9bd726c0372: Status 404 returned error can't find the container with id ec4ab9a6cb12f6e21a89348610fed4a9b0e792f87733015354e5d9bd726c0372 Jun 05 11:40:55.715127 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.715072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:55.715277 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.715246 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 11:40:55.715335 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.715324 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls podName:ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a nodeName:}" failed. No retries permitted until 2026-06-05 11:40:56.715306137 +0000 UTC m=+218.789800650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-69ldn" (UID: "ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a") : secret "samples-operator-tls" not found Jun 05 11:40:55.815768 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.815726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.815768 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.815775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:55.816052 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:55.815878 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:55.816052 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.815942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:40:56.815918393 +0000 UTC m=+218.890412909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : configmap references non-existent config key: service-ca.crt Jun 05 11:40:55.816052 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.815985 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 11:40:55.816052 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.816027 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:40:56.816015762 +0000 UTC m=+218.890510261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : secret "router-metrics-certs-default" not found Jun 05 11:40:55.816215 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.816018 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 11:40:55.816215 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.816069 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858bfd5f6d-vrwcx: secret "image-registry-tls" not found Jun 05 11:40:55.816215 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:55.816117 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls podName:885a9c96-f457-40b8-9aad-4a94455e9353 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:56.816102663 +0000 UTC m=+218.890597164 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls") pod "image-registry-858bfd5f6d-vrwcx" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353") : secret "image-registry-tls" not found Jun 05 11:40:56.068090 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.067979 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" event={"ID":"135738b1-5478-4138-864c-140794eb5180","Type":"ContainerStarted","Data":"5a72c3c218498b47169d763b5ff20df27c3e50ccde8d22dd4ec116069638f167"} Jun 05 11:40:56.068553 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.068190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" event={"ID":"135738b1-5478-4138-864c-140794eb5180","Type":"ContainerStarted","Data":"88d96dc5ecb30681a4e830ae4b277bf5a143024d4db4a88800839f9d2f85e82f"} Jun 05 11:40:56.069481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.069454 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nwlz8" event={"ID":"7e951429-325b-4890-9d67-9436e1ae0f4f","Type":"ContainerStarted","Data":"ec4ab9a6cb12f6e21a89348610fed4a9b0e792f87733015354e5d9bd726c0372"} Jun 05 11:40:56.082611 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.082550 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-wr87x" podStartSLOduration=2.082530687 podStartE2EDuration="2.082530687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:56.081909645 +0000 UTC m=+218.156404168" watchObservedRunningTime="2026-06-05 11:40:56.082530687 +0000 UTC m=+218.157025210" Jun 05 11:40:56.722880 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.722837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:56.723067 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.722979 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 11:40:56.723067 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.723049 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls podName:ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a nodeName:}" failed. No retries permitted until 2026-06-05 11:40:58.723031954 +0000 UTC m=+220.797526454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-69ldn" (UID: "ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a") : secret "samples-operator-tls" not found Jun 05 11:40:56.824117 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.824060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:56.824262 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.824209 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 11:40:56.824322 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.824269 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:40:58.82425387 +0000 UTC m=+220.898748370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : secret "router-metrics-certs-default" not found Jun 05 11:40:56.824322 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.824215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:56.824322 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.824320 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:40:58.82430264 +0000 UTC m=+220.898797145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : configmap references non-existent config key: service-ca.crt Jun 05 11:40:56.824461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:56.824357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:56.824498 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.824460 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 11:40:56.824498 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.824472 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858bfd5f6d-vrwcx: secret "image-registry-tls" not found Jun 05 11:40:56.824577 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:56.824513 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls podName:885a9c96-f457-40b8-9aad-4a94455e9353 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:58.824500444 +0000 UTC m=+220.898994949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls") pod "image-registry-858bfd5f6d-vrwcx" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353") : secret "image-registry-tls" not found Jun 05 11:40:57.507962 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:57.507931 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:57.554454 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:57.554416 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:58.077494 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.077452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nwlz8" event={"ID":"7e951429-325b-4890-9d67-9436e1ae0f4f","Type":"ContainerStarted","Data":"c5e2858c8e29afed67e133fb829afbaec98aedc878536be644c8f86a28b926f6"} Jun 05 11:40:58.095975 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.095921 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-nwlz8" podStartSLOduration=2.209973231 podStartE2EDuration="4.095903757s" totalImagesPullingTime="1.885930526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:58.095217276 +0000 UTC m=+220.169711798" watchObservedRunningTime="2026-06-05 11:40:58.095903757 +0000 UTC m=+220.170398278" Jun 05 11:40:58.741204 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.741152 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:40:58.741618 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.741293 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 11:40:58.741618 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.741362 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls podName:ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a nodeName:}" failed. No retries permitted until 2026-06-05 11:41:02.741343294 +0000 UTC m=+224.815837793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-69ldn" (UID: "ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a") : secret "samples-operator-tls" not found Jun 05 11:40:58.841602 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.841564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:58.841790 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.841672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:40:58.841790 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.841704 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 11:40:58.841790 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.841762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:41:02.841746169 +0000 UTC m=+224.916240668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : secret "router-metrics-certs-default" not found Jun 05 11:40:58.841790 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.841705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:40:58.842004 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.841797 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 11:40:58.842004 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.841826 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858bfd5f6d-vrwcx: secret "image-registry-tls" not found Jun 05 11:40:58.842004 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.841852 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:41:02.841834579 +0000 UTC m=+224.916329083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : configmap references non-existent config key: service-ca.crt Jun 05 11:40:58.842004 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:40:58.841877 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls podName:885a9c96-f457-40b8-9aad-4a94455e9353 nodeName:}" failed. No retries permitted until 2026-06-05 11:41:02.841865637 +0000 UTC m=+224.916360139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls") pod "image-registry-858bfd5f6d-vrwcx" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353") : secret "image-registry-tls" not found Jun 05 11:40:58.906001 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.905969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:58.957987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:58.957954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:59.457113 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:59.457082 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:59.550762 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:59.550725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:59.650537 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:59.650509 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:40:59.987928 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:40:59.987887 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:00.039495 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:00.039457 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:00.416698 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:00.416659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:00.466372 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:00.466327 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:00.688153 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:00.688069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:00.789868 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:00.789837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:01.014850 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:01.014756 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vk7ss_9543d026-5bb4-40b8-a75a-3e01b64ad205/dns-node-resolver/0.log" Jun 05 11:41:01.519853 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:01.519822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:02.015599 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.015571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvw5s_649b89ed-77fc-4a6c-9088-756726e5d6f2/node-ca/0.log" Jun 05 11:41:02.318164 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.318131 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:02.373436 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.373402 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:02.770778 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.770677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:41:02.770952 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.770864 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 11:41:02.770952 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.770939 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls podName:ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a nodeName:}" failed. No retries permitted until 2026-06-05 11:41:10.770920341 +0000 UTC m=+232.845414840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-69ldn" (UID: "ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a") : secret "samples-operator-tls" not found Jun 05 11:41:02.817280 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.817254 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zb52s_c797253a-99fe-4114-8ebe-c9a2ea31b2c8/serve-healthcheck-canary/0.log" Jun 05 11:41:02.871677 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.871640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:02.871788 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.871683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:02.871788 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:02.871710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:02.871893 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.871829 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 11:41:02.871893 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.871851 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858bfd5f6d-vrwcx: secret "image-registry-tls" not found Jun 05 11:41:02.871893 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.871852 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 11:41:02.871893 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.871836 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:41:10.871819356 +0000 UTC m=+232.946313868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : configmap references non-existent config key: service-ca.crt Jun 05 11:41:02.871893 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.871896 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs podName:464cdb2a-4f2e-4411-a4f1-8ac88d62021b nodeName:}" failed. No retries permitted until 2026-06-05 11:41:10.871880805 +0000 UTC m=+232.946375318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs") pod "router-default-6d5c5d4965-2thf6" (UID: "464cdb2a-4f2e-4411-a4f1-8ac88d62021b") : secret "router-metrics-certs-default" not found Jun 05 11:41:02.872067 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:02.871923 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls podName:885a9c96-f457-40b8-9aad-4a94455e9353 nodeName:}" failed. No retries permitted until 2026-06-05 11:41:10.871905329 +0000 UTC m=+232.946399845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls") pod "image-registry-858bfd5f6d-vrwcx" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353") : secret "image-registry-tls" not found Jun 05 11:41:03.270505 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:03.270463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:04.390456 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:04.390423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:04.550397 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:04.550365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:04.671508 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:04.671421 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:04.772093 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:04.772052 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:04.873256 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:04.873225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:05.288793 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:05.288714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:05.487343 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:05.487306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:06.034073 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:06.034024 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:06.684661 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:06.684626 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:06.894242 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:06.894207 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:07.090512 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:07.090482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:07.289324 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:07.289295 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:07.499640 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:07.499559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:07.981787 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:07.981751 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:08.286601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:08.286525 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:08.717137 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:08.717107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:08.890996 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:08.890965 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:09.084384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:09.084351 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:09.281887 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:09.281860 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:09.439392 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:09.439318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:09.537918 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:09.537888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:10.483037 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.482996 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:10.835426 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.835390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:41:10.837841 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.837787 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-69ldn\" (UID: \"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:41:10.882120 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.882082 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" Jun 05 11:41:10.891119 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.891079 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:10.936337 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.936254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:10.936337 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.936317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:10.936521 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.936360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:10.937135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.937104 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-service-ca-bundle\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:10.939151 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.939079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/464cdb2a-4f2e-4411-a4f1-8ac88d62021b-metrics-certs\") pod \"router-default-6d5c5d4965-2thf6\" (UID: \"464cdb2a-4f2e-4411-a4f1-8ac88d62021b\") " pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:10.939279 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.939152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"image-registry-858bfd5f6d-vrwcx\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:10.979251 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.979213 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:10.985703 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.985675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:10.992409 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:10.992343 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:11.011267 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.011191 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn"] Jun 05 11:41:11.092953 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.092908 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:11.116615 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.116575 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858bfd5f6d-vrwcx"] Jun 05 11:41:11.117437 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.117338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" event={"ID":"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a","Type":"ContainerStarted","Data":"6cc6e365c55ee2c5a4f8499f09c50bfa38d7d4009c3c29484181fe34eaa652c4"} Jun 05 11:41:11.119360 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:11.119329 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885a9c96_f457_40b8_9aad_4a94455e9353.slice/crio-da2d1f1935890d9e88e8957f308fccb068dd7faac154a7d5c287b8da20fa63f4 WatchSource:0}: Error finding container da2d1f1935890d9e88e8957f308fccb068dd7faac154a7d5c287b8da20fa63f4: Status 404 returned error can't find the container with id da2d1f1935890d9e88e8957f308fccb068dd7faac154a7d5c287b8da20fa63f4 Jun 05 11:41:11.136319 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.136291 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d5c5d4965-2thf6"] Jun 05 11:41:11.146916 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:11.146888 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464cdb2a_4f2e_4411_a4f1_8ac88d62021b.slice/crio-2c8eb9e2d4020db01789641984364d7e8a35770f2a4862ef734ab92ef9bf78b9 WatchSource:0}: Error finding container 2c8eb9e2d4020db01789641984364d7e8a35770f2a4862ef734ab92ef9bf78b9: Status 404 returned error can't find the container with id 2c8eb9e2d4020db01789641984364d7e8a35770f2a4862ef734ab92ef9bf78b9 Jun 05 11:41:11.284966 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.284927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:11.587115 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.587069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:11.688924 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:11.688895 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:12.123275 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.123237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" event={"ID":"464cdb2a-4f2e-4411-a4f1-8ac88d62021b","Type":"ContainerStarted","Data":"64c6ae6057ac9181e83f1b22f962fb3c5f44ce8b454cc134f39dfaf0ab233f74"} Jun 05 11:41:12.123460 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.123296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" event={"ID":"464cdb2a-4f2e-4411-a4f1-8ac88d62021b","Type":"ContainerStarted","Data":"2c8eb9e2d4020db01789641984364d7e8a35770f2a4862ef734ab92ef9bf78b9"} Jun 05 11:41:12.124944 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.124908 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" event={"ID":"885a9c96-f457-40b8-9aad-4a94455e9353","Type":"ContainerStarted","Data":"a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9"} Jun 05 11:41:12.125090 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.124962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" event={"ID":"885a9c96-f457-40b8-9aad-4a94455e9353","Type":"ContainerStarted","Data":"da2d1f1935890d9e88e8957f308fccb068dd7faac154a7d5c287b8da20fa63f4"} Jun 05 11:41:12.125090 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.124987 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:12.141435 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.141383 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" podStartSLOduration=17.14137065 podStartE2EDuration="17.14137065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:12.140167766 +0000 UTC m=+234.214662287" watchObservedRunningTime="2026-06-05 11:41:12.14137065 +0000 UTC m=+234.215865149" Jun 05 11:41:12.157185 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.157113 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" podStartSLOduration=17.157093028 podStartE2EDuration="17.157093028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:12.155771142 +0000 UTC m=+234.230265662" watchObservedRunningTime="2026-06-05 11:41:12.157093028 +0000 UTC m=+234.231587548" Jun 05 11:41:12.286090 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.286056 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:12.687435 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.687397 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:12.986654 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.986576 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:12.989242 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:12.989217 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:13.083706 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:13.083678 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:13.130869 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:13.130832 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" event={"ID":"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a","Type":"ContainerStarted","Data":"b72e1788b538601a42742f7973896a23a00f2aa1300e07837a994b644c1f25be"} Jun 05 11:41:13.131160 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:13.131139 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:13.132536 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:13.132516 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d5c5d4965-2thf6" Jun 05 11:41:13.312321 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:13.312289 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:13.689011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:13.688922 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:14.135467 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:14.135431 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" event={"ID":"ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a","Type":"ContainerStarted","Data":"ac6976b0a3de3cb44f8e486de385ab43b1f8debd976c9f7c0aa18a235a9cd1a4"} Jun 05 11:41:14.150105 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:14.150054 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-69ldn" podStartSLOduration=18.189493165 podStartE2EDuration="20.150038323s" totalImagesPullingTime="1.960545158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:14.148949066 +0000 UTC m=+236.223443587" watchObservedRunningTime="2026-06-05 11:41:14.150038323 +0000 UTC m=+236.224532844" Jun 05 11:41:14.509906 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:14.509799 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:14.689079 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:14.689049 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:14.890388 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:14.890357 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:15.086349 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:15.086317 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:19.288326 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:19.288287 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:19.389019 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:19.388988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:19.442567 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:19.442537 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:19.597836 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:19.597790 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:19.971824 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:19.971695 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:20.381443 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:20.381408 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:20.594134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:20.594082 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:20.694607 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:20.694509 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:20.795095 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:20.795055 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:20.986338 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:20.986248 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:21.037363 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.037328 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:21.200219 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.200187 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:21.248203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.248123 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:21.511207 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.511122 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-88shg"] Jun 05 11:41:21.515967 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.515939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.518479 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.518455 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 11:41:21.519323 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 11:41:21.519323 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519312 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8tw42\"" Jun 05 11:41:21.519592 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17d13dbf-c767-4c62-b61e-81e5befe371a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.519665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17d13dbf-c767-4c62-b61e-81e5befe371a-data-volume\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.519665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfdvx\" (UniqueName: \"kubernetes.io/projected/17d13dbf-c767-4c62-b61e-81e5befe371a-kube-api-access-xfdvx\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.519762 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17d13dbf-c767-4c62-b61e-81e5befe371a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.519827 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.519769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17d13dbf-c767-4c62-b61e-81e5befe371a-crio-socket\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.538230 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.538194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88shg"] Jun 05 11:41:21.539504 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.539470 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858bfd5f6d-vrwcx"] Jun 05 11:41:21.606560 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.606532 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86f4ccdb6b-sfwqj"] Jun 05 11:41:21.609849 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.609828 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a077577-c19b-4180-85d5-f7cf91a9e9f1-installation-pull-secrets\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17d13dbf-c767-4c62-b61e-81e5befe371a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-registry-tls\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a077577-c19b-4180-85d5-f7cf91a9e9f1-trusted-ca\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17d13dbf-c767-4c62-b61e-81e5befe371a-data-volume\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfdvx\" (UniqueName: \"kubernetes.io/projected/17d13dbf-c767-4c62-b61e-81e5befe371a-kube-api-access-xfdvx\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17d13dbf-c767-4c62-b61e-81e5befe371a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57j2g\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-kube-api-access-57j2g\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-bound-sa-token\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a077577-c19b-4180-85d5-f7cf91a9e9f1-image-registry-private-configuration\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17d13dbf-c767-4c62-b61e-81e5befe371a-crio-socket\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17d13dbf-c767-4c62-b61e-81e5befe371a-data-volume\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a077577-c19b-4180-85d5-f7cf91a9e9f1-ca-trust-extracted\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17d13dbf-c767-4c62-b61e-81e5befe371a-crio-socket\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.620666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620532 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a077577-c19b-4180-85d5-f7cf91a9e9f1-registry-certificates\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.620666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.620652 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17d13dbf-c767-4c62-b61e-81e5befe371a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.622509 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.622482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17d13dbf-c767-4c62-b61e-81e5befe371a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.628265 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.628239 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86f4ccdb6b-sfwqj"] Jun 05 11:41:21.636744 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.636714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfdvx\" (UniqueName: \"kubernetes.io/projected/17d13dbf-c767-4c62-b61e-81e5befe371a-kube-api-access-xfdvx\") pod \"insights-runtime-extractor-88shg\" (UID: \"17d13dbf-c767-4c62-b61e-81e5befe371a\") " pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.641910 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.641881 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:21.721340 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a077577-c19b-4180-85d5-f7cf91a9e9f1-installation-pull-secrets\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721340 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-registry-tls\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721379 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a077577-c19b-4180-85d5-f7cf91a9e9f1-trusted-ca\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57j2g\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-kube-api-access-57j2g\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-bound-sa-token\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a077577-c19b-4180-85d5-f7cf91a9e9f1-image-registry-private-configuration\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a077577-c19b-4180-85d5-f7cf91a9e9f1-ca-trust-extracted\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.721914 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.721702 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a077577-c19b-4180-85d5-f7cf91a9e9f1-registry-certificates\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.722095 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.722076 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7a077577-c19b-4180-85d5-f7cf91a9e9f1-ca-trust-extracted\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.722457 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.722435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a077577-c19b-4180-85d5-f7cf91a9e9f1-trusted-ca\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.722567 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.722545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7a077577-c19b-4180-85d5-f7cf91a9e9f1-registry-certificates\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.724085 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.724061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7a077577-c19b-4180-85d5-f7cf91a9e9f1-installation-pull-secrets\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.724415 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.724392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7a077577-c19b-4180-85d5-f7cf91a9e9f1-image-registry-private-configuration\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.724481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.724469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-registry-tls\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.729285 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.729255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-bound-sa-token\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.729404 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.729364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57j2g\" (UniqueName: \"kubernetes.io/projected/7a077577-c19b-4180-85d5-f7cf91a9e9f1-kube-api-access-57j2g\") pod \"image-registry-86f4ccdb6b-sfwqj\" (UID: \"7a077577-c19b-4180-85d5-f7cf91a9e9f1\") " pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.737946 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.737919 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:21.824445 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.824412 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88shg" Jun 05 11:41:21.920285 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.920245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:21.959113 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:21.959071 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88shg"] Jun 05 11:41:21.961616 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:21.961587 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d13dbf_c767_4c62_b61e_81e5befe371a.slice/crio-118d1aa5865c0d45f3578c7215becb0ade30b9c8362790cadd5e832bc87d3e37 WatchSource:0}: Error finding container 118d1aa5865c0d45f3578c7215becb0ade30b9c8362790cadd5e832bc87d3e37: Status 404 returned error can't find the container with id 118d1aa5865c0d45f3578c7215becb0ade30b9c8362790cadd5e832bc87d3e37 Jun 05 11:41:22.060869 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.060837 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86f4ccdb6b-sfwqj"] Jun 05 11:41:22.065140 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:22.065113 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a077577_c19b_4180_85d5_f7cf91a9e9f1.slice/crio-5699f6dd1e3ab90ea96939817c69d10876a64edb01d17754790a5a46425f19e4 WatchSource:0}: Error finding container 5699f6dd1e3ab90ea96939817c69d10876a64edb01d17754790a5a46425f19e4: Status 404 returned error can't find the container with id 5699f6dd1e3ab90ea96939817c69d10876a64edb01d17754790a5a46425f19e4 Jun 05 11:41:22.161836 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.161792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" event={"ID":"7a077577-c19b-4180-85d5-f7cf91a9e9f1","Type":"ContainerStarted","Data":"18c4b1fefc940f35f4729184ad1c771a5e7588ae07e1706fe976ad852d5e0432"} Jun 05 11:41:22.162012 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.161857 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" event={"ID":"7a077577-c19b-4180-85d5-f7cf91a9e9f1","Type":"ContainerStarted","Data":"5699f6dd1e3ab90ea96939817c69d10876a64edb01d17754790a5a46425f19e4"} Jun 05 11:41:22.162012 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.161892 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:41:22.163347 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.163322 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88shg" event={"ID":"17d13dbf-c767-4c62-b61e-81e5befe371a","Type":"ContainerStarted","Data":"b5ac83e185f24e57dc6867d1c99fa1fcd899f15fa46b04ac256ee63d2a7a9543"} Jun 05 11:41:22.163457 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.163368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88shg" event={"ID":"17d13dbf-c767-4c62-b61e-81e5befe371a","Type":"ContainerStarted","Data":"118d1aa5865c0d45f3578c7215becb0ade30b9c8362790cadd5e832bc87d3e37"} Jun 05 11:41:22.179213 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:22.179156 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podStartSLOduration=1.179139185 podStartE2EDuration="1.179139185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:22.178506819 +0000 UTC m=+244.253001341" watchObservedRunningTime="2026-06-05 11:41:22.179139185 +0000 UTC m=+244.253633753" Jun 05 11:41:23.168991 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:23.168950 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88shg" event={"ID":"17d13dbf-c767-4c62-b61e-81e5befe371a","Type":"ContainerStarted","Data":"d32efdac213bee19445694995af869dc246b83a9fb788c5ac6c9ef2f84ff3b6b"} Jun 05 11:41:24.173748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:24.173710 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88shg" event={"ID":"17d13dbf-c767-4c62-b61e-81e5befe371a","Type":"ContainerStarted","Data":"8a9d8af2cc366e82fe614c499d9b3c0a5c97560bff0095070f62dfaefe0bf58c"} Jun 05 11:41:24.190603 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:24.190552 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-88shg" podStartSLOduration=1.2892942490000001 podStartE2EDuration="3.190534379s" totalImagesPullingTime="1.90124013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:41:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:24.188767559 +0000 UTC m=+246.263262080" watchObservedRunningTime="2026-06-05 11:41:24.190534379 +0000 UTC m=+246.265028921" Jun 05 11:41:24.963874 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:24.963844 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:25.018397 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:25.018360 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:29.638969 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.638888 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:29.737266 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.737235 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:29.767583 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.767552 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7"] Jun 05 11:41:29.772367 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.772347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:29.775988 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.775956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 11:41:29.776112 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.775996 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8fl6r\"" Jun 05 11:41:29.778651 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.778627 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7"] Jun 05 11:41:29.794059 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.794025 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:29.885555 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.885516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d68ea8-8d8a-4aa1-a6b8-896796c2e513-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4dst7\" (UID: \"d8d68ea8-8d8a-4aa1-a6b8-896796c2e513\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:29.986256 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:29.986161 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d68ea8-8d8a-4aa1-a6b8-896796c2e513-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4dst7\" (UID: \"d8d68ea8-8d8a-4aa1-a6b8-896796c2e513\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:29.986422 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:29.986305 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 05 11:41:29.986422 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:29.986406 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8d68ea8-8d8a-4aa1-a6b8-896796c2e513-tls-certificates podName:d8d68ea8-8d8a-4aa1-a6b8-896796c2e513 nodeName:}" failed. No retries permitted until 2026-06-05 11:41:30.486384375 +0000 UTC m=+252.560878874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d8d68ea8-8d8a-4aa1-a6b8-896796c2e513-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-4dst7" (UID: "d8d68ea8-8d8a-4aa1-a6b8-896796c2e513") : secret "prometheus-operator-admission-webhook-tls" not found Jun 05 11:41:30.288133 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.288038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:41:30.290413 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.290391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/25aae35a-c484-4f93-b3d8-c2eb441b1e6d-metrics-certs\") pod \"network-metrics-daemon-fbfkh\" (UID: \"25aae35a-c484-4f93-b3d8-c2eb441b1e6d\") " pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:41:30.320442 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.320409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k8g9r\"" Jun 05 11:41:30.329377 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.329349 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbfkh" Jun 05 11:41:30.409450 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.409422 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:30.459658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.459625 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbfkh"] Jun 05 11:41:30.462786 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:30.462751 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25aae35a_c484_4f93_b3d8_c2eb441b1e6d.slice/crio-0dbc1f310a76bd1502d7cecf0eedf6ba834f69a3b3442f47c912278235d181f9 WatchSource:0}: Error finding container 0dbc1f310a76bd1502d7cecf0eedf6ba834f69a3b3442f47c912278235d181f9: Status 404 returned error can't find the container with id 0dbc1f310a76bd1502d7cecf0eedf6ba834f69a3b3442f47c912278235d181f9 Jun 05 11:41:30.490026 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.489989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d68ea8-8d8a-4aa1-a6b8-896796c2e513-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4dst7\" (UID: \"d8d68ea8-8d8a-4aa1-a6b8-896796c2e513\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:30.492398 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.492370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d8d68ea8-8d8a-4aa1-a6b8-896796c2e513-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-4dst7\" (UID: \"d8d68ea8-8d8a-4aa1-a6b8-896796c2e513\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:30.681770 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.681729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:30.810449 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:30.810405 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7"] Jun 05 11:41:30.813106 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:30.813080 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d68ea8_8d8a_4aa1_a6b8_896796c2e513.slice/crio-6d17dce8ba4de5b57ebd45c432d58015717a5d8ccceeeff2adb8657a539f57bf WatchSource:0}: Error finding container 6d17dce8ba4de5b57ebd45c432d58015717a5d8ccceeeff2adb8657a539f57bf: Status 404 returned error can't find the container with id 6d17dce8ba4de5b57ebd45c432d58015717a5d8ccceeeff2adb8657a539f57bf Jun 05 11:41:31.199643 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:31.199602 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" event={"ID":"d8d68ea8-8d8a-4aa1-a6b8-896796c2e513","Type":"ContainerStarted","Data":"6d17dce8ba4de5b57ebd45c432d58015717a5d8ccceeeff2adb8657a539f57bf"} Jun 05 11:41:31.200958 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:31.200922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbfkh" event={"ID":"25aae35a-c484-4f93-b3d8-c2eb441b1e6d","Type":"ContainerStarted","Data":"0dbc1f310a76bd1502d7cecf0eedf6ba834f69a3b3442f47c912278235d181f9"} Jun 05 11:41:31.546384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:31.546342 2574 patch_prober.go:28] interesting pod/image-registry-858bfd5f6d-vrwcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:41:31.546561 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:31.546404 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:41:32.208440 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.208406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" event={"ID":"d8d68ea8-8d8a-4aa1-a6b8-896796c2e513","Type":"ContainerStarted","Data":"27ec930ddbaaea2a45b0616f0ab966b5c29aa1939961654784d31dcf7564c491"} Jun 05 11:41:32.208911 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.208560 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:32.210395 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.210365 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbfkh" event={"ID":"25aae35a-c484-4f93-b3d8-c2eb441b1e6d","Type":"ContainerStarted","Data":"714da9c79096979f0f41d3b8e1d3dc866bc7b54df8b6aeb2d8ff9996a143a398"} Jun 05 11:41:32.210520 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.210413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbfkh" event={"ID":"25aae35a-c484-4f93-b3d8-c2eb441b1e6d","Type":"ContainerStarted","Data":"1ca4ffa3c44431568a44b1d3edb2e20c4dacb68d933b70abf87871353a32cc93"} Jun 05 11:41:32.213702 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.213678 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" Jun 05 11:41:32.222690 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.222641 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-4dst7" podStartSLOduration=1.984881554 podStartE2EDuration="3.222624002s" totalImagesPullingTime="1.237742448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:32.221638881 +0000 UTC m=+254.296133418" watchObservedRunningTime="2026-06-05 11:41:32.222624002 +0000 UTC m=+254.297118523" Jun 05 11:41:32.247905 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.247844 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbfkh" podStartSLOduration=252.381168886 podStartE2EDuration="4m13.247819078s" totalImagesPullingTime="866.650192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:32.247393959 +0000 UTC m=+254.321888478" watchObservedRunningTime="2026-06-05 11:41:32.247819078 +0000 UTC m=+254.322313597" Jun 05 11:41:32.326877 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.326771 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:32.386970 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.386939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:32.797971 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.797892 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:32.868461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.868432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:32.927211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:32.927175 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:33.203690 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:33.203659 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:33.253121 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:33.253089 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:41.082176 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:41.082139 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:41.545092 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:41.545010 2574 patch_prober.go:28] interesting pod/image-registry-858bfd5f6d-vrwcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:41:41.545092 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:41.545077 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:41:41.925107 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:41.925074 2574 patch_prober.go:28] interesting pod/image-registry-86f4ccdb6b-sfwqj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:41:41.925277 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:41.925131 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:41:42.812603 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:42.812567 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:42.913612 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:42.913577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:43.113548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:43.113471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:43.159893 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:43.159861 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:43.173589 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:43.173560 2574 patch_prober.go:28] interesting pod/image-registry-86f4ccdb6b-sfwqj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:41:43.173735 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:43.173623 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:41:43.912503 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:43.912470 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.058697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.058667 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.148076 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.148043 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.152047 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.152004 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54"] Jun 05 11:41:44.156569 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.156547 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.159030 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.159001 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 11:41:44.159030 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.159018 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 11:41:44.159288 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.159169 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 11:41:44.159288 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.159268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 11:41:44.160074 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.160054 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zfqk7\"" Jun 05 11:41:44.160176 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.160146 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 11:41:44.166888 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.166866 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54"] Jun 05 11:41:44.183816 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.183779 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vqqlf"] Jun 05 11:41:44.187014 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.186986 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.189271 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.189246 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 11:41:44.189518 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.189502 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kf7xw\"" Jun 05 11:41:44.189712 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.189696 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 11:41:44.189767 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.189736 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 11:41:44.198014 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.197991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4xgg\" (UniqueName: \"kubernetes.io/projected/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-kube-api-access-q4xgg\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.198125 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.198051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.198125 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.198089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.198125 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.198109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.220585 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.220553 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.298995 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.298949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.298995 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvc4\" (UniqueName: \"kubernetes.io/projected/5445fbe3-d806-44e4-a072-928330f49957-kube-api-access-6wvc4\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.299304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.299304 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299272 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445fbe3-d806-44e4-a072-928330f49957-metrics-client-ca\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299465 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299310 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-wtmp\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299465 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-sys\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299465 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-tls\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299465 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-root\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4xgg\" (UniqueName: \"kubernetes.io/projected/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-kube-api-access-q4xgg\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.299630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-textfile\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299630 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.299922 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.299904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.301640 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.301620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.301764 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.301621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.307516 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.307471 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4xgg\" (UniqueName: \"kubernetes.io/projected/c3c22107-ac2b-4c48-8ef2-0e6899776ba9-kube-api-access-q4xgg\") pod \"openshift-state-metrics-65f78d5c66-wxj54\" (UID: \"c3c22107-ac2b-4c48-8ef2-0e6899776ba9\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.320871 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.320837 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.400913 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.400872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-wtmp\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.400913 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.400910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-sys\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.400935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-tls\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-sys\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401013 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-root\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401067 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-textfile\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-wtmp\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvc4\" (UniqueName: \"kubernetes.io/projected/5445fbe3-d806-44e4-a072-928330f49957-kube-api-access-6wvc4\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445fbe3-d806-44e4-a072-928330f49957-metrics-client-ca\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5445fbe3-d806-44e4-a072-928330f49957-root\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401454 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-textfile\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401775 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401758 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5445fbe3-d806-44e4-a072-928330f49957-metrics-client-ca\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.401860 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.401771 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.403379 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.403351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-tls\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.403379 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.403372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5445fbe3-d806-44e4-a072-928330f49957-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.408578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.408557 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvc4\" (UniqueName: \"kubernetes.io/projected/5445fbe3-d806-44e4-a072-928330f49957-kube-api-access-6wvc4\") pod \"node-exporter-vqqlf\" (UID: \"5445fbe3-d806-44e4-a072-928330f49957\") " pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.421267 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.421140 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.467202 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.467152 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" Jun 05 11:41:44.496167 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.496137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqqlf" Jun 05 11:41:44.507601 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:44.507574 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5445fbe3_d806_44e4_a072_928330f49957.slice/crio-6afc6e1328ef8dd6b2a361b5dd2b9c4d4d4671b42d22e0012b66fa8f6f3fc542 WatchSource:0}: Error finding container 6afc6e1328ef8dd6b2a361b5dd2b9c4d4d4671b42d22e0012b66fa8f6f3fc542: Status 404 returned error can't find the container with id 6afc6e1328ef8dd6b2a361b5dd2b9c4d4d4671b42d22e0012b66fa8f6f3fc542 Jun 05 11:41:44.525843 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.525792 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.601044 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.600931 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54"] Jun 05 11:41:44.603459 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.603429 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:44.603597 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:44.603511 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c22107_ac2b_4c48_8ef2_0e6899776ba9.slice/crio-c8e9567de02562838f7475ed1e8476db1336436468f6a3df3f1c951a5556dc26 WatchSource:0}: Error finding container c8e9567de02562838f7475ed1e8476db1336436468f6a3df3f1c951a5556dc26: Status 404 returned error can't find the container with id c8e9567de02562838f7475ed1e8476db1336436468f6a3df3f1c951a5556dc26 Jun 05 11:41:44.698006 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:44.697978 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:45.153897 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.153860 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:45.236627 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.236583 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:45.240828 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.240721 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:41:45.246110 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.246077 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.248558 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.248523 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 11:41:45.248558 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.248551 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 11:41:45.248769 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.248585 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ftj5x\"" Jun 05 11:41:45.248847 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.248833 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 11:41:45.248910 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.248871 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 11:41:45.248977 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.248954 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 11:41:45.249087 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.249070 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 11:41:45.249147 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.249072 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 11:41:45.249445 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.249426 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 11:41:45.249650 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.249539 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 11:41:45.255316 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.255279 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" event={"ID":"c3c22107-ac2b-4c48-8ef2-0e6899776ba9","Type":"ContainerStarted","Data":"aed5c5acae403abb3cb4ef96574f0b221e0f602f893e0930c4c5c5c9bb46ff56"} Jun 05 11:41:45.255468 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.255359 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" event={"ID":"c3c22107-ac2b-4c48-8ef2-0e6899776ba9","Type":"ContainerStarted","Data":"4fc5b288c8e802b22a2e739235a3af1e42559bc17458d6ad662bfa57a74f97da"} Jun 05 11:41:45.255468 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.255389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" event={"ID":"c3c22107-ac2b-4c48-8ef2-0e6899776ba9","Type":"ContainerStarted","Data":"c8e9567de02562838f7475ed1e8476db1336436468f6a3df3f1c951a5556dc26"} Jun 05 11:41:45.259793 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.259719 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqqlf" event={"ID":"5445fbe3-d806-44e4-a072-928330f49957","Type":"ContainerStarted","Data":"6afc6e1328ef8dd6b2a361b5dd2b9c4d4d4671b42d22e0012b66fa8f6f3fc542"} Jun 05 11:41:45.260924 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.260897 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:41:45.310498 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.310687 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-out\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.310687 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4dzh\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-kube-api-access-s4dzh\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.310687 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.310687 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-web-config\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.310687 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.310687 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.311036 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.311036 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.311036 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.311036 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.311036 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.311036 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.310984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.411661 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411584 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-web-config\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.411661 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.411918 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411664 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.411918 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.411918 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.411918 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411914 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411946 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.411975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412062 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-out\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412103 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4dzh\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-kube-api-access-s4dzh\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412382 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412382 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412950 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.412950 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.412891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.413396 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:45.413370 2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 05 11:41:45.413543 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:45.413518 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls podName:6f47b3cc-7e60-4245-9334-c0d812bdb8e2 nodeName:}" failed. No retries permitted until 2026-06-05 11:41:45.91349657 +0000 UTC m=+267.987991097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2") : secret "alertmanager-main-tls" not found Jun 05 11:41:45.414832 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.414767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.415441 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.415373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-web-config\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.415823 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.415783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.415952 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.415915 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.416186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.416166 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.416390 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.416369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.416435 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.416406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.417151 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.417126 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-out\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.422306 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.422280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4dzh\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-kube-api-access-s4dzh\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.671847 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.671696 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:45.916484 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.916450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:45.918931 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:45.918900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:46.160103 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.160054 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:41:46.265545 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.265508 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" event={"ID":"c3c22107-ac2b-4c48-8ef2-0e6899776ba9","Type":"ContainerStarted","Data":"48f873d3c165a3be073c9fbdfd8ce3afa14426842830b130fe6a4a84d3339cce"} Jun 05 11:41:46.267282 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.267258 2574 generic.go:356] "Generic (PLEG): container finished" podID="5445fbe3-d806-44e4-a072-928330f49957" containerID="228d4061a4f2e3832cae886e896b829d5769c661316254d60298bb583dd7cf34" exitCode=0 Jun 05 11:41:46.267430 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.267309 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqqlf" event={"ID":"5445fbe3-d806-44e4-a072-928330f49957","Type":"ContainerDied","Data":"228d4061a4f2e3832cae886e896b829d5769c661316254d60298bb583dd7cf34"} Jun 05 11:41:46.282710 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.282663 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxj54" podStartSLOduration=1.4160792340000001 podStartE2EDuration="2.282648548s" totalImagesPullingTime="866.569314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:46.281973321 +0000 UTC m=+268.356467856" watchObservedRunningTime="2026-06-05 11:41:46.282648548 +0000 UTC m=+268.357143069" Jun 05 11:41:46.292685 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.292535 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:41:46.305084 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:46.305054 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f47b3cc_7e60_4245_9334_c0d812bdb8e2.slice/crio-e2f51182dcd75221041d05a97a81df139adff29b661c763fbe539f90d8bc9190 WatchSource:0}: Error finding container e2f51182dcd75221041d05a97a81df139adff29b661c763fbe539f90d8bc9190: Status 404 returned error can't find the container with id e2f51182dcd75221041d05a97a81df139adff29b661c763fbe539f90d8bc9190 Jun 05 11:41:46.566318 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.566279 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" containerName="registry" containerID="cri-o://a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9" gracePeriod=30 Jun 05 11:41:46.762471 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.762432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:46.823127 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.823061 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:46.845717 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.845677 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:46.924689 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.924651 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-image-registry-private-configuration\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.924873 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.924722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-bound-sa-token\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.924873 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.924756 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-installation-pull-secrets\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.925008 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.924931 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/885a9c96-f457-40b8-9aad-4a94455e9353-ca-trust-extracted\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.925008 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.924965 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pbp7\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-kube-api-access-5pbp7\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.925008 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.924996 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-registry-certificates\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.925153 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.925030 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.925153 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.925059 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-trusted-ca\") pod \"885a9c96-f457-40b8-9aad-4a94455e9353\" (UID: \"885a9c96-f457-40b8-9aad-4a94455e9353\") " Jun 05 11:41:46.926126 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.925442 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:41:46.926126 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.925689 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:41:46.927896 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.927630 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:41:46.927896 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.927639 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:41:46.927896 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.927763 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:41:46.928145 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.928113 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:41:46.928218 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.928157 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-kube-api-access-5pbp7" (OuterVolumeSpecName: "kube-api-access-5pbp7") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "kube-api-access-5pbp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:41:46.936029 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:46.935997 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/885a9c96-f457-40b8-9aad-4a94455e9353-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "885a9c96-f457-40b8-9aad-4a94455e9353" (UID: "885a9c96-f457-40b8-9aad-4a94455e9353"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:41:47.026370 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026338 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/885a9c96-f457-40b8-9aad-4a94455e9353-ca-trust-extracted\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026370 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026364 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pbp7\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-kube-api-access-5pbp7\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026370 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026373 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-registry-certificates\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026370 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026382 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-registry-tls\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026390 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/885a9c96-f457-40b8-9aad-4a94455e9353-trusted-ca\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026398 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-image-registry-private-configuration\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026407 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/885a9c96-f457-40b8-9aad-4a94455e9353-bound-sa-token\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.026729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.026415 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/885a9c96-f457-40b8-9aad-4a94455e9353-installation-pull-secrets\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:41:47.103231 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.103122 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:47.139167 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.139024 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-854fd99655-wvn52"] Jun 05 11:41:47.139397 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.139380 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" containerName="registry" Jun 05 11:41:47.139477 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.139402 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" containerName="registry" Jun 05 11:41:47.139477 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.139458 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" containerName="registry" Jun 05 11:41:47.144226 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.144200 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.146848 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.146822 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 11:41:47.146987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.146877 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 11:41:47.146987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.146890 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 11:41:47.146987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.146821 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 11:41:47.147375 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.147350 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 11:41:47.147497 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.147375 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qt8rn\"" Jun 05 11:41:47.147497 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.147451 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ani8bitb7stea\"" Jun 05 11:41:47.159358 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.159322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-854fd99655-wvn52"] Jun 05 11:41:47.176180 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.176145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:47.228644 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.228884 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vhlp\" (UniqueName: \"kubernetes.io/projected/a26b92a7-b310-488b-94ee-0079a9ade432-kube-api-access-7vhlp\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.228884 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-grpc-tls\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.228884 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.229026 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-tls\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.229026 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.229026 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.228977 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.229026 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.229002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b92a7-b310-488b-94ee-0079a9ade432-metrics-client-ca\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.272299 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.272264 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"e2f51182dcd75221041d05a97a81df139adff29b661c763fbe539f90d8bc9190"} Jun 05 11:41:47.273414 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.273384 2574 generic.go:356] "Generic (PLEG): container finished" podID="885a9c96-f457-40b8-9aad-4a94455e9353" containerID="a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9" exitCode=0 Jun 05 11:41:47.273601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.273440 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" Jun 05 11:41:47.273601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.273457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" event={"ID":"885a9c96-f457-40b8-9aad-4a94455e9353","Type":"ContainerDied","Data":"a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9"} Jun 05 11:41:47.273601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.273497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858bfd5f6d-vrwcx" event={"ID":"885a9c96-f457-40b8-9aad-4a94455e9353","Type":"ContainerDied","Data":"da2d1f1935890d9e88e8957f308fccb068dd7faac154a7d5c287b8da20fa63f4"} Jun 05 11:41:47.273601 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.273517 2574 scope.go:117] "RemoveContainer" containerID="a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9" Jun 05 11:41:47.275713 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.275682 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqqlf" event={"ID":"5445fbe3-d806-44e4-a072-928330f49957","Type":"ContainerStarted","Data":"2bb9acd12ef5c9b5f651a0756202f82cfb010bf14eae5225e0557156a62026d1"} Jun 05 11:41:47.275825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.275741 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqqlf" event={"ID":"5445fbe3-d806-44e4-a072-928330f49957","Type":"ContainerStarted","Data":"61ca03d9de4533ff8f1a249449a265a0267dc4854b7bea29680a35ee04bc79e0"} Jun 05 11:41:47.281813 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.281776 2574 scope.go:117] "RemoveContainer" containerID="a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9" Jun 05 11:41:47.282244 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:47.282216 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9\": container with ID starting with a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9 not found: ID does not exist" containerID="a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9" Jun 05 11:41:47.282341 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.282253 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9"} err="failed to get container status \"a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9\": rpc error: code = NotFound desc = could not find container \"a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9\": container with ID starting with a4257bf4c77f3143cae203a6f10a162f4f241a46cbd4f23acbd9f4197c6ff8c9 not found: ID does not exist" Jun 05 11:41:47.294422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.294369 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vqqlf" podStartSLOduration=2.181764015 podStartE2EDuration="3.294351133s" totalImagesPullingTime="1.045067021s" totalInitContainerRuntime="67.520097ms" isStatefulPod=true podCreationTimestamp="2026-06-05 11:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:47.293734669 +0000 UTC m=+269.368229191" watchObservedRunningTime="2026-06-05 11:41:47.294351133 +0000 UTC m=+269.368845654" Jun 05 11:41:47.308885 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.308778 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858bfd5f6d-vrwcx"] Jun 05 11:41:47.314011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.313983 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-858bfd5f6d-vrwcx"] Jun 05 11:41:47.329705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.329563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vhlp\" (UniqueName: \"kubernetes.io/projected/a26b92a7-b310-488b-94ee-0079a9ade432-kube-api-access-7vhlp\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.329705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.329688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-grpc-tls\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.329858 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.329725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.329858 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.329779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-tls\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.330303 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.330274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.330406 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.330361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.330406 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.330396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b92a7-b310-488b-94ee-0079a9ade432-metrics-client-ca\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.330518 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.330471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.331426 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.331402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a26b92a7-b310-488b-94ee-0079a9ade432-metrics-client-ca\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.333030 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.333003 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-grpc-tls\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.333432 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.333406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.333584 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.333559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.333680 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.333588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.333974 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.333953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-tls\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.334045 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.334016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a26b92a7-b310-488b-94ee-0079a9ade432-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.337678 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.337655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vhlp\" (UniqueName: \"kubernetes.io/projected/a26b92a7-b310-488b-94ee-0079a9ade432-kube-api-access-7vhlp\") pod \"thanos-querier-854fd99655-wvn52\" (UID: \"a26b92a7-b310-488b-94ee-0079a9ade432\") " pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.349774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.349748 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:47.423567 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.423538 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:47.457720 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.457683 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:47.589968 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:47.589927 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-854fd99655-wvn52"] Jun 05 11:41:47.593311 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:47.593277 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26b92a7_b310_488b_94ee_0079a9ade432.slice/crio-4634165c279fc536d75742195b27a649416302181b73dd0cf9b164bf359e2966 WatchSource:0}: Error finding container 4634165c279fc536d75742195b27a649416302181b73dd0cf9b164bf359e2966: Status 404 returned error can't find the container with id 4634165c279fc536d75742195b27a649416302181b73dd0cf9b164bf359e2966 Jun 05 11:41:48.280581 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.280545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"4634165c279fc536d75742195b27a649416302181b73dd0cf9b164bf359e2966"} Jun 05 11:41:48.282653 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.282624 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6" exitCode=0 Jun 05 11:41:48.282746 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.282721 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6"} Jun 05 11:41:48.422048 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.422007 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="885a9c96-f457-40b8-9aad-4a94455e9353" path="/var/lib/kubelet/pods/885a9c96-f457-40b8-9aad-4a94455e9353/volumes" Jun 05 11:41:48.939507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.939473 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w"] Jun 05 11:41:48.939685 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.939595 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:48.943285 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.943245 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:48.945613 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.945587 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 11:41:48.945613 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.945609 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5gkk9\"" Jun 05 11:41:48.951653 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.951620 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w"] Jun 05 11:41:48.980586 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.980547 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869dbb9c64-f92sj"] Jun 05 11:41:48.984239 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.984208 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:48.987039 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.986829 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 11:41:48.987039 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.986890 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 11:41:48.987039 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.986937 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 11:41:48.987374 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.987147 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 11:41:48.987374 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.987176 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 11:41:48.987374 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.987184 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ftfb8\"" Jun 05 11:41:48.987540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.987445 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 11:41:48.987540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:48.987515 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 11:41:49.004510 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.003303 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869dbb9c64-f92sj"] Jun 05 11:41:49.004510 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.003995 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 11:41:49.006225 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.006190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:49.045705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0459ee-d7d6-4709-b475-cedc1fe89074-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.045705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-console-config\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.045945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftrh4\" (UniqueName: \"kubernetes.io/projected/50b0c465-93bd-4c7f-b8fc-16993660a618-kube-api-access-ftrh4\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.045945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-oauth-config\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.045945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-trusted-ca-bundle\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.045945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-oauth-serving-cert\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.045945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-serving-cert\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.046161 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.045959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xssm7\" (UniqueName: \"kubernetes.io/projected/9a0459ee-d7d6-4709-b475-cedc1fe89074-kube-api-access-xssm7\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.046161 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.046021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-service-ca\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147237 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftrh4\" (UniqueName: \"kubernetes.io/projected/50b0c465-93bd-4c7f-b8fc-16993660a618-kube-api-access-ftrh4\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147428 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-oauth-config\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147496 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147439 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-trusted-ca-bundle\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147556 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-oauth-serving-cert\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147556 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-serving-cert\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147657 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147577 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xssm7\" (UniqueName: \"kubernetes.io/projected/9a0459ee-d7d6-4709-b475-cedc1fe89074-kube-api-access-xssm7\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.147657 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-service-ca\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147755 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147680 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0459ee-d7d6-4709-b475-cedc1fe89074-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.147755 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.147705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-console-config\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.147979 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:49.147955 2574 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 11:41:49.148053 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:49.148036 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0459ee-d7d6-4709-b475-cedc1fe89074-monitoring-plugin-cert podName:9a0459ee-d7d6-4709-b475-cedc1fe89074 nodeName:}" failed. No retries permitted until 2026-06-05 11:41:49.648016976 +0000 UTC m=+271.722511481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9a0459ee-d7d6-4709-b475-cedc1fe89074-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-rlh6w" (UID: "9a0459ee-d7d6-4709-b475-cedc1fe89074") : secret "monitoring-plugin-cert" not found Jun 05 11:41:49.148349 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.148323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-oauth-serving-cert\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.148440 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.148373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-service-ca\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.148506 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.148447 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-console-config\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.148558 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.148521 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-trusted-ca-bundle\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.150302 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.150279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-serving-cert\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.150516 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.150498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-oauth-config\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.156076 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.156044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xssm7\" (UniqueName: \"kubernetes.io/projected/9a0459ee-d7d6-4709-b475-cedc1fe89074-kube-api-access-xssm7\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.156076 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.156075 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftrh4\" (UniqueName: \"kubernetes.io/projected/50b0c465-93bd-4c7f-b8fc-16993660a618-kube-api-access-ftrh4\") pod \"console-869dbb9c64-f92sj\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.303918 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.303878 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:49.367273 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.367237 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:49.653471 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.653376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0459ee-d7d6-4709-b475-cedc1fe89074-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.656421 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.656392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9a0459ee-d7d6-4709-b475-cedc1fe89074-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-rlh6w\" (UID: \"9a0459ee-d7d6-4709-b475-cedc1fe89074\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.857347 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.857138 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:49.917892 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:49.917859 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869dbb9c64-f92sj"] Jun 05 11:41:49.920750 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:49.920704 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b0c465_93bd_4c7f_b8fc_16993660a618.slice/crio-4108b512d8fc2bd487d059d0a83b3f7e173b2c47e55f59192d929c97ffb414d6 WatchSource:0}: Error finding container 4108b512d8fc2bd487d059d0a83b3f7e173b2c47e55f59192d929c97ffb414d6: Status 404 returned error can't find the container with id 4108b512d8fc2bd487d059d0a83b3f7e173b2c47e55f59192d929c97ffb414d6 Jun 05 11:41:50.034355 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.034281 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w"] Jun 05 11:41:50.042177 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:50.042126 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0459ee_d7d6_4709_b475_cedc1fe89074.slice/crio-4101db00a41323a5a874a6a9e9557de1f915c1896a634a7896871783113de85a WatchSource:0}: Error finding container 4101db00a41323a5a874a6a9e9557de1f915c1896a634a7896871783113de85a: Status 404 returned error can't find the container with id 4101db00a41323a5a874a6a9e9557de1f915c1896a634a7896871783113de85a Jun 05 11:41:50.293303 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.293216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"557f622ae582560ab00157e3b492f3a52a8376d338dc779fadc6405789db2fb0"} Jun 05 11:41:50.293469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.293310 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"8ae031e21a39c346b50e736fadc5682d5497bce215364e49b20eb979936a6ae9"} Jun 05 11:41:50.293469 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.293350 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"6225aaf2382938535c200553f011ff55fa89e445958e2d7cf27e9cd9dd29a88d"} Jun 05 11:41:50.294599 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.294564 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" event={"ID":"9a0459ee-d7d6-4709-b475-cedc1fe89074","Type":"ContainerStarted","Data":"4101db00a41323a5a874a6a9e9557de1f915c1896a634a7896871783113de85a"} Jun 05 11:41:50.298436 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.298406 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd"} Jun 05 11:41:50.298557 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.298487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0"} Jun 05 11:41:50.298557 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.298532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869"} Jun 05 11:41:50.298668 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.298570 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd"} Jun 05 11:41:50.298668 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.298609 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2"} Jun 05 11:41:50.299785 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.299738 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869dbb9c64-f92sj" event={"ID":"50b0c465-93bd-4c7f-b8fc-16993660a618","Type":"ContainerStarted","Data":"4108b512d8fc2bd487d059d0a83b3f7e173b2c47e55f59192d929c97ffb414d6"} Jun 05 11:41:50.351284 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.351235 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:50.358874 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.358837 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:41:50.363451 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.363419 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.366010 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.365983 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z548d\"" Jun 05 11:41:50.366155 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.366139 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 11:41:50.366222 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.366212 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 11:41:50.366451 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.366411 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 11:41:50.366575 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.366453 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etoqn99pkale9\"" Jun 05 11:41:50.366774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.366674 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 11:41:50.366916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.366898 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 11:41:50.367052 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367034 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 11:41:50.367117 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367035 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 11:41:50.367737 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367510 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 11:41:50.367737 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367527 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 11:41:50.367737 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367550 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 11:41:50.367963 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367781 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 11:41:50.367963 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367840 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 11:41:50.367963 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.367857 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 11:41:50.368189 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.368170 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 11:41:50.370512 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.370489 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 11:41:50.380211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.380176 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:41:50.449259 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.449228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:50.461466 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461519 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461636 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461762 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461831 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrdv\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-kube-api-access-lqrdv\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.461983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.462298 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.461984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.462298 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.462021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.462298 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.462063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.462298 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.462098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.462298 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.462145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.462298 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.462225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.545639 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.545546 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562882 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562907 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.562963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrdv\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-kube-api-access-lqrdv\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563116 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563258 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.563825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.564753 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.563336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.564753 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.564104 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.565373 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.565280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.565373 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.565325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.570303 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.565396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.572046 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.571520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.572046 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.571656 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.572046 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.571885 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.573275 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.572702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.573398 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.573343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.574122 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.574074 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.574738 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.574664 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.590256 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.590223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.590848 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.590819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrdv\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-kube-api-access-lqrdv\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.593460 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.592901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.593460 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.593403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.593635 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.593466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.593635 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.593520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.593635 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.593538 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.594936 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.594188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.594936 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.594910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.595079 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.595049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.597524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.597466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:50.675769 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:50.675721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:51.004451 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:51.004423 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:41:51.307987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:51.307909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"e74c0bc8cd38db218e84886283135f74973e840d51864a46f9bf25c0a0c99edc"} Jun 05 11:41:51.312169 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:51.312094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerStarted","Data":"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91"} Jun 05 11:41:51.339151 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:51.339065 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.057926292 podStartE2EDuration="6.339047487s" totalImagesPullingTime="3.264348801s" totalInitContainerRuntime="16.772394ms" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:51.336604337 +0000 UTC m=+273.411098860" watchObservedRunningTime="2026-06-05 11:41:51.339047487 +0000 UTC m=+273.413542007" Jun 05 11:41:51.400686 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:41:51.400645 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20f24e1_2bd9_4865_a710_8d81ad978e6b.slice/crio-4ccdd7f84080721737db9af8578c162456c85ac9331803c23bb2d455e9ba595c WatchSource:0}: Error finding container 4ccdd7f84080721737db9af8578c162456c85ac9331803c23bb2d455e9ba595c: Status 404 returned error can't find the container with id 4ccdd7f84080721737db9af8578c162456c85ac9331803c23bb2d455e9ba595c Jun 05 11:41:51.925048 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:51.925000 2574 patch_prober.go:28] interesting pod/image-registry-86f4ccdb6b-sfwqj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:41:51.925255 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:51.925066 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:41:52.319223 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.319102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" event={"ID":"9a0459ee-d7d6-4709-b475-cedc1fe89074","Type":"ContainerStarted","Data":"51f356c31b161b6c7b3746b7f45d6a57c5fd190aa5032be8b8fc06e4fab59cc2"} Jun 05 11:41:52.319223 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.319185 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:52.323993 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.323956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"52bbd8fba9bfcc535232fd0804a46565ab8f3cd621f734b2fe74f09c3868576e"} Jun 05 11:41:52.324175 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.324041 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" event={"ID":"a26b92a7-b310-488b-94ee-0079a9ade432","Type":"ContainerStarted","Data":"85ec131710b8b2dc78bedee862b6d48b212daa27bdb906cd4e67a7154d7f5228"} Jun 05 11:41:52.324175 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.324128 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:52.325161 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.325111 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" Jun 05 11:41:52.326055 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.326029 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" exitCode=0 Jun 05 11:41:52.326162 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.326114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} Jun 05 11:41:52.326243 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.326212 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"4ccdd7f84080721737db9af8578c162456c85ac9331803c23bb2d455e9ba595c"} Jun 05 11:41:52.334220 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.334152 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-rlh6w" podStartSLOduration=2.924768229 podStartE2EDuration="4.334134371s" totalImagesPullingTime="1.409366142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:52.333723487 +0000 UTC m=+274.408218009" watchObservedRunningTime="2026-06-05 11:41:52.334134371 +0000 UTC m=+274.408628894" Jun 05 11:41:52.397856 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:52.397778 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" podStartSLOduration=2.360864288 podStartE2EDuration="5.397755397s" totalImagesPullingTime="3.036891109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:52.395191419 +0000 UTC m=+274.469685940" watchObservedRunningTime="2026-06-05 11:41:52.397755397 +0000 UTC m=+274.472249937" Jun 05 11:41:53.173721 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:53.173679 2574 patch_prober.go:28] interesting pod/image-registry-86f4ccdb6b-sfwqj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:41:53.174177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:53.173754 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:41:53.333119 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:53.333072 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869dbb9c64-f92sj" event={"ID":"50b0c465-93bd-4c7f-b8fc-16993660a618","Type":"ContainerStarted","Data":"ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17"} Jun 05 11:41:53.350611 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:53.350555 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869dbb9c64-f92sj" podStartSLOduration=2.489543763 podStartE2EDuration="5.350536514s" totalImagesPullingTime="2.860992751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:53.34883167 +0000 UTC m=+275.423326193" watchObservedRunningTime="2026-06-05 11:41:53.350536514 +0000 UTC m=+275.425031035" Jun 05 11:41:56.349786 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.349753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} Jun 05 11:41:56.350208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.349834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} Jun 05 11:41:56.350208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.349864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} Jun 05 11:41:56.350208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.349894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} Jun 05 11:41:56.350208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.349920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} Jun 05 11:41:56.350208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.349944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerStarted","Data":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} Jun 05 11:41:56.378007 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:56.377917 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.349151316 podStartE2EDuration="6.377895709s" totalImagesPullingTime="3.00099376s" totalInitContainerRuntime="27.750633ms" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:56.376586807 +0000 UTC m=+278.451081359" watchObservedRunningTime="2026-06-05 11:41:56.377895709 +0000 UTC m=+278.452390229" Jun 05 11:41:58.252227 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:58.252197 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:58.302475 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:58.302437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:58.339947 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:58.339921 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-854fd99655-wvn52" Jun 05 11:41:59.303979 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.303942 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:59.304419 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.304026 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:59.308934 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.308910 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:59.365107 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.365078 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:41:59.545930 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.545898 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:59.646114 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.646045 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:59.693216 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:41:59.693179 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:41:59.925060 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:41:59.924968 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dj7tz" podUID="3d01785c-b05f-4d1f-bf80-e06495018f32" Jun 05 11:42:00.159274 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:00.159243 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:00.208700 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:00.208618 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:00.365967 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:00.365939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dj7tz" Jun 05 11:42:00.676239 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:00.676196 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:01.924174 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:01.924140 2574 patch_prober.go:28] interesting pod/image-registry-86f4ccdb6b-sfwqj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:42:01.924600 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:01.924202 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:42:01.924600 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:01.924246 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:42:01.924787 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:01.924767 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"18c4b1fefc940f35f4729184ad1c771a5e7588ae07e1706fe976ad852d5e0432"} pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 11:42:01.928538 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:01.928505 2574 patch_prober.go:28] interesting pod/image-registry-86f4ccdb6b-sfwqj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 11:42:01.928663 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:01.928558 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 11:42:03.298013 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:03.297973 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:42:03.300408 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:03.300383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d01785c-b05f-4d1f-bf80-e06495018f32-metrics-tls\") pod \"dns-default-dj7tz\" (UID: \"3d01785c-b05f-4d1f-bf80-e06495018f32\") " pod="openshift-dns/dns-default-dj7tz" Jun 05 11:42:03.369612 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:03.369582 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k9md6\"" Jun 05 11:42:03.377866 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:03.377839 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dj7tz" Jun 05 11:42:03.520042 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:03.514719 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dj7tz"] Jun 05 11:42:04.383441 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:04.383399 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dj7tz" event={"ID":"3d01785c-b05f-4d1f-bf80-e06495018f32","Type":"ContainerStarted","Data":"a58b56c6680d2ea29ca85beee0396a379c2f103b25beef05d7ecdf90a51e6667"} Jun 05 11:42:05.389373 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:05.389339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dj7tz" event={"ID":"3d01785c-b05f-4d1f-bf80-e06495018f32","Type":"ContainerStarted","Data":"87ce73a02f91b4125c5a2c09f47a64af4af8da826fe24b6555b18aa91afdacbc"} Jun 05 11:42:05.389819 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:05.389387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dj7tz" event={"ID":"3d01785c-b05f-4d1f-bf80-e06495018f32","Type":"ContainerStarted","Data":"7d68b4442a593327dad5267dae4eeb80e006fb44ec89d5c9408f8a639c0cf992"} Jun 05 11:42:05.389819 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:05.389470 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dj7tz" Jun 05 11:42:05.406374 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:05.406322 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dj7tz" podStartSLOduration=250.848969918 podStartE2EDuration="4m12.406304165s" totalImagesPullingTime="1.557334247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:42:05.404551477 +0000 UTC m=+287.479045999" watchObservedRunningTime="2026-06-05 11:42:05.406304165 +0000 UTC m=+287.480798685" Jun 05 11:42:06.502693 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:06.502662 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:07.548705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:07.548670 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:07.649501 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:07.649464 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:10.020883 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:10.020828 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:10.067099 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:10.067067 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:11.929994 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:11.929962 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:42:12.054022 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:12.053985 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:12.154096 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:12.154066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:13.424629 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:13.424597 2574 generic.go:356] "Generic (PLEG): container finished" podID="7e951429-325b-4890-9d67-9436e1ae0f4f" containerID="c5e2858c8e29afed67e133fb829afbaec98aedc878536be644c8f86a28b926f6" exitCode=0 Jun 05 11:42:13.425045 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:13.424659 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nwlz8" event={"ID":"7e951429-325b-4890-9d67-9436e1ae0f4f","Type":"ContainerDied","Data":"c5e2858c8e29afed67e133fb829afbaec98aedc878536be644c8f86a28b926f6"} Jun 05 11:42:13.425087 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:13.425069 2574 scope.go:117] "RemoveContainer" containerID="c5e2858c8e29afed67e133fb829afbaec98aedc878536be644c8f86a28b926f6" Jun 05 11:42:14.373283 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:14.373251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dj7tz_3d01785c-b05f-4d1f-bf80-e06495018f32/dns/0.log" Jun 05 11:42:14.430279 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:14.430244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-nwlz8" event={"ID":"7e951429-325b-4890-9d67-9436e1ae0f4f","Type":"ContainerStarted","Data":"6525c9478aaee809f6cc85f4c077ac9844eab721363e2f89dc034de84ab3aa2c"} Jun 05 11:42:14.571684 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:14.571654 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dj7tz_3d01785c-b05f-4d1f-bf80-e06495018f32/kube-rbac-proxy/0.log" Jun 05 11:42:15.397012 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:15.396979 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dj7tz" Jun 05 11:42:15.971788 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:15.971761 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vk7ss_9543d026-5bb4-40b8-a75a-3e01b64ad205/dns-node-resolver/0.log" Jun 05 11:42:16.171540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:16.171514 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5c5d4965-2thf6_464cdb2a-4f2e-4411-a4f1-8ac88d62021b/router/0.log" Jun 05 11:42:16.414020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:16.413988 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:16.467376 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:16.467346 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:16.771178 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:16.771087 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zb52s_c797253a-99fe-4114-8ebe-c9a2ea31b2c8/serve-healthcheck-canary/0.log" Jun 05 11:42:17.740987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:17.740939 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:18.376593 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:18.376561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:42:18.376774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:18.376718 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:42:18.385363 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:18.385341 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 11:42:21.068335 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:21.068295 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:21.165261 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:21.165229 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:24.520020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:24.519979 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:24.621667 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:24.621632 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:25.484368 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:25.484330 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:25.539137 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:25.539097 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:26.945709 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:26.945640 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" podUID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerName="registry" containerID="cri-o://18c4b1fefc940f35f4729184ad1c771a5e7588ae07e1706fe976ad852d5e0432" gracePeriod=30 Jun 05 11:42:28.493590 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:28.493549 2574 generic.go:356] "Generic (PLEG): container finished" podID="7a077577-c19b-4180-85d5-f7cf91a9e9f1" containerID="18c4b1fefc940f35f4729184ad1c771a5e7588ae07e1706fe976ad852d5e0432" exitCode=0 Jun 05 11:42:28.493987 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:28.493614 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" event={"ID":"7a077577-c19b-4180-85d5-f7cf91a9e9f1","Type":"ContainerDied","Data":"18c4b1fefc940f35f4729184ad1c771a5e7588ae07e1706fe976ad852d5e0432"} Jun 05 11:42:29.500200 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:29.500164 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" event={"ID":"7a077577-c19b-4180-85d5-f7cf91a9e9f1","Type":"ContainerStarted","Data":"54ac14417db7bc1e14022aa6e18df9943a95083db8192061f5a6bf665371610b"} Jun 05 11:42:29.500623 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:29.500291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:42:29.658660 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:29.658622 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:29.759388 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:29.759303 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:31.133695 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:31.133663 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:31.235060 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:31.235028 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:31.291905 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:31.291871 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:39.924172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:39.924138 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:40.023946 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:40.023898 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:40.078362 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:40.078333 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:50.508142 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:50.508112 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86f4ccdb6b-sfwqj" Jun 05 11:42:50.676892 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:50.676851 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:50.685973 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:50.685928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:50.693592 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:50.693567 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:50.738913 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:50.738881 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:51.600501 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:51.600473 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:54.966869 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:54.966833 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:42:55.019422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:42:55.019394 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:03.345547 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:03.345452 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:03.777921 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:03.777840 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:04.391696 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.391663 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:43:04.392135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.391964 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="alertmanager" containerID="cri-o://0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2" gracePeriod=120 Jun 05 11:43:04.392135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.392040 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-metric" containerID="cri-o://b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd" gracePeriod=120 Jun 05 11:43:04.392135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.392076 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="config-reloader" containerID="cri-o://34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd" gracePeriod=120 Jun 05 11:43:04.392313 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.392112 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy" containerID="cri-o://c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0" gracePeriod=120 Jun 05 11:43:04.392313 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.392138 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="prom-label-proxy" containerID="cri-o://636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91" gracePeriod=120 Jun 05 11:43:04.392313 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.392059 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-web" containerID="cri-o://957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869" gracePeriod=120 Jun 05 11:43:04.645937 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.645847 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91" exitCode=0 Jun 05 11:43:04.645937 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.645871 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0" exitCode=0 Jun 05 11:43:04.645937 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.645882 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd" exitCode=0 Jun 05 11:43:04.645937 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.645890 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2" exitCode=0 Jun 05 11:43:04.645937 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.645922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91"} Jun 05 11:43:04.646205 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.646006 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0"} Jun 05 11:43:04.646205 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.646048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd"} Jun 05 11:43:04.646205 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:04.646087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2"} Jun 05 11:43:05.648917 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.648888 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:05.652297 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652264 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd" exitCode=0 Jun 05 11:43:05.652297 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652294 2574 generic.go:356] "Generic (PLEG): container finished" podID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerID="957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869" exitCode=0 Jun 05 11:43:05.652499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd"} Jun 05 11:43:05.652499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652356 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:05.652499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869"} Jun 05 11:43:05.652499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f47b3cc-7e60-4245-9334-c0d812bdb8e2","Type":"ContainerDied","Data":"e2f51182dcd75221041d05a97a81df139adff29b661c763fbe539f90d8bc9190"} Jun 05 11:43:05.652499 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.652491 2574 scope.go:117] "RemoveContainer" containerID="636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91" Jun 05 11:43:05.660116 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.660099 2574 scope.go:117] "RemoveContainer" containerID="b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd" Jun 05 11:43:05.667368 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.667350 2574 scope.go:117] "RemoveContainer" containerID="c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0" Jun 05 11:43:05.676695 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.676660 2574 scope.go:117] "RemoveContainer" containerID="957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869" Jun 05 11:43:05.687561 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.687532 2574 scope.go:117] "RemoveContainer" containerID="34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd" Jun 05 11:43:05.697563 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.697537 2574 scope.go:117] "RemoveContainer" containerID="0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2" Jun 05 11:43:05.706278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.706245 2574 scope.go:117] "RemoveContainer" containerID="7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6" Jun 05 11:43:05.714326 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.714302 2574 scope.go:117] "RemoveContainer" containerID="636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91" Jun 05 11:43:05.714647 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.714629 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91\": container with ID starting with 636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91 not found: ID does not exist" containerID="636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91" Jun 05 11:43:05.714714 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.714655 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91"} err="failed to get container status \"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91\": rpc error: code = NotFound desc = could not find container \"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91\": container with ID starting with 636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91 not found: ID does not exist" Jun 05 11:43:05.714714 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.714672 2574 scope.go:117] "RemoveContainer" containerID="b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd" Jun 05 11:43:05.714997 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.714979 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd\": container with ID starting with b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd not found: ID does not exist" containerID="b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd" Jun 05 11:43:05.715059 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715005 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd"} err="failed to get container status \"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd\": rpc error: code = NotFound desc = could not find container \"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd\": container with ID starting with b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd not found: ID does not exist" Jun 05 11:43:05.715059 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715021 2574 scope.go:117] "RemoveContainer" containerID="c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0" Jun 05 11:43:05.715293 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.715272 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0\": container with ID starting with c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0 not found: ID does not exist" containerID="c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0" Jun 05 11:43:05.715354 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715300 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0"} err="failed to get container status \"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0\": rpc error: code = NotFound desc = could not find container \"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0\": container with ID starting with c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0 not found: ID does not exist" Jun 05 11:43:05.715354 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715323 2574 scope.go:117] "RemoveContainer" containerID="957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869" Jun 05 11:43:05.715551 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.715534 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869\": container with ID starting with 957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869 not found: ID does not exist" containerID="957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869" Jun 05 11:43:05.715609 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715555 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869"} err="failed to get container status \"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869\": rpc error: code = NotFound desc = could not find container \"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869\": container with ID starting with 957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869 not found: ID does not exist" Jun 05 11:43:05.715609 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715571 2574 scope.go:117] "RemoveContainer" containerID="34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd" Jun 05 11:43:05.715783 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.715768 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd\": container with ID starting with 34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd not found: ID does not exist" containerID="34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd" Jun 05 11:43:05.715920 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715786 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd"} err="failed to get container status \"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd\": rpc error: code = NotFound desc = could not find container \"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd\": container with ID starting with 34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd not found: ID does not exist" Jun 05 11:43:05.715920 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.715798 2574 scope.go:117] "RemoveContainer" containerID="0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2" Jun 05 11:43:05.716064 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.716046 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2\": container with ID starting with 0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2 not found: ID does not exist" containerID="0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2" Jun 05 11:43:05.716122 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716067 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2"} err="failed to get container status \"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2\": rpc error: code = NotFound desc = could not find container \"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2\": container with ID starting with 0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2 not found: ID does not exist" Jun 05 11:43:05.716122 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716082 2574 scope.go:117] "RemoveContainer" containerID="7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6" Jun 05 11:43:05.716313 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:05.716297 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6\": container with ID starting with 7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6 not found: ID does not exist" containerID="7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6" Jun 05 11:43:05.716373 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716316 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6"} err="failed to get container status \"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6\": rpc error: code = NotFound desc = could not find container \"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6\": container with ID starting with 7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6 not found: ID does not exist" Jun 05 11:43:05.716373 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716329 2574 scope.go:117] "RemoveContainer" containerID="636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91" Jun 05 11:43:05.716507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716488 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91"} err="failed to get container status \"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91\": rpc error: code = NotFound desc = could not find container \"636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91\": container with ID starting with 636298cea3d2f06f9cf20cee41398a737bd7c3c01a1f9ab8ae66f59999e30c91 not found: ID does not exist" Jun 05 11:43:05.716567 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716507 2574 scope.go:117] "RemoveContainer" containerID="b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd" Jun 05 11:43:05.716738 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716721 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd"} err="failed to get container status \"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd\": rpc error: code = NotFound desc = could not find container \"b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd\": container with ID starting with b508d516c90a930ba745d9e2bd77638a2f5abac224b37be254b4b06c508c13dd not found: ID does not exist" Jun 05 11:43:05.716882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716738 2574 scope.go:117] "RemoveContainer" containerID="c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0" Jun 05 11:43:05.716983 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716964 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0"} err="failed to get container status \"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0\": rpc error: code = NotFound desc = could not find container \"c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0\": container with ID starting with c2841b20d9fbc8873202c78aa26315844a4f6edcf3c5b211e070de3283c73ad0 not found: ID does not exist" Jun 05 11:43:05.717043 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.716982 2574 scope.go:117] "RemoveContainer" containerID="957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869" Jun 05 11:43:05.717215 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717197 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869"} err="failed to get container status \"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869\": rpc error: code = NotFound desc = could not find container \"957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869\": container with ID starting with 957af2b18724e4f62b986c8c374495509159bebf4ed97044ca5d780c44767869 not found: ID does not exist" Jun 05 11:43:05.717275 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717215 2574 scope.go:117] "RemoveContainer" containerID="34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd" Jun 05 11:43:05.717412 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717396 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd"} err="failed to get container status \"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd\": rpc error: code = NotFound desc = could not find container \"34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd\": container with ID starting with 34fee0c5aa60a93095d2aaaab759ad35a83b827a33fc3245d061b654c3cd43cd not found: ID does not exist" Jun 05 11:43:05.717481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717412 2574 scope.go:117] "RemoveContainer" containerID="0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2" Jun 05 11:43:05.717685 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717609 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2"} err="failed to get container status \"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2\": rpc error: code = NotFound desc = could not find container \"0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2\": container with ID starting with 0d0b2eff3b954f47c471e2bec0b9cf0e2e4ac9b5b6ec6eb2d9dd37b2bb015ce2 not found: ID does not exist" Jun 05 11:43:05.717685 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717623 2574 scope.go:117] "RemoveContainer" containerID="7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6" Jun 05 11:43:05.717913 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.717890 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6"} err="failed to get container status \"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6\": rpc error: code = NotFound desc = could not find container \"7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6\": container with ID starting with 7fc00fc29cc9238953896d3ac157ebaa3ed38e88ac15b6e462dac465a7f089e6 not found: ID does not exist" Jun 05 11:43:05.744358 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744320 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-out\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744525 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744369 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-metrics-client-ca\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744525 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744400 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744525 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744421 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-cluster-tls-config\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744557 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-main-db\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744614 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-web\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744644 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744845 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744680 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4dzh\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-kube-api-access-s4dzh\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744845 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744736 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-web-config\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.744845 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744776 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-trusted-ca-bundle\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.745012 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744876 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:05.745012 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744910 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:43:05.745124 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.744815 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-volume\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.745177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.745136 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.745238 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.745191 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-tls-assets\") pod \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\" (UID: \"6f47b3cc-7e60-4245-9334-c0d812bdb8e2\") " Jun 05 11:43:05.745575 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.745552 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-metrics-client-ca\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.745575 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.745563 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:05.745748 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.745579 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-main-db\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.747691 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.747649 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-out" (OuterVolumeSpecName: "config-out") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:43:05.748057 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.748028 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.748269 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.748240 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-volume" (OuterVolumeSpecName: "config-volume") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.748487 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.748450 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.748487 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.748467 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-kube-api-access-s4dzh" (OuterVolumeSpecName: "kube-api-access-s4dzh") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "kube-api-access-s4dzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:43:05.748716 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.748695 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.749165 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.749134 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.749272 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.749212 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:43:05.752097 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.752071 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.759549 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.759516 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-web-config" (OuterVolumeSpecName: "web-config") pod "6f47b3cc-7e60-4245-9334-c0d812bdb8e2" (UID: "6f47b3cc-7e60-4245-9334-c0d812bdb8e2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:05.846548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846491 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-web-config\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846538 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846549 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-volume\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846557 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846566 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-tls-assets\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846548 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846574 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-config-out\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846582 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-main-tls\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846591 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-cluster-tls-config\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846601 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846609 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.846916 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.846618 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4dzh\" (UniqueName: \"kubernetes.io/projected/6f47b3cc-7e60-4245-9334-c0d812bdb8e2-kube-api-access-s4dzh\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:05.975730 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.975686 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:43:05.983560 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:05.981073 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:43:06.004024 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.003988 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:43:06.004335 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004321 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-web" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004337 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-web" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004345 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="prom-label-proxy" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004351 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="prom-label-proxy" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004364 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004370 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004377 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-metric" Jun 05 11:43:06.004381 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004383 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-metric" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004390 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="init-config-reloader" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004395 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="init-config-reloader" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004400 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="config-reloader" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004405 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="config-reloader" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004414 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="alertmanager" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004419 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="alertmanager" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004465 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-web" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004473 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004480 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="alertmanager" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004486 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="kube-rbac-proxy-metric" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004492 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="config-reloader" Jun 05 11:43:06.004577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.004497 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" containerName="prom-label-proxy" Jun 05 11:43:06.009733 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.009705 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.012285 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.012262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 11:43:06.012415 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.012374 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ftj5x\"" Jun 05 11:43:06.012485 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.012469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 11:43:06.012593 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.012571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 11:43:06.012725 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.012704 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 11:43:06.012793 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.012708 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 11:43:06.013141 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.013126 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 11:43:06.013301 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.013285 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 11:43:06.013384 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.013326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 11:43:06.017398 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.017372 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 11:43:06.021888 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.021861 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:43:06.047464 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047424 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047637 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047637 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047637 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a11ce5-e735-42c6-baa7-d2526cff7c07-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047738 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqnrm\" (UniqueName: \"kubernetes.io/projected/c2a11ce5-e735-42c6-baa7-d2526cff7c07-kube-api-access-fqnrm\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047738 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047738 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-web-config\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047738 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047879 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2a11ce5-e735-42c6-baa7-d2526cff7c07-config-out\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047879 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2a11ce5-e735-42c6-baa7-d2526cff7c07-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047879 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047879 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2a11ce5-e735-42c6-baa7-d2526cff7c07-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.047879 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.047869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a11ce5-e735-42c6-baa7-d2526cff7c07-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.148816 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.148776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqnrm\" (UniqueName: \"kubernetes.io/projected/c2a11ce5-e735-42c6-baa7-d2526cff7c07-kube-api-access-fqnrm\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.148958 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.148842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.148958 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.148860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-web-config\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.148958 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.148880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149113 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2a11ce5-e735-42c6-baa7-d2526cff7c07-config-out\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149113 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2a11ce5-e735-42c6-baa7-d2526cff7c07-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149218 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149218 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2a11ce5-e735-42c6-baa7-d2526cff7c07-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149218 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a11ce5-e735-42c6-baa7-d2526cff7c07-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149360 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149361 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.149461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.149393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a11ce5-e735-42c6-baa7-d2526cff7c07-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.150430 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.150401 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2a11ce5-e735-42c6-baa7-d2526cff7c07-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.151971 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.151821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2a11ce5-e735-42c6-baa7-d2526cff7c07-config-out\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152102 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.151991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2a11ce5-e735-42c6-baa7-d2526cff7c07-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-web-config\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152204 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2a11ce5-e735-42c6-baa7-d2526cff7c07-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152434 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.152700 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.152682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2a11ce5-e735-42c6-baa7-d2526cff7c07-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.153100 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.153078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.153941 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.153922 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2a11ce5-e735-42c6-baa7-d2526cff7c07-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.157140 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.157116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqnrm\" (UniqueName: \"kubernetes.io/projected/c2a11ce5-e735-42c6-baa7-d2526cff7c07-kube-api-access-fqnrm\") pod \"alertmanager-main-0\" (UID: \"c2a11ce5-e735-42c6-baa7-d2526cff7c07\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.321911 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.321859 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 11:43:06.422400 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.422369 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f47b3cc-7e60-4245-9334-c0d812bdb8e2" path="/var/lib/kubelet/pods/6f47b3cc-7e60-4245-9334-c0d812bdb8e2/volumes" Jun 05 11:43:06.464642 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.464612 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 11:43:06.467277 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:43:06.467248 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a11ce5_e735_42c6_baa7_d2526cff7c07.slice/crio-6908ec261eb246b9362018d9308e61e5b33bf401d4bd2119097e4e4136d1c3d2 WatchSource:0}: Error finding container 6908ec261eb246b9362018d9308e61e5b33bf401d4bd2119097e4e4136d1c3d2: Status 404 returned error can't find the container with id 6908ec261eb246b9362018d9308e61e5b33bf401d4bd2119097e4e4136d1c3d2 Jun 05 11:43:06.658174 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.658083 2574 generic.go:356] "Generic (PLEG): container finished" podID="c2a11ce5-e735-42c6-baa7-d2526cff7c07" containerID="01531d9758e40293679bd0e06d826267031e8340de7b8d95860ae30083ce4666" exitCode=0 Jun 05 11:43:06.658598 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.658171 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerDied","Data":"01531d9758e40293679bd0e06d826267031e8340de7b8d95860ae30083ce4666"} Jun 05 11:43:06.658598 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:06.658254 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"6908ec261eb246b9362018d9308e61e5b33bf401d4bd2119097e4e4136d1c3d2"} Jun 05 11:43:07.666825 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.666775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"99a8712e01141d79d514bbb409f99914d3450d5e6e891f0cd5150c78391747fc"} Jun 05 11:43:07.667221 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.666856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"f7264ce1cca224ac649764e4827fd2ae2940dbe8861dba521c9b41eb48a32a58"} Jun 05 11:43:07.667221 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.666896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"36874bbde0419eea6f2f31d62685a372a5eeb1f9eb9859592889c201275556b1"} Jun 05 11:43:07.667221 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.666927 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"b25f4238724f781245bdd218171c030a3aa11b5c916789f10a9df49da7e02c28"} Jun 05 11:43:07.667221 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.666951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"20558e512797742a6c9458ff3e4654fe87f874a8acbff1fd3533b2f354123854"} Jun 05 11:43:07.667221 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.666988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2a11ce5-e735-42c6-baa7-d2526cff7c07","Type":"ContainerStarted","Data":"afb4f057851ae5fd2d8a8e7e9e437d0429c612bc73d285f412cfd192be82f226"} Jun 05 11:43:07.691821 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:07.691752 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6767685390000002 podStartE2EDuration="2.691735789s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.96725ms" isStatefulPod=false podCreationTimestamp="2026-06-05 11:43:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:43:07.689188906 +0000 UTC m=+349.763683427" watchObservedRunningTime="2026-06-05 11:43:07.691735789 +0000 UTC m=+349.766230314" Jun 05 11:43:08.707329 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707291 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:43:08.707747 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707602 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="prometheus" containerID="cri-o://d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" gracePeriod=600 Jun 05 11:43:08.707747 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707635 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy" containerID="cri-o://f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" gracePeriod=600 Jun 05 11:43:08.707747 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707672 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="thanos-sidecar" containerID="cri-o://93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" gracePeriod=600 Jun 05 11:43:08.707747 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707672 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-web" containerID="cri-o://961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" gracePeriod=600 Jun 05 11:43:08.707747 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707680 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="config-reloader" containerID="cri-o://3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" gracePeriod=600 Jun 05 11:43:08.708015 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.707776 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" gracePeriod=600 Jun 05 11:43:08.963182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.963108 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:08.976065 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976030 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-tls\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976075 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-kubelet-serving-ca-bundle\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976100 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-1\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976116 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976150 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-trusted-ca-bundle\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976182 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976171 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqrdv\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-kube-api-access-lqrdv\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976195 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-metrics-client-ca\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976217 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-grpc-tls\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976242 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976277 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-thanos-prometheus-http-client-file\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976305 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config-out\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976334 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-kube-rbac-proxy\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976358 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-db\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976386 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-0\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976421 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-web-config\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976450 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-2\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976481 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-metrics-client-certs\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.976488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976473 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976509 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-tls-assets\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976510 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976538 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976591 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-serving-certs-ca-bundle\") pod \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\" (UID: \"c20f24e1-2bd9-4865-a710-8d81ad978e6b\") " Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976639 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976854 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976867 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976888 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:08.977134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.976904 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:08.977553 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.977204 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.977553 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.977426 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.979289 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.979256 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:08.979289 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.979279 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.979595 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.979568 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.980020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.979996 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:43:08.980020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.979892 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:43:08.980189 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.979592 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config" (OuterVolumeSpecName: "config") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.980404 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.980379 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config-out" (OuterVolumeSpecName: "config-out") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:43:08.980967 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.980932 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.981151 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.981133 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-kube-api-access-lqrdv" (OuterVolumeSpecName: "kube-api-access-lqrdv") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "kube-api-access-lqrdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:43:08.981362 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.981340 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.981427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.981365 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.981871 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.981852 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.982534 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.982516 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:08.992509 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:08.992469 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-web-config" (OuterVolumeSpecName: "web-config") pod "c20f24e1-2bd9-4865-a710-8d81ad978e6b" (UID: "c20f24e1-2bd9-4865-a710-8d81ad978e6b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:09.077985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.077936 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-tls-assets\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.077985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.077965 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.077985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.077976 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.077985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.077988 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.077985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.077997 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078006 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqrdv\" (UniqueName: \"kubernetes.io/projected/c20f24e1-2bd9-4865-a710-8d81ad978e6b-kube-api-access-lqrdv\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078014 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-configmap-metrics-client-ca\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078022 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-grpc-tls\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078030 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078038 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078047 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-config-out\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078055 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-kube-rbac-proxy\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078063 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-db\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078070 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078078 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-web-config\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078088 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c20f24e1-2bd9-4865-a710-8d81ad978e6b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.078278 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.078095 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c20f24e1-2bd9-4865-a710-8d81ad978e6b-secret-metrics-client-certs\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:09.679203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679166 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" exitCode=0 Jun 05 11:43:09.679203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679192 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" exitCode=0 Jun 05 11:43:09.679203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679200 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" exitCode=0 Jun 05 11:43:09.679203 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679219 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" exitCode=0 Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679225 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" exitCode=0 Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679232 2574 generic.go:356] "Generic (PLEG): container finished" podID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" exitCode=0 Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679263 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679312 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679364 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679379 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679414 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} Jun 05 11:43:09.679577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.679437 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c20f24e1-2bd9-4865-a710-8d81ad978e6b","Type":"ContainerDied","Data":"4ccdd7f84080721737db9af8578c162456c85ac9331803c23bb2d455e9ba595c"} Jun 05 11:43:09.687456 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.687436 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.694928 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.694906 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.702412 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.702380 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:43:09.703172 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.703154 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.706400 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.706376 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:43:09.711349 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.711211 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.719134 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.719115 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.729550 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729521 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:43:09.729921 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729905 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="prometheus" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729923 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="prometheus" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729945 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-thanos" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729953 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-thanos" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729966 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-web" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729976 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-web" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729991 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy" Jun 05 11:43:09.730011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.729999 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730022 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="init-config-reloader" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730030 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="init-config-reloader" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730040 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="thanos-sidecar" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730048 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="thanos-sidecar" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730061 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="config-reloader" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730068 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="config-reloader" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730141 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-web" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730153 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="thanos-sidecar" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730164 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy-thanos" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730173 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="kube-rbac-proxy" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730181 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="config-reloader" Jun 05 11:43:09.730361 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.730192 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" containerName="prometheus" Jun 05 11:43:09.735775 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.735752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.737008 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.736986 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.738862 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738722 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 11:43:09.738862 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738754 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 11:43:09.738862 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738767 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 11:43:09.738862 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738722 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 11:43:09.738862 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738726 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 11:43:09.739162 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738866 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 11:43:09.739162 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.738917 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-etoqn99pkale9\"" Jun 05 11:43:09.739362 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739325 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 11:43:09.739362 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739354 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 11:43:09.739481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739396 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 11:43:09.739481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739430 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 11:43:09.739481 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739325 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 11:43:09.739724 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739707 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 11:43:09.739850 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.739832 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 11:43:09.740120 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.740088 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z548d\"" Jun 05 11:43:09.741185 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.741165 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 11:43:09.743728 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.743708 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 11:43:09.749962 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.749936 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.750345 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.750316 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.750432 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.750357 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} err="failed to get container status \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" Jun 05 11:43:09.750432 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.750381 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.750694 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.750673 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.750771 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.750704 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} err="failed to get container status \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" Jun 05 11:43:09.750771 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.750726 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.750958 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.750934 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:43:09.756888 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.751594 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.756888 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.751632 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} err="failed to get container status \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" Jun 05 11:43:09.756888 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.751677 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.757323 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.757286 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.757431 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.757332 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} err="failed to get container status \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" Jun 05 11:43:09.757431 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.757355 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.757753 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.757730 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.757976 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.757762 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} err="failed to get container status \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" Jun 05 11:43:09.757976 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.757778 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.758083 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.758071 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.758118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758091 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} err="failed to get container status \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" Jun 05 11:43:09.758118 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758104 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.758365 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:09.758350 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.758401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758368 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} err="failed to get container status \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" Jun 05 11:43:09.758401 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758380 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.758628 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758606 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} err="failed to get container status \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" Jun 05 11:43:09.758685 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758631 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.758920 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758902 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} err="failed to get container status \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" Jun 05 11:43:09.758970 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.758921 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.759135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759119 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} err="failed to get container status \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" Jun 05 11:43:09.759135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759134 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.759345 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759330 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} err="failed to get container status \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" Jun 05 11:43:09.759393 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759346 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.759541 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759525 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} err="failed to get container status \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" Jun 05 11:43:09.759541 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759540 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.759757 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759733 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} err="failed to get container status \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" Jun 05 11:43:09.759757 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759748 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.759992 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759973 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} err="failed to get container status \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" Jun 05 11:43:09.759992 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.759991 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.760200 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760183 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} err="failed to get container status \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" Jun 05 11:43:09.760241 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760200 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.760427 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760399 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} err="failed to get container status \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" Jun 05 11:43:09.760500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760428 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.760663 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760645 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} err="failed to get container status \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" Jun 05 11:43:09.760709 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760664 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.760883 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760866 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} err="failed to get container status \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" Jun 05 11:43:09.760934 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.760883 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.761108 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761092 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} err="failed to get container status \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" Jun 05 11:43:09.761148 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761109 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.761327 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761310 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} err="failed to get container status \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" Jun 05 11:43:09.761365 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761327 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.761540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761522 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} err="failed to get container status \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" Jun 05 11:43:09.761578 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761541 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.761729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761711 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} err="failed to get container status \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" Jun 05 11:43:09.761780 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761729 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.761914 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761899 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} err="failed to get container status \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" Jun 05 11:43:09.761959 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.761914 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.762089 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762073 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} err="failed to get container status \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" Jun 05 11:43:09.762126 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762090 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.762276 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762262 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} err="failed to get container status \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" Jun 05 11:43:09.762323 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762276 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.762445 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762430 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} err="failed to get container status \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" Jun 05 11:43:09.762492 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762445 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.762635 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762620 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} err="failed to get container status \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" Jun 05 11:43:09.762635 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762634 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.762826 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762792 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} err="failed to get container status \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" Jun 05 11:43:09.762875 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762826 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.762992 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762978 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} err="failed to get container status \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" Jun 05 11:43:09.763034 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.762992 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.763154 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763139 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} err="failed to get container status \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" Jun 05 11:43:09.763196 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763154 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.763333 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763318 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} err="failed to get container status \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" Jun 05 11:43:09.763372 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763332 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.763511 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763495 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} err="failed to get container status \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" Jun 05 11:43:09.763556 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763511 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.763681 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763661 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} err="failed to get container status \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" Jun 05 11:43:09.763745 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763682 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.763909 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763891 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} err="failed to get container status \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" Jun 05 11:43:09.763957 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.763910 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.764078 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764063 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} err="failed to get container status \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" Jun 05 11:43:09.764128 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764078 2574 scope.go:117] "RemoveContainer" containerID="bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa" Jun 05 11:43:09.764224 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764210 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa"} err="failed to get container status \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": rpc error: code = NotFound desc = could not find container \"bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa\": container with ID starting with bf9d6f326f15e752f62d113c08957292c5fff01ecad29755df2d057bab3e17fa not found: ID does not exist" Jun 05 11:43:09.764271 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764225 2574 scope.go:117] "RemoveContainer" containerID="f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076" Jun 05 11:43:09.764424 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764405 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076"} err="failed to get container status \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": rpc error: code = NotFound desc = could not find container \"f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076\": container with ID starting with f49ca51b483582c17b4ab91ad5ed764298b51d9ea5be2575c172034a94d62076 not found: ID does not exist" Jun 05 11:43:09.764488 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764426 2574 scope.go:117] "RemoveContainer" containerID="961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560" Jun 05 11:43:09.764633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764612 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560"} err="failed to get container status \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": rpc error: code = NotFound desc = could not find container \"961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560\": container with ID starting with 961129e177fda257803f0f501af92a3ef0513a3ecf0d9dc3915d68e38f3d9560 not found: ID does not exist" Jun 05 11:43:09.764674 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764633 2574 scope.go:117] "RemoveContainer" containerID="93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2" Jun 05 11:43:09.764856 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764835 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2"} err="failed to get container status \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": rpc error: code = NotFound desc = could not find container \"93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2\": container with ID starting with 93afca6d8e9777ece7c6c47cd2c6c67db2cb195857a78588d09744690005bef2 not found: ID does not exist" Jun 05 11:43:09.764938 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.764857 2574 scope.go:117] "RemoveContainer" containerID="3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c" Jun 05 11:43:09.765080 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.765063 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c"} err="failed to get container status \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": rpc error: code = NotFound desc = could not find container \"3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c\": container with ID starting with 3b57c2117ddda3f32827386b3d0b09786a85dad67b2305fc169771b31a6b305c not found: ID does not exist" Jun 05 11:43:09.765130 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.765081 2574 scope.go:117] "RemoveContainer" containerID="d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c" Jun 05 11:43:09.765265 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.765247 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c"} err="failed to get container status \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": rpc error: code = NotFound desc = could not find container \"d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c\": container with ID starting with d5efbbbe9b5fe571df2fa36ce0a49dc352cb1cec0d1103e33cb0021d9aca927c not found: ID does not exist" Jun 05 11:43:09.765325 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.765267 2574 scope.go:117] "RemoveContainer" containerID="3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941" Jun 05 11:43:09.765477 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.765460 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941"} err="failed to get container status \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": rpc error: code = NotFound desc = could not find container \"3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941\": container with ID starting with 3f6250b560dee3180b1cca3dc54d31a46d59e9989778d36f46d15a3c6ca32941 not found: ID does not exist" Jun 05 11:43:09.784828 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.784764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.784843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-config-out\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.784871 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.784896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wdn\" (UniqueName: \"kubernetes.io/projected/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-kube-api-access-79wdn\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.784984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-config\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785024 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-web-config\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785177 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785159 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785304 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785353 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785543 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785543 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.785543 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.785418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886056 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886056 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886059 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886311 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886311 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886311 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886311 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886205 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886311 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886232 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-config-out\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886353 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wdn\" (UniqueName: \"kubernetes.io/projected/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-kube-api-access-79wdn\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-config\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-web-config\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886620 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.886889 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.887235 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.886965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.887235 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.887172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.887235 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.887197 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.887641 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.887614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.889297 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.889271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-config-out\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.889705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.889409 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.889705 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.889478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.889984 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.889959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-web-config\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.890697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.890179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.890697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.890287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.890697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.890610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-config\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.890697 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.890657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.890951 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.890939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.891377 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.891355 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.891776 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.891757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.892222 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.892199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.892422 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.892402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.892634 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.892617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.896400 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.896377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wdn\" (UniqueName: \"kubernetes.io/projected/acf4dfe7-e9be-4f18-aeaa-fab0373d6255-kube-api-access-79wdn\") pod \"prometheus-k8s-0\" (UID: \"acf4dfe7-e9be-4f18-aeaa-fab0373d6255\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:09.967610 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:09.967528 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:10.051941 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.051894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:10.091028 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.090989 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:10.195413 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.195390 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:43:10.197812 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:43:10.197781 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf4dfe7_e9be_4f18_aeaa_fab0373d6255.slice/crio-de4bcaf54d7d8a3365b4b53a7147a06cb7e00a063c1ead840fd063806952e294 WatchSource:0}: Error finding container de4bcaf54d7d8a3365b4b53a7147a06cb7e00a063c1ead840fd063806952e294: Status 404 returned error can't find the container with id de4bcaf54d7d8a3365b4b53a7147a06cb7e00a063c1ead840fd063806952e294 Jun 05 11:43:10.421666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.421631 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c20f24e1-2bd9-4865-a710-8d81ad978e6b" path="/var/lib/kubelet/pods/c20f24e1-2bd9-4865-a710-8d81ad978e6b/volumes" Jun 05 11:43:10.686674 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.686646 2574 generic.go:356] "Generic (PLEG): container finished" podID="acf4dfe7-e9be-4f18-aeaa-fab0373d6255" containerID="a795cafea160f138c47d8b3c95c78aef4955e8a591f8fdca40e75a4bd880e292" exitCode=0 Jun 05 11:43:10.686880 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.686681 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerDied","Data":"a795cafea160f138c47d8b3c95c78aef4955e8a591f8fdca40e75a4bd880e292"} Jun 05 11:43:10.686880 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:10.686733 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"de4bcaf54d7d8a3365b4b53a7147a06cb7e00a063c1ead840fd063806952e294"} Jun 05 11:43:11.694822 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.694761 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"d760ffb244d2d96c4af46b3dfd7e4e8109fb731bc9d36eb164d3c7c59f52c94a"} Jun 05 11:43:11.695292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.694867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"1cc2e559d0bf575b609ac3544da0dbea905301b9ef491ce2f7e7d37ffebf39e8"} Jun 05 11:43:11.695292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.694909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"f011bccd045d6149e586c60d6d0f0834e60013155e092b710f5f9ac580249f66"} Jun 05 11:43:11.695292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.694942 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"3acddcf30bc5b5f9f7be8e2c7bf3036da54542ac34fb833999785afa071f7878"} Jun 05 11:43:11.695292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.694971 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"4fa2858ce2ac1b077da4559a11d6a62fa3891d5f4c248c49b764002705083542"} Jun 05 11:43:11.695292 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.694999 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"acf4dfe7-e9be-4f18-aeaa-fab0373d6255","Type":"ContainerStarted","Data":"19e1a67c46f92a4d5d00e6d2349e71f6bc2435b16e3a3c0878c36fb6ff1d15b3"} Jun 05 11:43:11.721781 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:11.721718 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.70451199 podStartE2EDuration="2.721699557s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.187567ms" isStatefulPod=false podCreationTimestamp="2026-06-05 11:43:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:43:11.719143512 +0000 UTC m=+353.793638085" watchObservedRunningTime="2026-06-05 11:43:11.721699557 +0000 UTC m=+353.796194100" Jun 05 11:43:14.031543 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:14.031493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:14.089126 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:14.089093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:14.178472 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:14.178433 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:14.773335 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:14.773294 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:14.875442 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:14.875406 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:15.052020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:15.051993 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:17.761500 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:17.761448 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:17.814078 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:17.814041 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:18.483935 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:18.483896 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:25.118910 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:25.118866 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869dbb9c64-f92sj"] Jun 05 11:43:25.222326 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:25.222289 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:25.277537 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:25.277498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:25.329441 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:25.329389 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:44.390821 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:44.390752 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:44.445287 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:44.445257 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:43:50.140729 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.140662 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-869dbb9c64-f92sj" podUID="50b0c465-93bd-4c7f-b8fc-16993660a618" containerName="console" containerID="cri-o://ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17" gracePeriod=15 Jun 05 11:43:50.397858 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.397763 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:43:50.553985 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.553949 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-trusted-ca-bundle\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.553999 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftrh4\" (UniqueName: \"kubernetes.io/projected/50b0c465-93bd-4c7f-b8fc-16993660a618-kube-api-access-ftrh4\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554021 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-console-config\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554037 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-oauth-config\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554096 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-serving-cert\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554123 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-oauth-serving-cert\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554186 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554180 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-service-ca\") pod \"50b0c465-93bd-4c7f-b8fc-16993660a618\" (UID: \"50b0c465-93bd-4c7f-b8fc-16993660a618\") " Jun 05 11:43:50.554563 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554538 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-console-config" (OuterVolumeSpecName: "console-config") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:50.554563 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554548 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:50.554656 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554610 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:50.554694 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.554671 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-service-ca" (OuterVolumeSpecName: "service-ca") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:43:50.556404 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.556374 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:50.556507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.556409 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:43:50.556507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.556423 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50b0c465-93bd-4c7f-b8fc-16993660a618-kube-api-access-ftrh4" (OuterVolumeSpecName: "kube-api-access-ftrh4") pod "50b0c465-93bd-4c7f-b8fc-16993660a618" (UID: "50b0c465-93bd-4c7f-b8fc-16993660a618"). InnerVolumeSpecName "kube-api-access-ftrh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655638 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-serving-cert\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655671 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-oauth-serving-cert\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655684 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-service-ca\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655695 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-trusted-ca-bundle\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655706 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftrh4\" (UniqueName: \"kubernetes.io/projected/50b0c465-93bd-4c7f-b8fc-16993660a618-kube-api-access-ftrh4\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655718 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/50b0c465-93bd-4c7f-b8fc-16993660a618-console-config\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.655743 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.655731 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/50b0c465-93bd-4c7f-b8fc-16993660a618-console-oauth-config\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:43:50.855540 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.855500 2574 generic.go:356] "Generic (PLEG): container finished" podID="50b0c465-93bd-4c7f-b8fc-16993660a618" containerID="ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17" exitCode=0 Jun 05 11:43:50.855732 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.855572 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869dbb9c64-f92sj" Jun 05 11:43:50.855732 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.855587 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869dbb9c64-f92sj" event={"ID":"50b0c465-93bd-4c7f-b8fc-16993660a618","Type":"ContainerDied","Data":"ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17"} Jun 05 11:43:50.855732 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.855666 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869dbb9c64-f92sj" event={"ID":"50b0c465-93bd-4c7f-b8fc-16993660a618","Type":"ContainerDied","Data":"4108b512d8fc2bd487d059d0a83b3f7e173b2c47e55f59192d929c97ffb414d6"} Jun 05 11:43:50.855732 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.855686 2574 scope.go:117] "RemoveContainer" containerID="ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17" Jun 05 11:43:50.865594 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.865575 2574 scope.go:117] "RemoveContainer" containerID="ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17" Jun 05 11:43:50.865925 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:43:50.865905 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17\": container with ID starting with ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17 not found: ID does not exist" containerID="ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17" Jun 05 11:43:50.865992 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.865934 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17"} err="failed to get container status \"ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17\": rpc error: code = NotFound desc = could not find container \"ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17\": container with ID starting with ec6edb34ac3547aa9a5ac5f131e6618743f58ef9548e1f1d67c622d68e50bf17 not found: ID does not exist" Jun 05 11:43:50.877208 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.877183 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869dbb9c64-f92sj"] Jun 05 11:43:50.880213 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:50.880187 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869dbb9c64-f92sj"] Jun 05 11:43:52.421200 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:43:52.421163 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50b0c465-93bd-4c7f-b8fc-16993660a618" path="/var/lib/kubelet/pods/50b0c465-93bd-4c7f-b8fc-16993660a618/volumes" Jun 05 11:44:10.052486 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:10.052446 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:44:10.068377 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:10.068347 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:44:10.958563 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:10.958528 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:44:18.538564 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:18.538525 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:18.640099 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:18.640004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:19.390867 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:19.390831 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:19.439999 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:19.439960 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:19.699577 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:19.699481 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:19.754655 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:19.754621 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:20.315691 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:20.315658 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:20.365927 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:20.365899 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:30.417539 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:30.417418 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:30.524000 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:30.523962 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:30.616507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:30.616471 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:39.971933 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:39.971895 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:40.072625 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:40.072593 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:40.275579 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:40.275498 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:44:40.376244 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:44:40.376213 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:45:22.169104 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:45:22.169057 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:45:57.511581 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:45:57.511500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:46:30.476648 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:46:30.476617 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:46:30.765383 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:46:30.765298 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:18.414224 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:18.414190 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:47:18.416050 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:18.416022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:47:23.398135 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:23.398101 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:24.292707 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:24.292668 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:29.549120 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:29.549031 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:29.647592 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:29.647558 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:50.846443 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:50.846393 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:52.195421 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:52.195384 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:54.448507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:54.448469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:54.509346 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:54.509316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:56.884409 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:56.884378 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:56.986922 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:56.986884 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:59.048583 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:59.048548 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:47:59.100797 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:47:59.100766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:00.190792 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:00.190757 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:00.785579 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:00.785544 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:06.727322 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:06.727285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:06.827665 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:06.827632 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:08.596523 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:08.596492 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:17.685068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:17.685028 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:17.826798 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:17.826760 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:17.879507 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:17.879473 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:18.426482 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:18.426445 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:18.480624 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:18.480590 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:19.414106 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:19.414067 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:19.507622 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:19.507586 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:28.409545 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:28.409516 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:28.461157 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:28.461125 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:28.516739 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:28.516703 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:29.787363 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:29.787326 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:29.886724 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:29.886688 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:40.809760 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:40.809726 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:42.527242 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:42.527201 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:47.222823 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:47.222776 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:48:47.324071 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:48:47.324030 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:05.009815 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:05.009775 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:05.113377 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:05.113347 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:07.757572 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:07.757539 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:07.970848 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:07.970797 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:11.662432 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:11.662395 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:29.789617 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:29.789576 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:29.844060 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:29.844033 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:49:29.960613 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:49:29.960577 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:51:02.775854 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.775739 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l79tm/must-gather-8jlcs"] Jun 05 11:51:02.776448 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.776085 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b0c465-93bd-4c7f-b8fc-16993660a618" containerName="console" Jun 05 11:51:02.776448 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.776096 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b0c465-93bd-4c7f-b8fc-16993660a618" containerName="console" Jun 05 11:51:02.776448 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.776160 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="50b0c465-93bd-4c7f-b8fc-16993660a618" containerName="console" Jun 05 11:51:02.779305 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.779279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:02.781754 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.781730 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l79tm\"/\"openshift-service-ca.crt\"" Jun 05 11:51:02.782638 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.782620 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l79tm\"/\"default-dockercfg-r2hsb\"" Jun 05 11:51:02.782735 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.782662 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l79tm\"/\"kube-root-ca.crt\"" Jun 05 11:51:02.791115 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.791081 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l79tm/must-gather-8jlcs"] Jun 05 11:51:02.805060 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.805022 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:51:02.830263 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.830221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5slcg\" (UniqueName: \"kubernetes.io/projected/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-kube-api-access-5slcg\") pod \"must-gather-8jlcs\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:02.830458 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.830284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-must-gather-output\") pod \"must-gather-8jlcs\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:02.854236 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.854202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:51:02.931516 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.931484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5slcg\" (UniqueName: \"kubernetes.io/projected/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-kube-api-access-5slcg\") pod \"must-gather-8jlcs\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:02.931681 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.931540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-must-gather-output\") pod \"must-gather-8jlcs\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:02.931908 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.931889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-must-gather-output\") pod \"must-gather-8jlcs\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:02.939586 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:02.939560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5slcg\" (UniqueName: \"kubernetes.io/projected/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-kube-api-access-5slcg\") pod \"must-gather-8jlcs\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:03.107723 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:03.107680 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:51:03.237570 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:03.237542 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l79tm/must-gather-8jlcs"] Jun 05 11:51:03.240316 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:51:03.240287 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9f8b2e9_3ecc_496e_b4c8_365cf58c4060.slice/crio-c787fbc98fef7bb0f2411ec461e1cead491e632729678aed7b0ad1c4de795200 WatchSource:0}: Error finding container c787fbc98fef7bb0f2411ec461e1cead491e632729678aed7b0ad1c4de795200: Status 404 returned error can't find the container with id c787fbc98fef7bb0f2411ec461e1cead491e632729678aed7b0ad1c4de795200 Jun 05 11:51:03.242214 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:03.242199 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 11:51:03.589212 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:03.589179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l79tm/must-gather-8jlcs" event={"ID":"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060","Type":"ContainerStarted","Data":"c787fbc98fef7bb0f2411ec461e1cead491e632729678aed7b0ad1c4de795200"} Jun 05 11:51:09.621579 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:09.621520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l79tm/must-gather-8jlcs" event={"ID":"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060","Type":"ContainerStarted","Data":"90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17"} Jun 05 11:51:09.622115 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:09.621588 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l79tm/must-gather-8jlcs" event={"ID":"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060","Type":"ContainerStarted","Data":"aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8"} Jun 05 11:51:09.637425 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:09.637367 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l79tm/must-gather-8jlcs" podStartSLOduration=1.620471263 podStartE2EDuration="7.637349144s" totalImagesPullingTime="6.016877881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:51:09.636267555 +0000 UTC m=+831.710762096" watchObservedRunningTime="2026-06-05 11:51:09.637349144 +0000 UTC m=+831.711843665" Jun 05 11:51:56.842045 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:56.841994 2574 generic.go:356] "Generic (PLEG): container finished" podID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerID="aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8" exitCode=0 Jun 05 11:51:56.842567 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:56.842048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l79tm/must-gather-8jlcs" event={"ID":"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060","Type":"ContainerDied","Data":"aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8"} Jun 05 11:51:56.842567 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:56.842459 2574 scope.go:117] "RemoveContainer" containerID="aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8" Jun 05 11:51:57.708777 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:57.708676 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-l79tm_must-gather-8jlcs_b9f8b2e9-3ecc-496e-b4c8-365cf58c4060/gather/0.log" Jun 05 11:51:58.071517 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:58.071482 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:51:58.225536 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:58.225501 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:51:58.325594 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:51:58.325507 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:52:00.792020 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:00.791990 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2wm2q_4d05d6a3-14b1-472b-a433-1346cd4c59c6/global-pull-secret-syncer/0.log" Jun 05 11:52:00.909884 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:00.909853 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" Jun 05 11:52:01.030112 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:01.030074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-113.ec2.internal_bbdbf1b7c33db656b59a4aa42b0e098f/haproxy/0.log" Jun 05 11:52:03.048364 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.048327 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-l79tm/must-gather-8jlcs"] Jun 05 11:52:03.048923 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.048537 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-l79tm/must-gather-8jlcs" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="copy" containerID="cri-o://90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17" gracePeriod=2 Jun 05 11:52:03.050667 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:52:03.050633 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8jlcs\" is forbidden: User \"system:node:ip-10-0-140-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l79tm\": no relationship found between node 'ip-10-0-140-113.ec2.internal' and this object" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:52:03.051424 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.051402 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-l79tm/must-gather-8jlcs"] Jun 05 11:52:03.285179 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.285155 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-l79tm_must-gather-8jlcs_b9f8b2e9-3ecc-496e-b4c8-365cf58c4060/copy/0.log" Jun 05 11:52:03.287759 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.287742 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:52:03.289813 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:52:03.289773 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8jlcs\" is forbidden: User \"system:node:ip-10-0-140-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l79tm\": no relationship found between node 'ip-10-0-140-113.ec2.internal' and this object" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:52:03.400255 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.400218 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5slcg\" (UniqueName: \"kubernetes.io/projected/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-kube-api-access-5slcg\") pod \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " Jun 05 11:52:03.400448 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.400285 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-must-gather-output\") pod \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\" (UID: \"b9f8b2e9-3ecc-496e-b4c8-365cf58c4060\") " Jun 05 11:52:03.402428 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.402398 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-kube-api-access-5slcg" (OuterVolumeSpecName: "kube-api-access-5slcg") pod "b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" (UID: "b9f8b2e9-3ecc-496e-b4c8-365cf58c4060"). InnerVolumeSpecName "kube-api-access-5slcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:52:03.402645 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.402616 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" (UID: "b9f8b2e9-3ecc-496e-b4c8-365cf58c4060"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:52:03.501690 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.501641 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5slcg\" (UniqueName: \"kubernetes.io/projected/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-kube-api-access-5slcg\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:52:03.501690 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.501680 2574 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060-must-gather-output\") on node \"ip-10-0-140-113.ec2.internal\" DevicePath \"\"" Jun 05 11:52:03.548849 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.548780 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:52:03.651379 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.651285 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kjhcr_8e77f1e8-5dcb-4242-bbac-eea7a89026ce/konnectivity-agent/0.log" limit=1024 Jun 05 11:52:03.873001 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.872972 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-l79tm_must-gather-8jlcs_b9f8b2e9-3ecc-496e-b4c8-365cf58c4060/copy/0.log" Jun 05 11:52:03.873398 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.873375 2574 generic.go:356] "Generic (PLEG): container finished" podID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerID="90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17" exitCode=143 Jun 05 11:52:03.873462 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.873432 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:52:03.873523 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.873493 2574 scope.go:117] "RemoveContainer" containerID="90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17" Jun 05 11:52:03.875760 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:52:03.875723 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8jlcs\" is forbidden: User \"system:node:ip-10-0-140-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l79tm\": no relationship found between node 'ip-10-0-140-113.ec2.internal' and this object" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:52:03.881622 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.881603 2574 scope.go:117] "RemoveContainer" containerID="aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8" Jun 05 11:52:03.883293 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:52:03.883268 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8jlcs\" is forbidden: User \"system:node:ip-10-0-140-113.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l79tm\": no relationship found between node 'ip-10-0-140-113.ec2.internal' and this object" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" pod="openshift-must-gather-l79tm/must-gather-8jlcs" Jun 05 11:52:03.894259 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.894237 2574 scope.go:117] "RemoveContainer" containerID="90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17" Jun 05 11:52:03.894563 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:52:03.894539 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17\": container with ID starting with 90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17 not found: ID does not exist" containerID="90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17" Jun 05 11:52:03.894633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.894572 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17"} err="failed to get container status \"90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17\": rpc error: code = NotFound desc = could not find container \"90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17\": container with ID starting with 90a5ea3859a3870cf3321306025cbd557211308ec061b22d0abe57eeb6e4ab17 not found: ID does not exist" Jun 05 11:52:03.894633 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.894590 2574 scope.go:117] "RemoveContainer" containerID="aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8" Jun 05 11:52:03.894884 ip-10-0-140-113 kubenswrapper[2574]: E0605 11:52:03.894859 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8\": container with ID starting with aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8 not found: ID does not exist" containerID="aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8" Jun 05 11:52:03.894945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:03.894892 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8"} err="failed to get container status \"aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8\": rpc error: code = NotFound desc = could not find container \"aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8\": container with ID starting with aa32627ea4452e14107d5928d9711916c21c71d22f28f5413f8f28703e0ccbd8 not found: ID does not exist" Jun 05 11:52:04.421338 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:04.421306 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" path="/var/lib/kubelet/pods/b9f8b2e9-3ecc-496e-b4c8-365cf58c4060/volumes" Jun 05 11:52:04.906850 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:04.906792 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/alertmanager/0.log" Jun 05 11:52:04.929454 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:04.929418 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/config-reloader/0.log" Jun 05 11:52:04.951250 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:04.951209 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/kube-rbac-proxy-web/0.log" Jun 05 11:52:04.971598 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:04.971561 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/kube-rbac-proxy/0.log" Jun 05 11:52:04.992173 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:04.992144 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/kube-rbac-proxy-metric/0.log" Jun 05 11:52:05.022221 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.022194 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/prom-label-proxy/0.log" Jun 05 11:52:05.041959 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.041932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c2a11ce5-e735-42c6-baa7-d2526cff7c07/init-config-reloader/0.log" Jun 05 11:52:05.227011 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.226981 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-rlh6w_9a0459ee-d7d6-4709-b475-cedc1fe89074/monitoring-plugin/0.log" Jun 05 11:52:05.407461 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.407434 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqqlf_5445fbe3-d806-44e4-a072-928330f49957/node-exporter/0.log" Jun 05 11:52:05.425424 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.425339 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqqlf_5445fbe3-d806-44e4-a072-928330f49957/kube-rbac-proxy/0.log" Jun 05 11:52:05.444028 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.444007 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqqlf_5445fbe3-d806-44e4-a072-928330f49957/init-textfile/0.log" Jun 05 11:52:05.476573 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.476540 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wxj54_c3c22107-ac2b-4c48-8ef2-0e6899776ba9/kube-rbac-proxy-main/0.log" Jun 05 11:52:05.495290 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.495260 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wxj54_c3c22107-ac2b-4c48-8ef2-0e6899776ba9/kube-rbac-proxy-self/0.log" Jun 05 11:52:05.513956 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.513920 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wxj54_c3c22107-ac2b-4c48-8ef2-0e6899776ba9/openshift-state-metrics/0.log" Jun 05 11:52:05.555725 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.555695 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/prometheus/0.log" Jun 05 11:52:05.575996 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.575946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/config-reloader/0.log" Jun 05 11:52:05.600931 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.600903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/thanos-sidecar/0.log" Jun 05 11:52:05.619296 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.619268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/kube-rbac-proxy-web/0.log" Jun 05 11:52:05.641940 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.641909 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/kube-rbac-proxy/0.log" Jun 05 11:52:05.660621 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.660592 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/kube-rbac-proxy-thanos/0.log" Jun 05 11:52:05.680593 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.680511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_acf4dfe7-e9be-4f18-aeaa-fab0373d6255/init-config-reloader/0.log" Jun 05 11:52:05.750969 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.750944 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-4dst7_d8d68ea8-8d8a-4aa1-a6b8-896796c2e513/prometheus-operator-admission-webhook/0.log" Jun 05 11:52:05.861460 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.861425 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854fd99655-wvn52_a26b92a7-b310-488b-94ee-0079a9ade432/thanos-query/0.log" Jun 05 11:52:05.901844 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.901791 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854fd99655-wvn52_a26b92a7-b310-488b-94ee-0079a9ade432/kube-rbac-proxy-web/0.log" Jun 05 11:52:05.931653 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.931570 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854fd99655-wvn52_a26b92a7-b310-488b-94ee-0079a9ade432/kube-rbac-proxy/0.log" Jun 05 11:52:05.950882 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.950841 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854fd99655-wvn52_a26b92a7-b310-488b-94ee-0079a9ade432/prom-label-proxy/0.log" Jun 05 11:52:05.978068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:05.978032 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854fd99655-wvn52_a26b92a7-b310-488b-94ee-0079a9ade432/kube-rbac-proxy-rules/0.log" Jun 05 11:52:06.007625 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:06.007598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-854fd99655-wvn52_a26b92a7-b310-488b-94ee-0079a9ade432/kube-rbac-proxy-metrics/0.log" Jun 05 11:52:08.604945 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.604904 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms"] Jun 05 11:52:08.605524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.605397 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="copy" Jun 05 11:52:08.605524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.605415 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="copy" Jun 05 11:52:08.605524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.605434 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="gather" Jun 05 11:52:08.605524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.605443 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="gather" Jun 05 11:52:08.605524 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.605521 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="gather" Jun 05 11:52:08.605789 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.605535 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f8b2e9-3ecc-496e-b4c8-365cf58c4060" containerName="copy" Jun 05 11:52:08.610502 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.610476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.612681 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.612661 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hdqwv\"/\"kube-root-ca.crt\"" Jun 05 11:52:08.612820 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.612700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hdqwv\"/\"default-dockercfg-mwn9x\"" Jun 05 11:52:08.613541 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.613522 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hdqwv\"/\"openshift-service-ca.crt\"" Jun 05 11:52:08.617478 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.617447 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms"] Jun 05 11:52:08.645662 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.645624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-proc\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.645891 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.645686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-podres\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.645891 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.645758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2v5\" (UniqueName: \"kubernetes.io/projected/3b4a889b-3553-47d6-9502-ce870ae0dbad-kube-api-access-kl2v5\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.645891 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.645847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-sys\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.646025 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.645894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-lib-modules\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746453 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-lib-modules\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746453 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-proc\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-podres\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2v5\" (UniqueName: \"kubernetes.io/projected/3b4a889b-3553-47d6-9502-ce870ae0dbad-kube-api-access-kl2v5\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-sys\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-proc\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-lib-modules\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746658 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-sys\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.746872 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.746689 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3b4a889b-3553-47d6-9502-ce870ae0dbad-podres\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.754211 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.754176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2v5\" (UniqueName: \"kubernetes.io/projected/3b4a889b-3553-47d6-9502-ce870ae0dbad-kube-api-access-kl2v5\") pod \"perf-node-gather-daemonset-b8hms\" (UID: \"3b4a889b-3553-47d6-9502-ce870ae0dbad\") " pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:08.922486 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:08.922391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:09.055666 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.055626 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms"] Jun 05 11:52:09.058880 ip-10-0-140-113 kubenswrapper[2574]: W0605 11:52:09.058846 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3b4a889b_3553_47d6_9502_ce870ae0dbad.slice/crio-94b80853c760a8e11d7542457fdcf75b3abcfd6bdd35e1fb286f334df86e1ee0 WatchSource:0}: Error finding container 94b80853c760a8e11d7542457fdcf75b3abcfd6bdd35e1fb286f334df86e1ee0: Status 404 returned error can't find the container with id 94b80853c760a8e11d7542457fdcf75b3abcfd6bdd35e1fb286f334df86e1ee0 Jun 05 11:52:09.457714 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.457668 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dj7tz_3d01785c-b05f-4d1f-bf80-e06495018f32/dns/0.log" Jun 05 11:52:09.476192 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.476157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dj7tz_3d01785c-b05f-4d1f-bf80-e06495018f32/kube-rbac-proxy/0.log" Jun 05 11:52:09.615523 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.615491 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vk7ss_9543d026-5bb4-40b8-a75a-3e01b64ad205/dns-node-resolver/0.log" Jun 05 11:52:09.900144 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.900109 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" event={"ID":"3b4a889b-3553-47d6-9502-ce870ae0dbad","Type":"ContainerStarted","Data":"c32caa1bbbc8689484aeec5e8ffb987b3f3536dc917b0893d4a8cce8263f168c"} Jun 05 11:52:09.900337 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.900158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" event={"ID":"3b4a889b-3553-47d6-9502-ce870ae0dbad","Type":"ContainerStarted","Data":"94b80853c760a8e11d7542457fdcf75b3abcfd6bdd35e1fb286f334df86e1ee0"} Jun 05 11:52:09.900337 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.900210 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:09.915624 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.915573 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" podStartSLOduration=1.915559442 podStartE2EDuration="1.915559442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:52:09.914527336 +0000 UTC m=+891.989021879" watchObservedRunningTime="2026-06-05 11:52:09.915559442 +0000 UTC m=+891.990053963" Jun 05 11:52:09.988718 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.988664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86f4ccdb6b-sfwqj_7a077577-c19b-4180-85d5-f7cf91a9e9f1/registry/0.log" Jun 05 11:52:09.992774 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:09.992745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86f4ccdb6b-sfwqj_7a077577-c19b-4180-85d5-f7cf91a9e9f1/registry/1.log" Jun 05 11:52:10.048005 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:10.047974 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xvw5s_649b89ed-77fc-4a6c-9088-756726e5d6f2/node-ca/0.log" Jun 05 11:52:10.730821 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:10.730782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d5c5d4965-2thf6_464cdb2a-4f2e-4411-a4f1-8ac88d62021b/router/0.log" Jun 05 11:52:11.081785 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:11.081751 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zb52s_c797253a-99fe-4114-8ebe-c9a2ea31b2c8/serve-healthcheck-canary/0.log" Jun 05 11:52:11.390758 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:11.390665 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nwlz8_7e951429-325b-4890-9d67-9436e1ae0f4f/insights-operator/0.log" Jun 05 11:52:11.391509 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:11.391482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-nwlz8_7e951429-325b-4890-9d67-9436e1ae0f4f/insights-operator/1.log" Jun 05 11:52:11.410898 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:11.410873 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88shg_17d13dbf-c767-4c62-b61e-81e5befe371a/kube-rbac-proxy/0.log" Jun 05 11:52:11.428744 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:11.428722 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88shg_17d13dbf-c767-4c62-b61e-81e5befe371a/exporter/0.log" Jun 05 11:52:11.447068 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:11.447033 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88shg_17d13dbf-c767-4c62-b61e-81e5befe371a/extractor/0.log" Jun 05 11:52:15.913756 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:15.913722 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hdqwv/perf-node-gather-daemonset-b8hms" Jun 05 11:52:17.311310 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.311277 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/kube-multus-additional-cni-plugins/0.log" Jun 05 11:52:17.331674 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.331647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/egress-router-binary-copy/0.log" Jun 05 11:52:17.352895 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.352866 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/cni-plugins/0.log" Jun 05 11:52:17.371655 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.371627 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/bond-cni-plugin/0.log" Jun 05 11:52:17.392695 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.392665 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/routeoverride-cni/0.log" Jun 05 11:52:17.411961 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.411927 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/whereabouts-cni-bincopy/0.log" Jun 05 11:52:17.432421 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.432389 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pxdbz_4a56e121-28b7-485d-a634-97c32f976cd1/whereabouts-cni/0.log" Jun 05 11:52:17.467224 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.467144 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gxbr2_ca3451b1-3895-4753-9c74-16d6fc50e744/kube-multus/0.log" Jun 05 11:52:17.570243 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.570211 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbfkh_25aae35a-c484-4f93-b3d8-c2eb441b1e6d/network-metrics-daemon/0.log" Jun 05 11:52:17.590526 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:17.590495 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbfkh_25aae35a-c484-4f93-b3d8-c2eb441b1e6d/kube-rbac-proxy/0.log" Jun 05 11:52:18.441064 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.441037 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:52:18.444382 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.444358 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:52:18.585726 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.585695 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-controller/0.log" Jun 05 11:52:18.600310 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.600265 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/1.log" Jun 05 11:52:18.600310 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.600310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovn-acl-logging/0.log" Jun 05 11:52:18.623522 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.623490 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/kube-rbac-proxy-node/0.log" Jun 05 11:52:18.646084 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.646051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 11:52:18.664391 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.664359 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/northd/0.log" Jun 05 11:52:18.684953 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.684919 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/nbdb/0.log" Jun 05 11:52:18.704491 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.704463 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/sbdb/0.log" Jun 05 11:52:18.757037 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:18.757002 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxspx_2ed0c269-13ba-471f-a756-35fdd4b93436/ovnkube-controller/0.log" Jun 05 11:52:19.882988 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:19.882955 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-wr87x_135738b1-5478-4138-864c-140794eb5180/check-endpoints/0.log" Jun 05 11:52:19.923574 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:19.923541 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hkvws_a1a01e4e-dbfe-4a7b-8212-59eab3fbaf9b/network-check-target-container/0.log" Jun 05 11:52:20.728930 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:20.728902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-p69r9_260417d1-ba5c-4e80-a7bb-b97b8057b620/iptables-alerter/0.log" Jun 05 11:52:21.282174 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:21.282132 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-99x4q_ad905d2f-3bcf-49c4-8315-1b3d5a0cbb7f/tuned/0.log" Jun 05 11:52:22.913568 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:22.913535 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-69ldn_ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a/cluster-samples-operator/0.log" Jun 05 11:52:22.928696 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:22.928664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-854f8b96b6-69ldn_ec8856e4-a99a-4b1c-a4b1-76c2cb4ba09a/cluster-samples-operator-watch/0.log" Jun 05 11:52:24.496971 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:24.496890 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-gzhnl_f9c9b7e9-6677-4e11-831c-f4e2d452da64/csi-driver/0.log" Jun 05 11:52:24.515415 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:24.515385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-gzhnl_f9c9b7e9-6677-4e11-831c-f4e2d452da64/csi-node-driver-registrar/0.log" Jun 05 11:52:24.535333 ip-10-0-140-113 kubenswrapper[2574]: I0605 11:52:24.535305 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-gzhnl_f9c9b7e9-6677-4e11-831c-f4e2d452da64/csi-liveness-probe/0.log"