Jul 27 14:17:01.731326 ip-10-0-139-60 systemd[1]: Starting Kubernetes Kubelet... Jul 27 14:17:02.139510 ip-10-0-139-60 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 14:17:02.139510 ip-10-0-139-60 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 14:17:02.139510 ip-10-0-139-60 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 14:17:02.139510 ip-10-0-139-60 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 14:17:02.139510 ip-10-0-139-60 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 14:17:02.141501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.141420 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 14:17:02.145852 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145838 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 14:17:02.145852 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145851 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145856 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145862 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145867 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145872 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145875 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145878 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145880 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145883 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145886 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145888 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145891 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145894 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145897 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145899 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145902 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145905 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145907 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145910 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145918 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 14:17:02.145918 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145921 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145924 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145927 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145930 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145932 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145935 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145937 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145940 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145942 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145945 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145947 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145952 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145956 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145959 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145962 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145965 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145967 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145970 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145972 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 14:17:02.146412 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145975 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145977 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145980 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145982 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145985 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145987 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145989 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145992 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145997 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.145999 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146002 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146006 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146008 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146011 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146016 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146020 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146023 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146026 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 14:17:02.147150 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146029 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146032 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146034 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146037 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146040 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146042 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146045 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146047 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146050 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146052 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146065 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146069 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146073 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146077 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146080 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146085 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146089 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146091 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146094 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146096 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 14:17:02.147654 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146099 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146101 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146104 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146107 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146109 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146112 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146114 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146118 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146121 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146124 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146126 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146129 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146131 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146134 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146136 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146139 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146141 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146144 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146147 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 14:17:02.148159 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.146149 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 14:17:02.148815 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148800 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 14:17:02.148815 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148814 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148818 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148822 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148825 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148828 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148831 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148834 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148837 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148839 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148842 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148845 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148848 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148850 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148853 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148856 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148858 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148861 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148863 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148866 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 14:17:02.148870 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148869 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148871 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148874 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148877 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148880 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148882 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148885 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148887 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148890 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148893 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148895 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148898 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148901 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148903 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148906 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148908 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148911 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148914 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148916 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148919 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 14:17:02.149357 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148921 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148924 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148926 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148930 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148934 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148938 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148943 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148946 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148948 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148951 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148953 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148956 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148959 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148962 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148964 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148967 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148970 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148972 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148975 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 14:17:02.149835 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148977 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148980 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148982 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148985 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148987 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148990 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148993 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148996 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.148999 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149001 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149004 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149006 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149009 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149011 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149018 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149021 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149024 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149026 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149029 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149031 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 14:17:02.150321 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149034 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149036 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149038 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149041 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149045 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149048 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149052 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149069 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149072 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149075 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149079 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149083 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149086 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149089 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149092 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149101 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149106 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149108 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149111 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149114 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 14:17:02.150804 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149499 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149505 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149508 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149511 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149514 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149517 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149521 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149524 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149527 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149531 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149533 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149536 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149538 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149541 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149543 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149546 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149549 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149554 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149559 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 14:17:02.151296 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149563 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149566 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149568 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149572 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149575 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149577 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149580 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149582 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149585 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149587 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149590 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149593 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149595 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149598 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149600 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149603 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149606 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149608 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149611 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149613 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 14:17:02.151776 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149616 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149618 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149621 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149623 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149626 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149628 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149631 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149633 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149636 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149638 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149642 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149645 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149649 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149652 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149655 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149658 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149661 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149663 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149666 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149669 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 14:17:02.152312 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149672 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149675 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149677 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149680 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149684 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149687 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149689 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149692 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149695 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149697 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149700 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149702 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149705 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149707 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149710 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149712 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149715 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149717 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149720 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 14:17:02.152778 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149722 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149725 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149727 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149731 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149734 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149737 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149739 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149742 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149745 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149747 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149749 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149752 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149754 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149757 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149759 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149762 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149764 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149767 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149769 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149772 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 14:17:02.153246 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.149774 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149841 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149852 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149863 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149869 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149875 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149879 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149888 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149892 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149895 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149898 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149901 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149904 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149907 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149910 2577 flags.go:64] FLAG: --cgroup-root="" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149914 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149917 2577 flags.go:64] FLAG: --client-ca-file="" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149920 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149923 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149928 2577 flags.go:64] FLAG: --cluster-domain="" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149931 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149934 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149936 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149940 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 14:17:02.153728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149943 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149946 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149949 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149952 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149955 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149958 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149961 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149966 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149968 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149972 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149975 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149978 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149981 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149983 2577 flags.go:64] FLAG: --enable-server="true" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149986 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149990 2577 flags.go:64] FLAG: --event-burst="100" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149993 2577 flags.go:64] FLAG: --event-qps="50" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149996 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.149999 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150002 2577 flags.go:64] FLAG: --eviction-hard="" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150006 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150009 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150012 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150015 2577 flags.go:64] FLAG: --eviction-soft="" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150018 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 14:17:02.154292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150021 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150024 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150027 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150030 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150033 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150035 2577 flags.go:64] FLAG: --feature-gates="" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150039 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150042 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150045 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150048 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150051 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150067 2577 flags.go:64] FLAG: --help="false" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150072 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150077 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150083 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150086 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150089 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150092 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150095 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150098 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150101 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150104 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150107 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150110 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 14:17:02.154967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150113 2577 flags.go:64] FLAG: --kube-reserved="" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150116 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150119 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150122 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150125 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150128 2577 flags.go:64] FLAG: --lock-file="" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150130 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150133 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150136 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150141 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150145 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150147 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150150 2577 flags.go:64] FLAG: --logging-format="text" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150153 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150156 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150159 2577 flags.go:64] FLAG: --manifest-url="" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150161 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150165 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150168 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150172 2577 flags.go:64] FLAG: --max-pods="110" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150175 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150178 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150182 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150184 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150187 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 14:17:02.155581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150190 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150193 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150200 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150203 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150206 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150209 2577 flags.go:64] FLAG: --pod-cidr="" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150212 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150217 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150220 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150223 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150225 2577 flags.go:64] FLAG: --port="10250" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150228 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150232 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ee7b347da84b879d" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150235 2577 flags.go:64] FLAG: --qos-reserved="" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150237 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150240 2577 flags.go:64] FLAG: --register-node="true" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150243 2577 flags.go:64] FLAG: --register-with-taints="" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150247 2577 flags.go:64] FLAG: --registry-burst="10" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150250 2577 flags.go:64] FLAG: --registry-qps="5" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150253 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150255 2577 flags.go:64] FLAG: --reserved-memory="" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150259 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150262 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150264 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150267 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 14:17:02.156274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150270 2577 flags.go:64] FLAG: --runonce="false" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150273 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150276 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150279 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150283 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150286 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150288 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150291 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150294 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150297 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150300 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150302 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150306 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150309 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150312 2577 flags.go:64] FLAG: --system-cgroups="" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150314 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150319 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150322 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150325 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150332 2577 flags.go:64] FLAG: --tls-min-version="" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150335 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150337 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150340 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150343 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150346 2577 flags.go:64] FLAG: --v="2" Jul 27 14:17:02.156872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150350 2577 flags.go:64] FLAG: --version="false" Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150354 2577 flags.go:64] FLAG: --vmodule="" Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150357 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150361 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150479 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150483 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150486 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150489 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150492 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150494 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150497 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150501 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150504 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150506 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150509 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150511 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150514 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150516 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150519 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150521 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 14:17:02.157488 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150524 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150526 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150529 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150532 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150534 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150537 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150540 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150543 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150545 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150549 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150553 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150556 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150559 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150561 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150567 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150570 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150572 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150575 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150578 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150581 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 14:17:02.157975 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150583 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150586 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150588 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150592 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150595 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150597 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150600 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150602 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150605 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150608 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150610 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150613 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150615 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150618 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150620 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150623 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150625 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150628 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150632 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150634 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 14:17:02.158477 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150637 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150640 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150642 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150645 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150647 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150650 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150653 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150656 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150659 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150661 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150664 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150666 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150669 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150672 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150674 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150678 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150680 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150683 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150686 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150688 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 14:17:02.158972 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150691 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150693 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150696 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150698 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150701 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150705 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150708 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150711 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150715 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150719 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150723 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150725 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150728 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150730 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150733 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150735 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150738 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150741 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150744 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 14:17:02.159483 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150746 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150749 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150752 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.150754 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.150760 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.157381 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.157398 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.158255 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.158263 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158319 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158324 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158328 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158331 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158334 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 14:17:02.159936 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158338 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158342 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158346 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158349 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158354 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158357 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158361 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158364 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158367 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158370 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158373 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158376 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158378 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158381 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158384 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158386 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158389 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158392 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158395 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 14:17:02.160424 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158397 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158400 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158402 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158405 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158408 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158412 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158415 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158418 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158420 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158423 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158426 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158428 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158431 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158434 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158437 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158440 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158442 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158445 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158447 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158450 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 14:17:02.160877 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158452 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158455 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158457 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158460 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158462 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158465 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158467 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158470 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158473 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158475 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158478 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158481 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158483 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158486 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158489 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158492 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158495 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158498 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158501 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158504 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 14:17:02.161379 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158506 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158508 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158512 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158514 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158516 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158519 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158521 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158524 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158526 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158529 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158531 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158534 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158536 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158539 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158541 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158543 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158546 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158549 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158551 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158553 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 14:17:02.161896 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158556 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158558 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158561 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158563 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158565 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158568 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158570 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158573 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158576 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158578 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158581 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158585 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158587 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158589 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158592 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 14:17:02.162396 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.158597 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158715 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158720 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158723 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158726 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158729 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158731 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158734 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158737 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158739 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158741 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158744 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158747 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158749 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158752 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158754 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158759 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158763 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158765 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158768 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 14:17:02.162760 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158771 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158773 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158776 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158779 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158781 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158783 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158786 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158788 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158791 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158794 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158797 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158799 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158802 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158804 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158807 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158809 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158811 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158814 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158816 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158819 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 14:17:02.163256 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158821 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158823 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158826 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158828 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158831 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158833 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158836 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158838 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158841 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158843 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158846 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158848 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158851 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158853 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158856 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158858 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158860 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158863 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158865 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158868 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 14:17:02.163741 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158870 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158872 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158875 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158878 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158881 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158883 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158885 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158888 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158890 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158893 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158895 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158899 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158902 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158905 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158908 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158910 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158912 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158915 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158917 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 14:17:02.164313 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158920 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158922 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158925 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158927 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158930 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158932 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158935 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158937 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158939 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158942 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158945 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158948 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158952 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158954 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158957 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158959 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158962 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158965 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158967 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 14:17:02.164761 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158970 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 14:17:02.165268 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:02.158973 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 14:17:02.165268 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.158978 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 14:17:02.165268 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.159095 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 14:17:02.165268 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.162250 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 14:17:02.165268 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.165217 2577 server.go:1019] "Starting client certificate rotation" Jul 27 14:17:02.165398 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.165319 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 14:17:02.165398 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.165358 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 14:17:02.168513 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.168500 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 14:17:02.173308 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.173295 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 14:17:02.187215 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.187197 2577 log.go:25] "Validated CRI v1 runtime API" Jul 27 14:17:02.189203 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.189189 2577 log.go:25] "Validated CRI v1 image API" Jul 27 14:17:02.190011 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.189989 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 14:17:02.192953 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.192933 2577 fs.go:135] Filesystem UUIDs: map[0e638f7c-7863-45c1-a9d8-cca5cc12dd1a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a003434c-95bd-4158-8140-62034a8b1b02:/dev/nvme0n1p4] Jul 27 14:17:02.193018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.192950 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 14:17:02.193375 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.193358 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 14:17:02.201397 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.201285 2577 manager.go:216] Machine: {Timestamp:2026-07-27 14:17:02.197632686 +0000 UTC m=+0.347911859 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3165623 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aaa4da1c30ade7bbad52416e8abe0 SystemUUID:ec2aaa4d-a1c3-0ade-7bba-d52416e8abe0 BootID:4f85af46-cc06-458b-b246-143bf24656c2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:24:ab:05:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:24:ab:05:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:6c:d1:a8:02:c2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 14:17:02.201397 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.201389 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 14:17:02.201517 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.201471 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 14:17:02.204966 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.204943 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 14:17:02.205122 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.204969 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-60.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 14:17:02.206251 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.206240 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 14:17:02.206283 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.206253 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 14:17:02.206283 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.206260 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 14:17:02.206283 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.206271 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 14:17:02.207184 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.207174 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 14:17:02.209292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209281 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 27 14:17:02.209405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209396 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 14:17:02.209437 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209425 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 27 14:17:02.209467 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209442 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 14:17:02.209467 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209456 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 14:17:02.209467 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209465 2577 kubelet.go:398] "Adding apiserver pod source" Jul 27 14:17:02.209578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209473 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 14:17:02.209806 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209795 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 14:17:02.209839 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.209816 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 14:17:02.212972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.212955 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 14:17:02.215079 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.215047 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 14:17:02.215138 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.215096 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 14:17:02.216851 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216840 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216856 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216862 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216868 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216877 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216882 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216890 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 14:17:02.216897 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216898 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 14:17:02.217088 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216908 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 14:17:02.217088 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216916 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 14:17:02.217088 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216937 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 14:17:02.217088 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.216943 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 14:17:02.217979 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.217967 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 14:17:02.218012 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.217983 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 14:17:02.219615 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.219598 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9rxg" Jul 27 14:17:02.220952 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.220924 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-60.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 14:17:02.220952 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.220933 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 14:17:02.221077 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.221012 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 14:17:02.221618 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.221481 2577 server.go:1268] "Started kubelet" Jul 27 14:17:02.221618 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.221535 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 14:17:02.222165 ip-10-0-139-60 systemd[1]: Started Kubernetes Kubelet. Jul 27 14:17:02.223222 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.222080 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 14:17:02.223222 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.222685 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 14:17:02.226925 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.226903 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 14:17:02.227809 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.227784 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 14:17:02.228074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.228043 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 27 14:17:02.229368 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.229351 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9rxg" Jul 27 14:17:02.230584 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.228447 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-60.ec2.internal.18c62b38181699b2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-60.ec2.internal,UID:ip-10-0-139-60.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-60.ec2.internal,},FirstTimestamp:2026-07-27 14:17:02.221277618 +0000 UTC m=+0.371556787,LastTimestamp:2026-07-27 14:17:02.221277618 +0000 UTC m=+0.371556787,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-60.ec2.internal,}" Jul 27 14:17:02.235501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.235486 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 14:17:02.235501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.235497 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 14:17:02.235632 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.235598 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.236415 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236398 2577 factory.go:153] Registering CRI-O factory Jul 27 14:17:02.236518 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236418 2577 factory.go:223] Registration of the crio container factory successfully Jul 27 14:17:02.236518 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236475 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 14:17:02.236518 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236484 2577 factory.go:55] Registering systemd factory Jul 27 14:17:02.236518 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236484 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236548 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236494 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236492 2577 factory.go:223] Registration of the systemd container factory successfully Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236606 2577 factory.go:103] Registering Raw factory Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236621 2577 manager.go:1196] Started watching for new ooms in manager Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236674 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 27 14:17:02.236692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236683 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 27 14:17:02.237012 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.236999 2577 manager.go:349] Starting recovery of all containers Jul 27 14:17:02.237857 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.237828 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 14:17:02.237970 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.237925 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-60.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 14:17:02.246072 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.246040 2577 manager.go:354] Recovery completed Jul 27 14:17:02.251421 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.251408 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.253476 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.253456 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.253555 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.253494 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.253555 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.253509 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.254143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254125 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 14:17:02.254143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254141 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 14:17:02.254283 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254159 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 27 14:17:02.254283 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254193 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.254878 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254861 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.254940 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254892 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.254940 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.254906 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.256548 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.256532 2577 policy_none.go:49] "None policy: Start" Jul 27 14:17:02.256603 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.256556 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 14:17:02.256603 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.256571 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 14:17:02.258276 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.258263 2577 policy_none.go:47] "Start" Jul 27 14:17:02.299761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.299617 2577 manager.go:337] "Starting Device Plugin manager" Jul 27 14:17:02.299922 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.299788 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 14:17:02.299922 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.299803 2577 server.go:87] "Starting device plugin registration server" Jul 27 14:17:02.300038 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.300025 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 14:17:02.300112 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.300040 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 14:17:02.300112 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.300102 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 14:17:02.300211 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.300204 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 14:17:02.300260 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.300213 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 14:17:02.300754 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.300733 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 14:17:02.300838 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.300789 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.323809 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.323788 2577 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2609 into the system container \"/system.slice\": " Jul 27 14:17:02.400308 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.400257 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.402252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.401231 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.402252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.401262 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.402252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.401272 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.402252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.401302 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.408821 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.408806 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.408872 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.408828 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-60.ec2.internal\": node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.423134 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.423112 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.424632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.424609 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 14:17:02.425804 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.425790 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 14:17:02.425868 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.425832 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 14:17:02.425868 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.425857 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 14:17:02.425973 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.425893 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 14:17:02.427652 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.427629 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 14:17:02.523713 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.523656 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.526805 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.526789 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal"] Jul 27 14:17:02.526855 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.526849 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.527744 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.527725 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.527824 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.527761 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.527824 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.527777 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.530085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.530073 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.530187 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.530172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.530239 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.530213 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.530882 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.530857 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.530970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.530906 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.530970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.530924 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.531272 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.531258 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.531314 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.531283 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.531314 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.531294 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.533213 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.533196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.533301 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.533222 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 14:17:02.533851 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.533835 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientMemory" Jul 27 14:17:02.533929 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.533861 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 14:17:02.533929 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.533874 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeHasSufficientPID" Jul 27 14:17:02.538032 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.538013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d86f8dc10c2acea0b453421180560d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-60.ec2.internal\" (UID: \"35d86f8dc10c2acea0b453421180560d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.538126 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.538045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61b8c40fbd5690a756efb220b7a22679-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal\" (UID: \"61b8c40fbd5690a756efb220b7a22679\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.538126 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.538100 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61b8c40fbd5690a756efb220b7a22679-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal\" (UID: \"61b8c40fbd5690a756efb220b7a22679\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.553575 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.553557 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-60.ec2.internal\" not found" node="ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.557435 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.557421 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-60.ec2.internal\" not found" node="ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.624089 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.624067 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.638415 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.638394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61b8c40fbd5690a756efb220b7a22679-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal\" (UID: \"61b8c40fbd5690a756efb220b7a22679\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.638487 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.638421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61b8c40fbd5690a756efb220b7a22679-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal\" (UID: \"61b8c40fbd5690a756efb220b7a22679\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.638487 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.638436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d86f8dc10c2acea0b453421180560d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-60.ec2.internal\" (UID: \"35d86f8dc10c2acea0b453421180560d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.638581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.638486 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/35d86f8dc10c2acea0b453421180560d-config\") pod \"kube-apiserver-proxy-ip-10-0-139-60.ec2.internal\" (UID: \"35d86f8dc10c2acea0b453421180560d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.638581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.638490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/61b8c40fbd5690a756efb220b7a22679-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal\" (UID: \"61b8c40fbd5690a756efb220b7a22679\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.638581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.638519 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61b8c40fbd5690a756efb220b7a22679-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal\" (UID: \"61b8c40fbd5690a756efb220b7a22679\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.724767 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.724713 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.825294 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.825262 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:02.856784 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.856765 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.862628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:02.862606 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" Jul 27 14:17:02.925931 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:02.925907 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.249098 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.249078 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.275050 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.273623 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 14:17:04.349220 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.349198 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.386998 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.386978 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 14:17:04.387362 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.387108 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 14:17:04.387362 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.387142 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 14:17:04.449263 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.449243 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.458642 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.458605 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 14:12:03 +0000 UTC" deadline="2028-01-16 21:31:19.633980154 +0000 UTC" Jul 27 14:17:04.458642 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.458641 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12919h14m15.175340989s" Jul 27 14:17:04.495113 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.495060 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 14:17:04.550110 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.550088 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.650164 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.650142 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.708397 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:04.708361 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d86f8dc10c2acea0b453421180560d.slice/crio-4a41e7bbaff59df21624382d16a8c0bcbc156e9b8c2f7097ba137a498fef5cc6 WatchSource:0}: Error finding container 4a41e7bbaff59df21624382d16a8c0bcbc156e9b8c2f7097ba137a498fef5cc6: Status 404 returned error can't find the container with id 4a41e7bbaff59df21624382d16a8c0bcbc156e9b8c2f7097ba137a498fef5cc6 Jul 27 14:17:04.708796 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:04.708778 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61b8c40fbd5690a756efb220b7a22679.slice/crio-7470eb21cc42d2ecd32fdc839dbbcbca3ee763702d8b2efce6b4d1067e707201 WatchSource:0}: Error finding container 7470eb21cc42d2ecd32fdc839dbbcbca3ee763702d8b2efce6b4d1067e707201: Status 404 returned error can't find the container with id 7470eb21cc42d2ecd32fdc839dbbcbca3ee763702d8b2efce6b4d1067e707201 Jul 27 14:17:04.712840 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:04.712826 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 14:17:04.751226 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.751179 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.851688 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.851665 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:04.952428 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:04.952404 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-60.ec2.internal\" not found" Jul 27 14:17:05.015410 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.015362 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 14:17:05.058457 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.058434 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" Jul 27 14:17:05.069500 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.069481 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 14:17:05.070674 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.070662 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" Jul 27 14:17:05.082007 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.081991 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 14:17:05.433193 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.433109 2577 apiserver.go:52] "Watching apiserver" Jul 27 14:17:05.446268 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.446244 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 14:17:05.446612 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.446593 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-g2x4z","openshift-image-registry/node-ca-2v9c6","openshift-network-diagnostics/network-check-target-nxl7t","openshift-network-operator/iptables-alerter-78mn2","openshift-ovn-kubernetes/ovnkube-node-c77qg","kube-system/global-pull-secret-syncer-whbh6","kube-system/konnectivity-agent-trgmd","kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal","openshift-dns/node-resolver-blx2n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal","openshift-multus/multus-5hfk6","openshift-multus/multus-additional-cni-plugins-zbfkv","openshift-multus/network-metrics-daemon-8rp8n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9"] Jul 27 14:17:05.450476 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.450460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.452586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.452567 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:05.452682 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.452623 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:05.453044 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.453032 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 14:17:05.453734 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.453717 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k6nwf\"" Jul 27 14:17:05.453813 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.453748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 14:17:05.454710 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.454687 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:05.454817 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.454796 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:05.456857 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.456842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.458624 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.458608 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 14:17:05.459169 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.459151 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.461394 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.461012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.461394 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.461206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 14:17:05.461394 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.461302 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lcnk7\"" Jul 27 14:17:05.462229 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.462206 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.462649 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.462621 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:05.464044 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.464028 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.464754 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.464734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.464902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.464887 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.467190 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.467174 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.468291 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.468274 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 14:17:05.468291 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.468283 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.468426 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.468323 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 14:17:05.468426 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.468408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.469109 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469093 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:05.469156 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-slash\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469156 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sppnf\" (UniqueName: \"kubernetes.io/projected/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-kube-api-access-sppnf\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.469265 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-etc-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469265 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469216 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469265 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/630f147a-b279-4728-80fb-08388320ed95-ovn-node-metrics-cert\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.469405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-kubelet\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-log-socket\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469394 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-cni-netd\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:05.469584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-host-slash\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.469584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469476 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-run-netns\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.469584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469549 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9mpxl\"" Jul 27 14:17:05.469835 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469626 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 14:17:05.469835 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469678 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 14:17:05.469835 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469497 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-systemd\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469976 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469844 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jmtkd\"" Jul 27 14:17:05.469976 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-cni-bin\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.469976 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469956 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.469976 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.469970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-env-overrides\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470027 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e4a8cab-05ad-4c99-8461-5293ad3ff669-kubelet-config\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470063 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-systemd-units\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-ovn\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-run-ovn-kubernetes\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470162 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470156 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-ovnkube-script-lib\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5dbd46e-019e-4696-a73a-12646e9a02e6-agent-certs\") pod \"konnectivity-agent-trgmd\" (UID: \"b5dbd46e-019e-4696-a73a-12646e9a02e6\") " pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhp8x\" (UniqueName: \"kubernetes.io/projected/13865f74-f907-40fe-9ad0-09ad853e1531-kube-api-access-zhp8x\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-iptables-alerter-script\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-ovnkube-config\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470247 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8bzh\" (UniqueName: \"kubernetes.io/projected/630f147a-b279-4728-80fb-08388320ed95-kube-api-access-f8bzh\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e4a8cab-05ad-4c99-8461-5293ad3ff669-dbus\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-var-lib-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-node-log\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.470447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5dbd46e-019e-4696-a73a-12646e9a02e6-konnectivity-ca\") pod \"konnectivity-agent-trgmd\" (UID: \"b5dbd46e-019e-4696-a73a-12646e9a02e6\") " pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.470780 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.470653 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n267q\"" Jul 27 14:17:05.471794 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.471779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.474034 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.474018 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.474258 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.474236 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.474338 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.474290 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 14:17:05.474403 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.474361 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 14:17:05.476292 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.476276 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.478363 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478551 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zl269\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478569 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478553 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mrzk6\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478648 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 14:17:05.478761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478648 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.479106 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478821 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 14:17:05.479106 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478821 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 14:17:05.479106 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.478860 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wg8wk\"" Jul 27 14:17:05.479566 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.479548 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 14:17:05.479868 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.479854 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 14:17:05.480794 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.480780 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2n2ds\"" Jul 27 14:17:05.514913 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.514887 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 14:17:05.542736 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.542715 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4k9g" Jul 27 14:17:05.560371 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.560354 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 14:17:05.565423 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.565408 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w4k9g" Jul 27 14:17:05.571046 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:05.571127 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-slash\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.571127 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c676d3df-c2f0-4367-adcc-4a9850947bdc-tmp-dir\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.571127 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sppnf\" (UniqueName: \"kubernetes.io/projected/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-kube-api-access-sppnf\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.571127 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.571312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/630f147a-b279-4728-80fb-08388320ed95-ovn-node-metrics-cert\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.571312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571141 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-slash\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.571312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.571312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.571312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6j25\" (UniqueName: \"kubernetes.io/projected/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-kube-api-access-x6j25\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.571312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysctl-d\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.571318 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571323 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.571399 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571408 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.571402 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:06.07138232 +0000 UTC m=+2.999015609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.571488 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:06.071470298 +0000 UTC m=+2.999103564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571530 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn2l6\" (UniqueName: \"kubernetes.io/projected/a27b13dc-6809-44f9-919c-d98e8f1123fb-kube-api-access-tn2l6\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9dc80248-a8f6-46db-b4f4-709ab9483e98-serviceca\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.571586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-host-slash\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571602 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-systemd\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571635 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-host-slash\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-cni-bin\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571685 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-env-overrides\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e4a8cab-05ad-4c99-8461-5293ad3ff669-kubelet-config\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571732 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-cni-bin\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-run\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-device-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-systemd\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-ovn\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5dbd46e-019e-4696-a73a-12646e9a02e6-agent-certs\") pod \"konnectivity-agent-trgmd\" (UID: \"b5dbd46e-019e-4696-a73a-12646e9a02e6\") " pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-cni-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571861 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-run-ovn\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571892 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e4a8cab-05ad-4c99-8461-5293ad3ff669-kubelet-config\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-multus-certs\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.572065 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysctl-conf\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.571994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-iptables-alerter-script\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8bzh\" (UniqueName: \"kubernetes.io/projected/630f147a-b279-4728-80fb-08388320ed95-kube-api-access-f8bzh\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-netns\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-cni-bin\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572207 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysconfig\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e4a8cab-05ad-4c99-8461-5293ad3ff669-dbus\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-env-overrides\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cnibin\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572278 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-registration-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5dbd46e-019e-4696-a73a-12646e9a02e6-konnectivity-ca\") pod \"konnectivity-agent-trgmd\" (UID: \"b5dbd46e-019e-4696-a73a-12646e9a02e6\") " pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-systemd\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-lib-modules\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572365 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-etc-selinux\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572372 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e4a8cab-05ad-4c99-8461-5293ad3ff669-dbus\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:05.572902 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjcm\" (UniqueName: \"kubernetes.io/projected/c676d3df-c2f0-4367-adcc-4a9850947bdc-kube-api-access-fkjcm\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-kubernetes\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572435 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-host\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-etc-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a27b13dc-6809-44f9-919c-d98e8f1123fb-tmp\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572507 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-etc-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572539 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-sys-fs\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-kubelet\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-log-socket\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-cni-netd\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-iptables-alerter-script\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572661 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-log-socket\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572669 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-cni-netd\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-system-cni-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-kubelet\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-cnibin\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-socket-dir-parent\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.573464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-os-release\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-run-netns\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572883 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-run-netns\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572845 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5dbd46e-019e-4696-a73a-12646e9a02e6-konnectivity-ca\") pod \"konnectivity-agent-trgmd\" (UID: \"b5dbd46e-019e-4696-a73a-12646e9a02e6\") " pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-kubelet\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-conf-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572942 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.572987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-modprobe-d\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-var-lib-kubelet\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573035 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dc80248-a8f6-46db-b4f4-709ab9483e98-host\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573061 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-systemd-units\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-run-ovn-kubernetes\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-ovnkube-script-lib\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-systemd-units\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573136 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhp8x\" (UniqueName: \"kubernetes.io/projected/13865f74-f907-40fe-9ad0-09ad853e1531-kube-api-access-zhp8x\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:05.574002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573159 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-k8s-cni-cncf-io\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573162 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-host-run-ovn-kubernetes\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-daemon-config\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-etc-kubernetes\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rrw\" (UniqueName: \"kubernetes.io/projected/934d5a8e-bb6f-4b51-811c-0d4d081d143c-kube-api-access-f5rrw\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-ovnkube-config\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-os-release\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-system-cni-dir\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573431 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-socket-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-cni-multus\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-hostroot\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-tuned\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573575 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m27t\" (UniqueName: \"kubernetes.io/projected/9dc80248-a8f6-46db-b4f4-709ab9483e98-kube-api-access-8m27t\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-var-lib-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573618 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-ovnkube-script-lib\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-node-log\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.574462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573661 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/934d5a8e-bb6f-4b51-811c-0d4d081d143c-cni-binary-copy\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-var-lib-openvswitch\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c676d3df-c2f0-4367-adcc-4a9850947bdc-hosts-file\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/630f147a-b279-4728-80fb-08388320ed95-node-log\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-sys\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbrt\" (UniqueName: \"kubernetes.io/projected/bf71a6e1-0893-461e-b2ac-518a1df0f93f-kube-api-access-qnbrt\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.573809 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/630f147a-b279-4728-80fb-08388320ed95-ovnkube-config\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.574751 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/630f147a-b279-4728-80fb-08388320ed95-ovn-node-metrics-cert\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.575081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.574776 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5dbd46e-019e-4696-a73a-12646e9a02e6-agent-certs\") pod \"konnectivity-agent-trgmd\" (UID: \"b5dbd46e-019e-4696-a73a-12646e9a02e6\") " pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.584973 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.584955 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:05.584973 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.584976 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:05.585097 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.584985 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:05.585097 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:05.585027 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:06.085015787 +0000 UTC m=+3.012649060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:05.590946 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.590926 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sppnf\" (UniqueName: \"kubernetes.io/projected/2d4903fe-9140-46e9-9cd2-78b87ed4abb1-kube-api-access-sppnf\") pod \"iptables-alerter-78mn2\" (UID: \"2d4903fe-9140-46e9-9cd2-78b87ed4abb1\") " pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.592226 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.592207 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8bzh\" (UniqueName: \"kubernetes.io/projected/630f147a-b279-4728-80fb-08388320ed95-kube-api-access-f8bzh\") pod \"ovnkube-node-c77qg\" (UID: \"630f147a-b279-4728-80fb-08388320ed95\") " pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.593539 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.593521 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhp8x\" (UniqueName: \"kubernetes.io/projected/13865f74-f907-40fe-9ad0-09ad853e1531-kube-api-access-zhp8x\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:05.654854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.654803 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" event={"ID":"61b8c40fbd5690a756efb220b7a22679","Type":"ContainerStarted","Data":"7470eb21cc42d2ecd32fdc839dbbcbca3ee763702d8b2efce6b4d1067e707201"} Jul 27 14:17:05.655886 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.655865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" event={"ID":"35d86f8dc10c2acea0b453421180560d","Type":"ContainerStarted","Data":"4a41e7bbaff59df21624382d16a8c0bcbc156e9b8c2f7097ba137a498fef5cc6"} Jul 27 14:17:05.674920 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.674896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjcm\" (UniqueName: \"kubernetes.io/projected/c676d3df-c2f0-4367-adcc-4a9850947bdc-kube-api-access-fkjcm\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.675002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.674923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-kubernetes\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.674939 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-host\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.674954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a27b13dc-6809-44f9-919c-d98e8f1123fb-tmp\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.674970 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-sys-fs\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.675002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.674989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-system-cni-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-cnibin\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-kubernetes\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-socket-dir-parent\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675025 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-host\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675052 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-os-release\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675068 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-sys-fs\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675077 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-cnibin\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-kubelet\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-system-cni-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675115 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-conf-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-os-release\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-kubelet\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675181 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-socket-dir-parent\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675186 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-conf-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675201 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-modprobe-d\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-var-lib-kubelet\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dc80248-a8f6-46db-b4f4-709ab9483e98-host\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-k8s-cni-cncf-io\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-var-lib-kubelet\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675295 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-k8s-cni-cncf-io\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675301 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9dc80248-a8f6-46db-b4f4-709ab9483e98-host\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-daemon-config\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675330 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675330 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-modprobe-d\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-etc-kubernetes\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rrw\" (UniqueName: \"kubernetes.io/projected/934d5a8e-bb6f-4b51-811c-0d4d081d143c-kube-api-access-f5rrw\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-os-release\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675405 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-system-cni-dir\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675461 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-etc-kubernetes\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675470 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-os-release\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-socket-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-cni-multus\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675549 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-hostroot\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.675987 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675462 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-system-cni-dir\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-socket-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-cni-multus\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675572 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-tuned\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675471 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-hostroot\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m27t\" (UniqueName: \"kubernetes.io/projected/9dc80248-a8f6-46db-b4f4-709ab9483e98-kube-api-access-8m27t\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/934d5a8e-bb6f-4b51-811c-0d4d081d143c-cni-binary-copy\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c676d3df-c2f0-4367-adcc-4a9850947bdc-hosts-file\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675760 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-sys\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbrt\" (UniqueName: \"kubernetes.io/projected/bf71a6e1-0893-461e-b2ac-518a1df0f93f-kube-api-access-qnbrt\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c676d3df-c2f0-4367-adcc-4a9850947bdc-hosts-file\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c676d3df-c2f0-4367-adcc-4a9850947bdc-tmp-dir\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675862 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-sys\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675871 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6j25\" (UniqueName: \"kubernetes.io/projected/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-kube-api-access-x6j25\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.675966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysctl-d\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676008 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.676854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn2l6\" (UniqueName: \"kubernetes.io/projected/a27b13dc-6809-44f9-919c-d98e8f1123fb-kube-api-access-tn2l6\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9dc80248-a8f6-46db-b4f4-709ab9483e98-serviceca\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676119 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysctl-d\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c676d3df-c2f0-4367-adcc-4a9850947bdc-tmp-dir\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-run\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676165 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-run\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/934d5a8e-bb6f-4b51-811c-0d4d081d143c-cni-binary-copy\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-device-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-cni-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-device-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-multus-certs\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676295 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysctl-conf\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-netns\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676356 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-multus-certs\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-cni-bin\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676392 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-cni-dir\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.677315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysconfig\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cnibin\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676478 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysctl-conf\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676512 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-registration-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-var-lib-cni-bin\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-systemd\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676562 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-lib-modules\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-etc-selinux\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676593 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9dc80248-a8f6-46db-b4f4-709ab9483e98-serviceca\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676597 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cnibin\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676632 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-sysconfig\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676675 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-systemd\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676723 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-registration-dir\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676728 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf71a6e1-0893-461e-b2ac-518a1df0f93f-etc-selinux\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676562 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/934d5a8e-bb6f-4b51-811c-0d4d081d143c-host-run-netns\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676781 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676804 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a27b13dc-6809-44f9-919c-d98e8f1123fb-lib-modules\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.677854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.676876 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.678296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.677158 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/934d5a8e-bb6f-4b51-811c-0d4d081d143c-multus-daemon-config\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.678296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.677475 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a27b13dc-6809-44f9-919c-d98e8f1123fb-tmp\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.678296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.677676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-cni-binary-copy\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.678296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.677788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a27b13dc-6809-44f9-919c-d98e8f1123fb-etc-tuned\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.690172 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.690120 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m27t\" (UniqueName: \"kubernetes.io/projected/9dc80248-a8f6-46db-b4f4-709ab9483e98-kube-api-access-8m27t\") pod \"node-ca-2v9c6\" (UID: \"9dc80248-a8f6-46db-b4f4-709ab9483e98\") " pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.690320 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.690302 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbrt\" (UniqueName: \"kubernetes.io/projected/bf71a6e1-0893-461e-b2ac-518a1df0f93f-kube-api-access-qnbrt\") pod \"aws-ebs-csi-driver-node-rn8k9\" (UID: \"bf71a6e1-0893-461e-b2ac-518a1df0f93f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.690505 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.690491 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjcm\" (UniqueName: \"kubernetes.io/projected/c676d3df-c2f0-4367-adcc-4a9850947bdc-kube-api-access-fkjcm\") pod \"node-resolver-blx2n\" (UID: \"c676d3df-c2f0-4367-adcc-4a9850947bdc\") " pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.690628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.690613 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn2l6\" (UniqueName: \"kubernetes.io/projected/a27b13dc-6809-44f9-919c-d98e8f1123fb-kube-api-access-tn2l6\") pod \"tuned-g2x4z\" (UID: \"a27b13dc-6809-44f9-919c-d98e8f1123fb\") " pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.695569 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.695551 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6j25\" (UniqueName: \"kubernetes.io/projected/a874b4ad-7e47-49d1-8a8f-e7d90039a1a7-kube-api-access-x6j25\") pod \"multus-additional-cni-plugins-zbfkv\" (UID: \"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7\") " pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.700144 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.700121 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rrw\" (UniqueName: \"kubernetes.io/projected/934d5a8e-bb6f-4b51-811c-0d4d081d143c-kube-api-access-f5rrw\") pod \"multus-5hfk6\" (UID: \"934d5a8e-bb6f-4b51-811c-0d4d081d143c\") " pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.758182 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.758159 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:05.768925 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.768904 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5dbd46e_019e_4696_a73a_12646e9a02e6.slice/crio-de2a32fcb07e46b861e71f68bd19cbddaab8e104d62bc6058c25812d94b89454 WatchSource:0}: Error finding container de2a32fcb07e46b861e71f68bd19cbddaab8e104d62bc6058c25812d94b89454: Status 404 returned error can't find the container with id de2a32fcb07e46b861e71f68bd19cbddaab8e104d62bc6058c25812d94b89454 Jul 27 14:17:05.769460 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.769439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78mn2" Jul 27 14:17:05.776963 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.776942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:05.778129 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.778063 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4903fe_9140_46e9_9cd2_78b87ed4abb1.slice/crio-367e1ff1e215e87ce29c25f4c4d23cd9bb318fe850f6a559a19208bf637e2e7a WatchSource:0}: Error finding container 367e1ff1e215e87ce29c25f4c4d23cd9bb318fe850f6a559a19208bf637e2e7a: Status 404 returned error can't find the container with id 367e1ff1e215e87ce29c25f4c4d23cd9bb318fe850f6a559a19208bf637e2e7a Jul 27 14:17:05.781447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.781272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-blx2n" Jul 27 14:17:05.787111 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.787090 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" Jul 27 14:17:05.787984 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.787947 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630f147a_b279_4728_80fb_08388320ed95.slice/crio-0798534e2965c9959cb93b5cbe9b21d56ce33a191d8ff753c994d53c30a76b2d WatchSource:0}: Error finding container 0798534e2965c9959cb93b5cbe9b21d56ce33a191d8ff753c994d53c30a76b2d: Status 404 returned error can't find the container with id 0798534e2965c9959cb93b5cbe9b21d56ce33a191d8ff753c994d53c30a76b2d Jul 27 14:17:05.791229 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.791202 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc676d3df_c2f0_4367_adcc_4a9850947bdc.slice/crio-65b1ed8b971a020fb1d3bef1bdbe2bff14fc80f7d9afb242bb3222b4e0b4068c WatchSource:0}: Error finding container 65b1ed8b971a020fb1d3bef1bdbe2bff14fc80f7d9afb242bb3222b4e0b4068c: Status 404 returned error can't find the container with id 65b1ed8b971a020fb1d3bef1bdbe2bff14fc80f7d9afb242bb3222b4e0b4068c Jul 27 14:17:05.792288 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.792259 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2v9c6" Jul 27 14:17:05.796769 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.796750 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda27b13dc_6809_44f9_919c_d98e8f1123fb.slice/crio-d52a2d5040b6f667967d508567ffe32415f0f5a841ac1d58a326ca2ee349a875 WatchSource:0}: Error finding container d52a2d5040b6f667967d508567ffe32415f0f5a841ac1d58a326ca2ee349a875: Status 404 returned error can't find the container with id d52a2d5040b6f667967d508567ffe32415f0f5a841ac1d58a326ca2ee349a875 Jul 27 14:17:05.797675 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.797638 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" Jul 27 14:17:05.801576 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.801542 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc80248_a8f6_46db_b4f4_709ab9483e98.slice/crio-b0693b724ae2837c1a630650ba0aa8bfa2d61d0167e4559250ec2ffb66684517 WatchSource:0}: Error finding container b0693b724ae2837c1a630650ba0aa8bfa2d61d0167e4559250ec2ffb66684517: Status 404 returned error can't find the container with id b0693b724ae2837c1a630650ba0aa8bfa2d61d0167e4559250ec2ffb66684517 Jul 27 14:17:05.803474 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.803176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hfk6" Jul 27 14:17:05.806800 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.806779 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf71a6e1_0893_461e_b2ac_518a1df0f93f.slice/crio-f1eace36dceb2c8bee98c264c546214c9c37d3198fc0655f882d5a13c0d41440 WatchSource:0}: Error finding container f1eace36dceb2c8bee98c264c546214c9c37d3198fc0655f882d5a13c0d41440: Status 404 returned error can't find the container with id f1eace36dceb2c8bee98c264c546214c9c37d3198fc0655f882d5a13c0d41440 Jul 27 14:17:05.807857 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.807840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" Jul 27 14:17:05.812817 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.812795 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934d5a8e_bb6f_4b51_811c_0d4d081d143c.slice/crio-fa401d4c2edecd9023b7457481406b243947b20dbd261a55ac91e95aa835917b WatchSource:0}: Error finding container fa401d4c2edecd9023b7457481406b243947b20dbd261a55ac91e95aa835917b: Status 404 returned error can't find the container with id fa401d4c2edecd9023b7457481406b243947b20dbd261a55ac91e95aa835917b Jul 27 14:17:05.817850 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:05.817831 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda874b4ad_7e47_49d1_8a8f_e7d90039a1a7.slice/crio-c3787b10025a0ab288478111377a2d4dc3f0b13109eeab41e13835537982590a WatchSource:0}: Error finding container c3787b10025a0ab288478111377a2d4dc3f0b13109eeab41e13835537982590a: Status 404 returned error can't find the container with id c3787b10025a0ab288478111377a2d4dc3f0b13109eeab41e13835537982590a Jul 27 14:17:05.900883 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:05.900860 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 14:17:06.079093 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.079019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:06.079093 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.079067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:06.079290 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.079166 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:06.079290 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.079181 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:06.079290 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.079236 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:07.079213218 +0000 UTC m=+4.006846479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:06.079290 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.079254 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:07.079246157 +0000 UTC m=+4.006879417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:06.179745 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.179699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:06.179891 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.179869 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:06.179891 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.179888 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:06.179975 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.179901 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:06.179975 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:06.179969 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:07.17994657 +0000 UTC m=+4.107579849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:06.569206 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.569087 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 14:12:05 +0000 UTC" deadline="2028-02-23 20:32:55.775079834 +0000 UTC" Jul 27 14:17:06.569206 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.569126 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13830h15m49.20595844s" Jul 27 14:17:06.664503 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.664381 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2v9c6" event={"ID":"9dc80248-a8f6-46db-b4f4-709ab9483e98","Type":"ContainerStarted","Data":"b0693b724ae2837c1a630650ba0aa8bfa2d61d0167e4559250ec2ffb66684517"} Jul 27 14:17:06.666524 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.666403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" event={"ID":"a27b13dc-6809-44f9-919c-d98e8f1123fb","Type":"ContainerStarted","Data":"d52a2d5040b6f667967d508567ffe32415f0f5a841ac1d58a326ca2ee349a875"} Jul 27 14:17:06.671147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.671045 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" event={"ID":"bf71a6e1-0893-461e-b2ac-518a1df0f93f","Type":"ContainerStarted","Data":"f1eace36dceb2c8bee98c264c546214c9c37d3198fc0655f882d5a13c0d41440"} Jul 27 14:17:06.681256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.679737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-blx2n" event={"ID":"c676d3df-c2f0-4367-adcc-4a9850947bdc","Type":"ContainerStarted","Data":"65b1ed8b971a020fb1d3bef1bdbe2bff14fc80f7d9afb242bb3222b4e0b4068c"} Jul 27 14:17:06.683044 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.682986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"0798534e2965c9959cb93b5cbe9b21d56ce33a191d8ff753c994d53c30a76b2d"} Jul 27 14:17:06.693027 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.692974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78mn2" event={"ID":"2d4903fe-9140-46e9-9cd2-78b87ed4abb1","Type":"ContainerStarted","Data":"367e1ff1e215e87ce29c25f4c4d23cd9bb318fe850f6a559a19208bf637e2e7a"} Jul 27 14:17:06.697338 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.697310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trgmd" event={"ID":"b5dbd46e-019e-4696-a73a-12646e9a02e6","Type":"ContainerStarted","Data":"de2a32fcb07e46b861e71f68bd19cbddaab8e104d62bc6058c25812d94b89454"} Jul 27 14:17:06.706252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.706013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerStarted","Data":"c3787b10025a0ab288478111377a2d4dc3f0b13109eeab41e13835537982590a"} Jul 27 14:17:06.720363 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:06.720265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hfk6" event={"ID":"934d5a8e-bb6f-4b51-811c-0d4d081d143c","Type":"ContainerStarted","Data":"fa401d4c2edecd9023b7457481406b243947b20dbd261a55ac91e95aa835917b"} Jul 27 14:17:07.088107 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.087369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:07.088107 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.087415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:07.088107 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.087549 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:07.088107 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.087608 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:09.087589701 +0000 UTC m=+6.015222979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:07.088107 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.087667 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:07.088107 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.087696 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:09.087686218 +0000 UTC m=+6.015319493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:07.188014 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.187977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:07.188212 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.188190 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:07.188287 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.188221 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:07.188287 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.188235 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:07.188391 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.188294 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:09.188275179 +0000 UTC m=+6.115908444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:07.464549 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.464455 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 14:17:07.570000 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.569934 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 14:12:05 +0000 UTC" deadline="2028-03-14 18:03:39.214028176 +0000 UTC" Jul 27 14:17:07.570000 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.569991 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14307h46m31.64404119s" Jul 27 14:17:07.652432 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.651325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:07.652432 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.651461 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:07.652432 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.651538 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:07.652432 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.651605 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:07.652432 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.651717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:07.652432 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:07.651794 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:07.745506 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.745426 2577 generic.go:356] "Generic (PLEG): container finished" podID="61b8c40fbd5690a756efb220b7a22679" containerID="b9ac250c5b33cca15b8d311ffb1cd2bacf9ed91bd826e7f41125f379bd978880" exitCode=0 Jul 27 14:17:07.745506 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:07.745482 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" event={"ID":"61b8c40fbd5690a756efb220b7a22679","Type":"ContainerDied","Data":"b9ac250c5b33cca15b8d311ffb1cd2bacf9ed91bd826e7f41125f379bd978880"} Jul 27 14:17:08.772697 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:08.772660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" event={"ID":"61b8c40fbd5690a756efb220b7a22679","Type":"ContainerStarted","Data":"54cffc55c2b7220d4ce56002db8f38191eec4dfeae94dcd36b3bd3e130f0dfc7"} Jul 27 14:17:09.104442 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:09.104346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:09.104598 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:09.104460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:09.104598 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.104572 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:09.104741 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.104633 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:13.104614111 +0000 UTC m=+10.032247378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:09.105328 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.104993 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:09.105328 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.105053 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:13.105035554 +0000 UTC m=+10.032668829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:09.206040 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:09.205393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:09.206040 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.205558 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:09.206040 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.205579 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:09.206040 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.205591 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:09.206040 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.205651 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:13.205631354 +0000 UTC m=+10.133264619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:09.649382 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:09.649354 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:09.649565 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.649463 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:09.649565 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:09.649547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:09.649694 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.649630 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:09.649694 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:09.649684 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:09.649818 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:09.649777 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:11.649267 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:11.648910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:11.649267 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:11.648910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:11.649267 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:11.649039 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:11.649267 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:11.649065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:11.649267 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:11.649162 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:11.649872 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:11.649314 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:13.136936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:13.136689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:13.136936 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:13.136759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:13.136936 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.136851 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:13.136936 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.136881 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:13.136936 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.136930 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:21.136907692 +0000 UTC m=+18.064540969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:13.137582 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.136953 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:21.136941646 +0000 UTC m=+18.064574907 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:13.237221 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:13.237187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:13.237391 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.237357 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:13.237391 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.237380 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:13.237499 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.237393 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:13.237499 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.237444 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:21.23743235 +0000 UTC m=+18.165065609 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:13.653334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:13.653303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:13.653508 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.653429 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:13.653508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:13.653490 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:13.653622 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.653563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:13.653622 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:13.653614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:13.653731 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:13.653682 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:15.649026 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:15.648986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:15.649026 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:15.649016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:15.649573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:15.648986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:15.649573 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:15.649124 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:15.649573 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:15.649181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:15.649573 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:15.649258 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:17.649735 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:17.649545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:17.649735 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:17.649545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:17.649735 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:17.649684 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:17.650214 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:17.649784 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:17.650214 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:17.649819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:17.650214 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:17.649928 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:19.651607 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:19.651577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:19.652098 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:19.651577 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:19.652098 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:19.651679 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:19.652098 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:19.651582 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:19.652098 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:19.651807 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:19.652098 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:19.651878 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:21.196640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:21.196605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:21.196640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:21.196642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:21.197096 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.196768 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:21.197096 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.196835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:37.196819601 +0000 UTC m=+34.124452874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:21.197096 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.196772 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:21.197096 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.196906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:37.196891904 +0000 UTC m=+34.124525165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:21.297757 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:21.297726 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:21.297902 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.297870 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:21.297902 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.297888 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:21.297902 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.297898 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:21.297996 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.297944 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:37.297931009 +0000 UTC m=+34.225564269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:21.649549 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:21.649513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:21.649728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:21.649524 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:21.649728 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.649633 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:21.649872 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.649793 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:21.649872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:21.649833 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:21.649979 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:21.649960 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:23.649640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:23.649511 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:23.649640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:23.649530 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:23.649640 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:23.649618 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:23.649640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:23.649640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:23.650295 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:23.649695 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:23.650295 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:23.649767 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:25.649894 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.649671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:25.650459 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:25.649997 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:25.650459 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.649848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:25.650459 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:25.650101 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:25.650459 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.649820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:25.650459 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:25.650179 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:25.804545 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.804284 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2v9c6" event={"ID":"9dc80248-a8f6-46db-b4f4-709ab9483e98","Type":"ContainerStarted","Data":"8b72fb06e26219c5e6218612a8c4968a46596e0403a4c6e0e9bc6137820428e6"} Jul 27 14:17:25.805972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.805946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" event={"ID":"a27b13dc-6809-44f9-919c-d98e8f1123fb","Type":"ContainerStarted","Data":"c7a557bfe794db6b9feaf5ab80af0b7e65a139a539b22497d14a92010207a9b9"} Jul 27 14:17:25.807572 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.807545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" event={"ID":"35d86f8dc10c2acea0b453421180560d","Type":"ContainerStarted","Data":"81705da489e9022648df3e64bf24bd80bc221504fe9270318c7164c3374da0ca"} Jul 27 14:17:25.809076 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.809057 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" event={"ID":"bf71a6e1-0893-461e-b2ac-518a1df0f93f","Type":"ContainerStarted","Data":"29f1ee0f4ed4d806814ff596822a7fcf9ff85cdaa3d67871a6ca88cef76dd88e"} Jul 27 14:17:25.810436 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.810405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-blx2n" event={"ID":"c676d3df-c2f0-4367-adcc-4a9850947bdc","Type":"ContainerStarted","Data":"a171951d5f16ababeaa2f6254f16d11097bc3ec2c745e28f7ffffa06a57d0a2d"} Jul 27 14:17:25.812165 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.812137 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"c0cc7bf30747490f453a5c20aad6b240eeaeaddc63223eac39d517c25650ad6d"} Jul 27 14:17:25.812298 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.812219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"023db256aaeaf9c671184eda978e01e9ae69cad4d894ea1b7465aa12189f11a1"} Jul 27 14:17:25.813376 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.813350 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trgmd" event={"ID":"b5dbd46e-019e-4696-a73a-12646e9a02e6","Type":"ContainerStarted","Data":"5d0db3d9c6c07287d16bab75af4f2635e1d4407e89732abda2d30b9ac86503b9"} Jul 27 14:17:25.814888 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.814862 2577 generic.go:356] "Generic (PLEG): container finished" podID="a874b4ad-7e47-49d1-8a8f-e7d90039a1a7" containerID="85a630f74d25c436cebf3cb5a0832bdd1b20a81dbfa7b47d4b0c4b39548a9573" exitCode=0 Jul 27 14:17:25.815003 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.814946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerDied","Data":"85a630f74d25c436cebf3cb5a0832bdd1b20a81dbfa7b47d4b0c4b39548a9573"} Jul 27 14:17:25.816510 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.816444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hfk6" event={"ID":"934d5a8e-bb6f-4b51-811c-0d4d081d143c","Type":"ContainerStarted","Data":"ddac54f49379654492b944afc24a1c1f655f2c1bf603806c8f7099e35adae8aa"} Jul 27 14:17:25.820644 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.820609 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2v9c6" podStartSLOduration=3.189354313 podStartE2EDuration="22.820599264s" totalImagesPullingTime="19.631244951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:25.820529451 +0000 UTC m=+22.748162746" watchObservedRunningTime="2026-07-27 14:17:25.820599264 +0000 UTC m=+22.748232546" Jul 27 14:17:25.821003 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.820979 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-60.ec2.internal" podStartSLOduration=20.820972685 podStartE2EDuration="20.820972685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:08.790411745 +0000 UTC m=+5.718045028" watchObservedRunningTime="2026-07-27 14:17:25.820972685 +0000 UTC m=+22.748605966" Jul 27 14:17:25.838277 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.838237 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5hfk6" podStartSLOduration=3.157417533 podStartE2EDuration="22.838225231s" totalImagesPullingTime="19.680807698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:25.837924732 +0000 UTC m=+22.765558026" watchObservedRunningTime="2026-07-27 14:17:25.838225231 +0000 UTC m=+22.765858512" Jul 27 14:17:25.845968 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.845945 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:25.846435 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.846419 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:25.874224 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.874183 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-60.ec2.internal" podStartSLOduration=20.874171317 podStartE2EDuration="20.874171317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:25.873861558 +0000 UTC m=+22.801494846" watchObservedRunningTime="2026-07-27 14:17:25.874171317 +0000 UTC m=+22.801804599" Jul 27 14:17:25.891127 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.891088 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-blx2n" podStartSLOduration=3.226571673 podStartE2EDuration="22.891075425s" totalImagesPullingTime="19.664503752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:25.89047853 +0000 UTC m=+22.818111811" watchObservedRunningTime="2026-07-27 14:17:25.891075425 +0000 UTC m=+22.818708706" Jul 27 14:17:25.915974 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.915932 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g2x4z" podStartSLOduration=3.27945378 podStartE2EDuration="22.915919876s" totalImagesPullingTime="19.636466096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:25.915790527 +0000 UTC m=+22.843423808" watchObservedRunningTime="2026-07-27 14:17:25.915919876 +0000 UTC m=+22.843553158" Jul 27 14:17:25.932411 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:25.932378 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-trgmd" podStartSLOduration=3.263020661 podStartE2EDuration="22.932366393s" totalImagesPullingTime="19.669345732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:25.932104586 +0000 UTC m=+22.859737869" watchObservedRunningTime="2026-07-27 14:17:25.932366393 +0000 UTC m=+22.859999675" Jul 27 14:17:26.822784 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.822741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"47fcfde83953369a11339b249b3c68f227de7f138b2e73db61f0206729df0dc6"} Jul 27 14:17:26.823429 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.822871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"1fbcebda1830630f7e31dedc8281ab4d0d0799d05686b560862f5165c13dd9d5"} Jul 27 14:17:26.823429 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.822924 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"7c2f7f134c74b97b7e005f0d3c424496b2fe8183df631f0200be9b5cf9f5a249"} Jul 27 14:17:26.823429 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.822971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"cbf56da4af0115fd14c1d08695540b6848baae40a33384d00ea7abaaa891b1d3"} Jul 27 14:17:26.824608 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.824558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78mn2" event={"ID":"2d4903fe-9140-46e9-9cd2-78b87ed4abb1","Type":"ContainerStarted","Data":"0855ff720211ace5b36897cfa017555a8cd82f4b828ad4038a3e6f45f1e1e754"} Jul 27 14:17:26.825403 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.825382 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:26.825729 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.825692 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-trgmd" Jul 27 14:17:26.840850 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:26.840807 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-78mn2" podStartSLOduration=4.182426453 podStartE2EDuration="23.840795061s" totalImagesPullingTime="19.658368608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:26.840317996 +0000 UTC m=+23.767951278" watchObservedRunningTime="2026-07-27 14:17:26.840795061 +0000 UTC m=+23.768428343" Jul 27 14:17:27.651995 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:27.651971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:27.652143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:27.652008 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:27.652143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:27.652008 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:27.652143 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:27.652096 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:27.652264 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:27.652155 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:27.652264 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:27.652218 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:27.689599 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:27.689566 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 14:17:27.828249 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:27.828162 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" event={"ID":"bf71a6e1-0893-461e-b2ac-518a1df0f93f","Type":"ContainerStarted","Data":"6ca5a306230d9c26804571f53e65c8b81f65754485bc0f44649e015cff2795b5"} Jul 27 14:17:28.540234 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:28.539978 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T14:17:27.689583614Z","UUID":"77b8a97b-5488-49f1-9fcc-a6f90d3623e7","Handler":null,"Name":"","Endpoint":""} Jul 27 14:17:28.541667 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:28.541645 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 14:17:28.541787 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:28.541680 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 14:17:28.834549 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:28.834471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"03337c4f6bd795a6858c1ae93a398194d41b97f2c331c5ec66da5f4f0c45ebad"} Jul 27 14:17:29.649005 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:29.648974 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:29.649005 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:29.648994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:29.649261 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:29.648977 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:29.649261 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:29.649111 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:29.649261 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:29.649186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:29.649261 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:29.649254 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:31.649344 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.649310 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:31.650023 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.649487 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:31.650023 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:31.649499 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:31.650023 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:31.649569 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:31.650023 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.649578 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:31.650023 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:31.649648 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:31.843054 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.843014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" event={"ID":"630f147a-b279-4728-80fb-08388320ed95","Type":"ContainerStarted","Data":"e278a3e7853c872013ce5cc3f66d6c82125632f175699680fc868c3950e5a000"} Jul 27 14:17:31.843296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.843269 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:31.843447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.843338 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:31.844819 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.844796 2577 generic.go:356] "Generic (PLEG): container finished" podID="a874b4ad-7e47-49d1-8a8f-e7d90039a1a7" containerID="c6b80c8a8917343a1f9403a064773c4d02b0a91a1888141666db7edbfa06c94e" exitCode=0 Jul 27 14:17:31.844916 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.844877 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerDied","Data":"c6b80c8a8917343a1f9403a064773c4d02b0a91a1888141666db7edbfa06c94e"} Jul 27 14:17:31.847231 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.847194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" event={"ID":"bf71a6e1-0893-461e-b2ac-518a1df0f93f","Type":"ContainerStarted","Data":"79d4cbb7ddee3fbb32613bbe0a6c31a1ae7e425553877be63c182bed6f712e67"} Jul 27 14:17:31.859672 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.859654 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:31.859822 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.859796 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:31.871798 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.871755 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" podStartSLOduration=9.144244542 podStartE2EDuration="28.871739923s" totalImagesPullingTime="19.727495381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:31.871391643 +0000 UTC m=+28.799024924" watchObservedRunningTime="2026-07-27 14:17:31.871739923 +0000 UTC m=+28.799373206" Jul 27 14:17:31.916424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:31.916344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rn8k9" podStartSLOduration=4.065313733 podStartE2EDuration="28.916330817s" totalImagesPullingTime="24.851017084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:31.915935344 +0000 UTC m=+28.843568626" watchObservedRunningTime="2026-07-27 14:17:31.916330817 +0000 UTC m=+28.843964099" Jul 27 14:17:32.849514 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:32.849488 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:17:33.324857 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.324662 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nxl7t"] Jul 27 14:17:33.325002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.324941 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:33.325047 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:33.325027 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:33.327644 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.327483 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whbh6"] Jul 27 14:17:33.327644 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.327629 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:33.327857 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:33.327748 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:33.328417 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.328390 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rp8n"] Jul 27 14:17:33.328513 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.328503 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:33.328630 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:33.328609 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:33.852259 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.852231 2577 generic.go:356] "Generic (PLEG): container finished" podID="a874b4ad-7e47-49d1-8a8f-e7d90039a1a7" containerID="5fd1e4649f82f470db915ce034bd68cd862900cadc6e4997f8a3dfbb993c7ecf" exitCode=0 Jul 27 14:17:33.852648 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:33.852306 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerDied","Data":"5fd1e4649f82f470db915ce034bd68cd862900cadc6e4997f8a3dfbb993c7ecf"} Jul 27 14:17:34.648975 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:34.648918 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:34.649082 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:34.649013 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:35.649456 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:35.649431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:35.650014 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:35.649458 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:35.650014 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:35.649548 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:35.650014 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:35.649655 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:35.859049 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:35.859022 2577 generic.go:356] "Generic (PLEG): container finished" podID="a874b4ad-7e47-49d1-8a8f-e7d90039a1a7" containerID="247e8334a13636fbe1474184f73c4fdd2918899c1b83577f85d14572f6948504" exitCode=0 Jul 27 14:17:35.859173 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:35.859080 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerDied","Data":"247e8334a13636fbe1474184f73c4fdd2918899c1b83577f85d14572f6948504"} Jul 27 14:17:36.648982 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:36.648950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:36.649154 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:36.649070 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whbh6" podUID="8e4a8cab-05ad-4c99-8461-5293ad3ff669" Jul 27 14:17:37.219894 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:37.219862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:37.219894 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:37.219899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:37.220538 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.220022 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:37.220538 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.220023 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:37.220538 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.220085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret podName:8e4a8cab-05ad-4c99-8461-5293ad3ff669 nodeName:}" failed. No retries permitted until 2026-07-27 14:18:09.220068097 +0000 UTC m=+66.147701357 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret") pod "global-pull-secret-syncer-whbh6" (UID: "8e4a8cab-05ad-4c99-8461-5293ad3ff669") : object "kube-system"/"original-pull-secret" not registered Jul 27 14:17:37.220538 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.220109 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs podName:13865f74-f907-40fe-9ad0-09ad853e1531 nodeName:}" failed. No retries permitted until 2026-07-27 14:18:09.220093078 +0000 UTC m=+66.147726343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs") pod "network-metrics-daemon-8rp8n" (UID: "13865f74-f907-40fe-9ad0-09ad853e1531") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 14:17:37.320791 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:37.320761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:37.320951 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.320934 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 14:17:37.321012 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.320956 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 14:17:37.321012 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.320965 2577 projected.go:196] Error preparing data for projected volume kube-api-access-vlfvk for pod openshift-network-diagnostics/network-check-target-nxl7t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:37.321095 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.321020 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk podName:c64ee3a8-cd70-4a40-acab-491bc4197b90 nodeName:}" failed. No retries permitted until 2026-07-27 14:18:09.321001803 +0000 UTC m=+66.248635065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vlfvk" (UniqueName: "kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk") pod "network-check-target-nxl7t" (UID: "c64ee3a8-cd70-4a40-acab-491bc4197b90") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 14:17:37.648943 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:37.648911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:37.649124 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.649042 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rp8n" podUID="13865f74-f907-40fe-9ad0-09ad853e1531" Jul 27 14:17:37.649124 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:37.649091 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:37.649250 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:37.649198 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nxl7t" podUID="c64ee3a8-cd70-4a40-acab-491bc4197b90" Jul 27 14:17:38.407618 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.407588 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-60.ec2.internal" event="NodeReady" Jul 27 14:17:38.408167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.407758 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 14:17:38.444673 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.444642 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d7c595fcc-rvlls"] Jul 27 14:17:38.447328 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.447303 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.450256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.450238 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrv8d\"" Jul 27 14:17:38.450568 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.450552 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 14:17:38.453631 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.453609 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 14:17:38.453849 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.453767 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 14:17:38.457412 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.457392 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 14:17:38.462389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.462339 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d7c595fcc-rvlls"] Jul 27 14:17:38.463033 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.463009 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d4vs9"] Jul 27 14:17:38.466007 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.465988 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pj5hp"] Jul 27 14:17:38.466134 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.466118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.468338 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.468315 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 14:17:38.468435 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.468372 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 14:17:38.468435 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.468405 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9kwzw\"" Jul 27 14:17:38.468917 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.468894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.471870 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.471728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 14:17:38.471870 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.471752 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fj826\"" Jul 27 14:17:38.471870 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.471859 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 14:17:38.472201 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.472183 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 14:17:38.476408 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.475951 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pj5hp"] Jul 27 14:17:38.478225 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.478202 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d4vs9"] Jul 27 14:17:38.632543 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-installation-pull-secrets\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.632724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr6hq\" (UniqueName: \"kubernetes.io/projected/57736bb5-55bd-45f0-aaf7-c1229e54a8bc-kube-api-access-pr6hq\") pod \"ingress-canary-pj5hp\" (UID: \"57736bb5-55bd-45f0-aaf7-c1229e54a8bc\") " pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.632724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc7xg\" (UniqueName: \"kubernetes.io/projected/d01b13ec-b607-425e-9ef0-ae71f22afad5-kube-api-access-jc7xg\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.632724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.632724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-image-registry-private-configuration\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.632724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01b13ec-b607-425e-9ef0-ae71f22afad5-tmp-dir\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.632951 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-bound-sa-token\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.632951 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632813 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-trusted-ca\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.632951 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57736bb5-55bd-45f0-aaf7-c1229e54a8bc-cert\") pod \"ingress-canary-pj5hp\" (UID: \"57736bb5-55bd-45f0-aaf7-c1229e54a8bc\") " pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.632951 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-ca-trust-extracted\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.632951 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-certificates\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.633139 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.633139 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.632988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klzsz\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-kube-api-access-klzsz\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.633139 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.633004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d01b13ec-b607-425e-9ef0-ae71f22afad5-config-volume\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.648772 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.648745 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:17:38.651399 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.651379 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 14:17:38.733958 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.733929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc7xg\" (UniqueName: \"kubernetes.io/projected/d01b13ec-b607-425e-9ef0-ae71f22afad5-kube-api-access-jc7xg\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.734111 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.733966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.734111 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-image-registry-private-configuration\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734111 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01b13ec-b607-425e-9ef0-ae71f22afad5-tmp-dir\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.734111 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-bound-sa-token\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734305 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-trusted-ca\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734305 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:38.734149 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 14:17:38.734305 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734162 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57736bb5-55bd-45f0-aaf7-c1229e54a8bc-cert\") pod \"ingress-canary-pj5hp\" (UID: \"57736bb5-55bd-45f0-aaf7-c1229e54a8bc\") " pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.734305 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-ca-trust-extracted\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734305 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:38.734229 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls podName:d01b13ec-b607-425e-9ef0-ae71f22afad5 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:39.234209941 +0000 UTC m=+36.161843215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls") pod "dns-default-d4vs9" (UID: "d01b13ec-b607-425e-9ef0-ae71f22afad5") : secret "dns-default-metrics-tls" not found Jul 27 14:17:38.734305 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-certificates\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734601 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734601 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klzsz\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-kube-api-access-klzsz\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734601 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d01b13ec-b607-425e-9ef0-ae71f22afad5-config-volume\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.734601 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-installation-pull-secrets\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734601 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr6hq\" (UniqueName: \"kubernetes.io/projected/57736bb5-55bd-45f0-aaf7-c1229e54a8bc-kube-api-access-pr6hq\") pod \"ingress-canary-pj5hp\" (UID: \"57736bb5-55bd-45f0-aaf7-c1229e54a8bc\") " pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.734601 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734582 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-ca-trust-extracted\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.734978 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.734803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01b13ec-b607-425e-9ef0-ae71f22afad5-tmp-dir\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.734978 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:38.734918 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 14:17:38.734978 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:38.734934 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7c595fcc-rvlls: secret "image-registry-tls" not found Jul 27 14:17:38.734978 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:38.734976 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls podName:f1ba90fc-17d2-4c02-b130-3cf9d55349f2 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:39.23496188 +0000 UTC m=+36.162595153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls") pod "image-registry-6d7c595fcc-rvlls" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2") : secret "image-registry-tls" not found Jul 27 14:17:38.735381 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.735358 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d01b13ec-b607-425e-9ef0-ae71f22afad5-config-volume\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.735529 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.735442 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-trusted-ca\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.735529 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.735445 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-certificates\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.739204 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.739183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57736bb5-55bd-45f0-aaf7-c1229e54a8bc-cert\") pod \"ingress-canary-pj5hp\" (UID: \"57736bb5-55bd-45f0-aaf7-c1229e54a8bc\") " pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.739307 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.739249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-installation-pull-secrets\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.739371 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.739318 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-image-registry-private-configuration\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.743103 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.743079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc7xg\" (UniqueName: \"kubernetes.io/projected/d01b13ec-b607-425e-9ef0-ae71f22afad5-kube-api-access-jc7xg\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:38.743214 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.743126 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr6hq\" (UniqueName: \"kubernetes.io/projected/57736bb5-55bd-45f0-aaf7-c1229e54a8bc-kube-api-access-pr6hq\") pod \"ingress-canary-pj5hp\" (UID: \"57736bb5-55bd-45f0-aaf7-c1229e54a8bc\") " pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.743374 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.743340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-bound-sa-token\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.743587 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.743566 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klzsz\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-kube-api-access-klzsz\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:38.786200 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.786172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pj5hp" Jul 27 14:17:38.935995 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:38.935804 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pj5hp"] Jul 27 14:17:38.940285 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:17:38.940256 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57736bb5_55bd_45f0_aaf7_c1229e54a8bc.slice/crio-a12f3a32ef48eebb6b467a2ee66cebc14e6d98ef497c2afae18188bc0dc7f3f2 WatchSource:0}: Error finding container a12f3a32ef48eebb6b467a2ee66cebc14e6d98ef497c2afae18188bc0dc7f3f2: Status 404 returned error can't find the container with id a12f3a32ef48eebb6b467a2ee66cebc14e6d98ef497c2afae18188bc0dc7f3f2 Jul 27 14:17:39.239147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.239113 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:39.239316 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.239184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:39.239316 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:39.239274 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 14:17:39.239316 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:39.239293 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7c595fcc-rvlls: secret "image-registry-tls" not found Jul 27 14:17:39.239431 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:39.239346 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls podName:f1ba90fc-17d2-4c02-b130-3cf9d55349f2 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:40.239331246 +0000 UTC m=+37.166964531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls") pod "image-registry-6d7c595fcc-rvlls" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2") : secret "image-registry-tls" not found Jul 27 14:17:39.239431 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:39.239353 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 14:17:39.239431 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:39.239409 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls podName:d01b13ec-b607-425e-9ef0-ae71f22afad5 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:40.239397204 +0000 UTC m=+37.167030464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls") pod "dns-default-d4vs9" (UID: "d01b13ec-b607-425e-9ef0-ae71f22afad5") : secret "dns-default-metrics-tls" not found Jul 27 14:17:39.649604 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.649520 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:17:39.650137 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.649761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:17:39.652484 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.652461 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 14:17:39.652583 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.652566 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 14:17:39.653494 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.653477 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 14:17:39.653579 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.653533 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmpms\"" Jul 27 14:17:39.653579 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.653565 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nn5ms\"" Jul 27 14:17:39.869965 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:39.869923 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pj5hp" event={"ID":"57736bb5-55bd-45f0-aaf7-c1229e54a8bc","Type":"ContainerStarted","Data":"a12f3a32ef48eebb6b467a2ee66cebc14e6d98ef497c2afae18188bc0dc7f3f2"} Jul 27 14:17:40.249029 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:40.248989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:40.249203 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:40.249050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:40.249203 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:40.249144 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 14:17:40.249203 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:40.249174 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7c595fcc-rvlls: secret "image-registry-tls" not found Jul 27 14:17:40.249203 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:40.249155 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 14:17:40.249378 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:40.249234 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls podName:f1ba90fc-17d2-4c02-b130-3cf9d55349f2 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:42.249212397 +0000 UTC m=+39.176845657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls") pod "image-registry-6d7c595fcc-rvlls" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2") : secret "image-registry-tls" not found Jul 27 14:17:40.249378 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:40.249251 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls podName:d01b13ec-b607-425e-9ef0-ae71f22afad5 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:42.249243756 +0000 UTC m=+39.176877017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls") pod "dns-default-d4vs9" (UID: "d01b13ec-b607-425e-9ef0-ae71f22afad5") : secret "dns-default-metrics-tls" not found Jul 27 14:17:41.881331 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:41.881292 2577 generic.go:356] "Generic (PLEG): container finished" podID="a874b4ad-7e47-49d1-8a8f-e7d90039a1a7" containerID="274fd2b046e3544e7239dddedc0c7e866ef79b6c08dbb089a7ed6c7abce8d666" exitCode=0 Jul 27 14:17:41.881728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:41.881372 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerDied","Data":"274fd2b046e3544e7239dddedc0c7e866ef79b6c08dbb089a7ed6c7abce8d666"} Jul 27 14:17:42.264294 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:42.264112 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:42.264443 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:42.264252 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 14:17:42.264443 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:42.264410 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls podName:d01b13ec-b607-425e-9ef0-ae71f22afad5 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:46.26439289 +0000 UTC m=+43.192026154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls") pod "dns-default-d4vs9" (UID: "d01b13ec-b607-425e-9ef0-ae71f22afad5") : secret "dns-default-metrics-tls" not found Jul 27 14:17:42.264443 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:42.264351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:42.264557 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:42.264424 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 14:17:42.264557 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:42.264473 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7c595fcc-rvlls: secret "image-registry-tls" not found Jul 27 14:17:42.264557 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:42.264512 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls podName:f1ba90fc-17d2-4c02-b130-3cf9d55349f2 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:46.264500604 +0000 UTC m=+43.192133868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls") pod "image-registry-6d7c595fcc-rvlls" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2") : secret "image-registry-tls" not found Jul 27 14:17:42.887482 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:42.887446 2577 generic.go:356] "Generic (PLEG): container finished" podID="a874b4ad-7e47-49d1-8a8f-e7d90039a1a7" containerID="137aef9bfa5be1d20245c836a5f6c49f5d04ee1ab3e71a9a91cef00f0f55aba7" exitCode=0 Jul 27 14:17:42.887917 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:42.887493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerDied","Data":"137aef9bfa5be1d20245c836a5f6c49f5d04ee1ab3e71a9a91cef00f0f55aba7"} Jul 27 14:17:43.891294 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:43.891262 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pj5hp" event={"ID":"57736bb5-55bd-45f0-aaf7-c1229e54a8bc","Type":"ContainerStarted","Data":"fbcf9d3aff14dcc46dfe7c3ab40ccfc99f60920eb6e3cb825e2e40486075890a"} Jul 27 14:17:43.894310 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:43.894285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" event={"ID":"a874b4ad-7e47-49d1-8a8f-e7d90039a1a7","Type":"ContainerStarted","Data":"1aa73c7bbc983fff6afbbb2bd2f68e8c097a5afbfebd97327dd10e09bba8a30c"} Jul 27 14:17:43.912393 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:43.912345 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pj5hp" podStartSLOduration=1.414385594 podStartE2EDuration="5.912332056s" totalImagesPullingTime="4.497946462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:43.911195904 +0000 UTC m=+40.838829187" watchObservedRunningTime="2026-07-27 14:17:43.912332056 +0000 UTC m=+40.839965339" Jul 27 14:17:43.935349 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:43.935297 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zbfkv" podStartSLOduration=8.653910765 podStartE2EDuration="40.935278244s" totalImagesPullingTime="32.281367479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:17:43.933619776 +0000 UTC m=+40.861253057" watchObservedRunningTime="2026-07-27 14:17:43.935278244 +0000 UTC m=+40.862911526" Jul 27 14:17:45.072953 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.072920 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w4rdh"] Jul 27 14:17:45.094845 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.094811 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4rdh"] Jul 27 14:17:45.094992 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.094910 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.100369 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.100344 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5xtg\"" Jul 27 14:17:45.100490 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.100430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 14:17:45.100490 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.100436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 14:17:45.101241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.101061 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 14:17:45.101328 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.101310 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 14:17:45.184528 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.184496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.184672 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.184552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4c56\" (UniqueName: \"kubernetes.io/projected/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-api-access-x4c56\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.184672 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.184576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-crio-socket\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.184672 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.184628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-data-volume\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.184793 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.184740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.285951 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.285922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.286095 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.285976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4c56\" (UniqueName: \"kubernetes.io/projected/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-api-access-x4c56\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.286095 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.285997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-crio-socket\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.286095 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.286022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-data-volume\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.286095 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.286064 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 14:17:45.286275 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.286070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.286275 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.286119 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 14:17:45.286275 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.286120 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:45.786105046 +0000 UTC m=+42.713738306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : secret "insights-runtime-extractor-tls" not found Jul 27 14:17:45.286275 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.286238 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:45.786212326 +0000 UTC m=+42.713845587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : configmap "kube-rbac-proxy" not found Jul 27 14:17:45.286419 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.286270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-crio-socket\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.286419 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.286354 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-data-volume\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.296714 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.296676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4c56\" (UniqueName: \"kubernetes.io/projected/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-api-access-x4c56\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.789489 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.789450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.789697 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:45.789557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:45.789697 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.789605 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 14:17:45.789697 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.789621 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 14:17:45.789697 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.789670 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:46.789654821 +0000 UTC m=+43.717288080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : secret "insights-runtime-extractor-tls" not found Jul 27 14:17:45.789697 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:45.789685 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:46.789679078 +0000 UTC m=+43.717312338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : configmap "kube-rbac-proxy" not found Jul 27 14:17:46.292929 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:46.292897 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:46.293348 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:46.292957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:46.293348 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.293053 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 14:17:46.293348 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.293069 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 14:17:46.293348 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.293096 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7c595fcc-rvlls: secret "image-registry-tls" not found Jul 27 14:17:46.293348 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.293103 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls podName:d01b13ec-b607-425e-9ef0-ae71f22afad5 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:54.293089546 +0000 UTC m=+51.220722809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls") pod "dns-default-d4vs9" (UID: "d01b13ec-b607-425e-9ef0-ae71f22afad5") : secret "dns-default-metrics-tls" not found Jul 27 14:17:46.293348 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.293149 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls podName:f1ba90fc-17d2-4c02-b130-3cf9d55349f2 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:54.293131348 +0000 UTC m=+51.220764625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls") pod "image-registry-6d7c595fcc-rvlls" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2") : secret "image-registry-tls" not found Jul 27 14:17:46.797311 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:46.797275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:46.797465 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:46.797325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:46.797465 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.797392 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 14:17:46.797547 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.797469 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:48.797454631 +0000 UTC m=+45.725087891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : configmap "kube-rbac-proxy" not found Jul 27 14:17:46.797547 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.797476 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 14:17:46.797547 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:46.797520 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:48.797507996 +0000 UTC m=+45.725141256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : secret "insights-runtime-extractor-tls" not found Jul 27 14:17:47.042106 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:47.042078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-blx2n_c676d3df-c2f0-4367-adcc-4a9850947bdc/dns-node-resolver/0.log" Jul 27 14:17:47.843358 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:47.843329 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2v9c6_9dc80248-a8f6-46db-b4f4-709ab9483e98/node-ca/0.log" Jul 27 14:17:48.813539 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:48.813503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:48.813743 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:48.813544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:48.813743 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:48.813649 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 14:17:48.813743 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:48.813720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:17:52.813689541 +0000 UTC m=+49.741322803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : secret "insights-runtime-extractor-tls" not found Jul 27 14:17:48.814048 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:48.814028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:49.042448 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:49.042413 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pj5hp_57736bb5-55bd-45f0-aaf7-c1229e54a8bc/serve-healthcheck-canary/0.log" Jul 27 14:17:52.844678 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:52.844640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:17:52.845068 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:52.844788 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 14:17:52.845068 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:52.844851 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls podName:c7057f7f-861c-41ea-a7bd-30dc7d01a0e4 nodeName:}" failed. No retries permitted until 2026-07-27 14:18:00.844836576 +0000 UTC m=+57.772469851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w4rdh" (UID: "c7057f7f-861c-41ea-a7bd-30dc7d01a0e4") : secret "insights-runtime-extractor-tls" not found Jul 27 14:17:54.355325 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:54.355281 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:17:54.355836 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:54.355430 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 14:17:54.355836 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:17:54.355441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") pod \"image-registry-6d7c595fcc-rvlls\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:17:54.355836 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:54.355491 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls podName:d01b13ec-b607-425e-9ef0-ae71f22afad5 nodeName:}" failed. No retries permitted until 2026-07-27 14:18:10.355474322 +0000 UTC m=+67.283107585 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls") pod "dns-default-d4vs9" (UID: "d01b13ec-b607-425e-9ef0-ae71f22afad5") : secret "dns-default-metrics-tls" not found Jul 27 14:17:54.355836 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:54.355540 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 14:17:54.355836 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:54.355558 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d7c595fcc-rvlls: secret "image-registry-tls" not found Jul 27 14:17:54.355836 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:17:54.355616 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls podName:f1ba90fc-17d2-4c02-b130-3cf9d55349f2 nodeName:}" failed. No retries permitted until 2026-07-27 14:18:10.35560326 +0000 UTC m=+67.283236542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls") pod "image-registry-6d7c595fcc-rvlls" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2") : secret "image-registry-tls" not found Jul 27 14:18:00.900329 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:00.900293 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:18:00.902437 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:00.902417 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7057f7f-861c-41ea-a7bd-30dc7d01a0e4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w4rdh\" (UID: \"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4\") " pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:18:01.003637 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:01.003593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w4rdh" Jul 27 14:18:01.119978 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:01.119946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w4rdh"] Jul 27 14:18:01.122801 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:01.122768 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7057f7f_861c_41ea_a7bd_30dc7d01a0e4.slice/crio-aff5b503fcd153e61731d14c7b1380a5e7a1e297e6ddf226c22ce271e8112bf0 WatchSource:0}: Error finding container aff5b503fcd153e61731d14c7b1380a5e7a1e297e6ddf226c22ce271e8112bf0: Status 404 returned error can't find the container with id aff5b503fcd153e61731d14c7b1380a5e7a1e297e6ddf226c22ce271e8112bf0 Jul 27 14:18:01.939539 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:01.939450 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4rdh" event={"ID":"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4","Type":"ContainerStarted","Data":"aff5b503fcd153e61731d14c7b1380a5e7a1e297e6ddf226c22ce271e8112bf0"} Jul 27 14:18:03.869222 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:03.869196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c77qg" Jul 27 14:18:06.954746 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:06.954659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4rdh" event={"ID":"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4","Type":"ContainerStarted","Data":"6d0419044731475c2719dc8f9a1497716ec6bb842db917903983020b513bb958"} Jul 27 14:18:07.890997 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.890961 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd"] Jul 27 14:18:07.897155 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.897132 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:07.901274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.901235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 27 14:18:07.901274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.901246 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 14:18:07.901467 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.901242 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 14:18:07.901467 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.901235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 14:18:07.908670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.908648 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd"] Jul 27 14:18:07.938903 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.938879 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7c595fcc-rvlls"] Jul 27 14:18:07.939091 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:07.939069 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" podUID="f1ba90fc-17d2-4c02-b130-3cf9d55349f2" Jul 27 14:18:07.956872 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.956851 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:18:07.959262 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.959238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdjf4\" (UniqueName: \"kubernetes.io/projected/2581d178-bbfa-4a51-8fcd-b28415048c45-kube-api-access-gdjf4\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:07.959377 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.959287 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2581d178-bbfa-4a51-8fcd-b28415048c45-tmp\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:07.959377 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.959356 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2581d178-bbfa-4a51-8fcd-b28415048c45-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:07.964762 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:07.964737 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:18:08.002770 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.002735 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67c9fd5fd-zcbvc"] Jul 27 14:18:08.008894 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.008874 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.022085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.022065 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c9fd5fd-zcbvc"] Jul 27 14:18:08.060567 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060539 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-bound-sa-token\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.060751 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060599 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-image-registry-private-configuration\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.060751 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060624 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-trusted-ca\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.060751 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060658 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klzsz\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-kube-api-access-klzsz\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.060751 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060687 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-installation-pull-secrets\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.060751 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060726 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-certificates\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.061013 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060754 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-ca-trust-extracted\") pod \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\" (UID: \"f1ba90fc-17d2-4c02-b130-3cf9d55349f2\") " Jul 27 14:18:08.061013 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89d60295-85b5-41e0-a93c-9f4c77979d49-ca-trust-extracted\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061013 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89d60295-85b5-41e0-a93c-9f4c77979d49-trusted-ca\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061013 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.060980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89d60295-85b5-41e0-a93c-9f4c77979d49-image-registry-private-configuration\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061205 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-bound-sa-token\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061205 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2581d178-bbfa-4a51-8fcd-b28415048c45-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.061205 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89d60295-85b5-41e0-a93c-9f4c77979d49-installation-pull-secrets\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061205 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxdq6\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-kube-api-access-sxdq6\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061205 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061158 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 14:18:08.061205 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdjf4\" (UniqueName: \"kubernetes.io/projected/2581d178-bbfa-4a51-8fcd-b28415048c45-kube-api-access-gdjf4\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.061464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061185 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:18:08.061464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-registry-tls\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2581d178-bbfa-4a51-8fcd-b28415048c45-tmp\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.061699 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89d60295-85b5-41e0-a93c-9f4c77979d49-registry-certificates\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.061805 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061734 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-trusted-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.061805 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061747 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:18:08.061805 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.061757 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-ca-trust-extracted\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.062072 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.062018 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2581d178-bbfa-4a51-8fcd-b28415048c45-tmp\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.063591 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.063553 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:18:08.063774 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.063737 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-kube-api-access-klzsz" (OuterVolumeSpecName: "kube-api-access-klzsz") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "kube-api-access-klzsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:18:08.064400 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.064376 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:18:08.064648 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.064628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2581d178-bbfa-4a51-8fcd-b28415048c45-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.064802 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.064783 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f1ba90fc-17d2-4c02-b130-3cf9d55349f2" (UID: "f1ba90fc-17d2-4c02-b130-3cf9d55349f2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:18:08.078957 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.078934 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdjf4\" (UniqueName: \"kubernetes.io/projected/2581d178-bbfa-4a51-8fcd-b28415048c45-kube-api-access-gdjf4\") pod \"klusterlet-addon-workmgr-6c57d57f6b-cqrpd\" (UID: \"2581d178-bbfa-4a51-8fcd-b28415048c45\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.162290 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-registry-tls\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162290 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162255 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89d60295-85b5-41e0-a93c-9f4c77979d49-registry-certificates\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162290 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89d60295-85b5-41e0-a93c-9f4c77979d49-ca-trust-extracted\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162550 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89d60295-85b5-41e0-a93c-9f4c77979d49-trusted-ca\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162550 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89d60295-85b5-41e0-a93c-9f4c77979d49-image-registry-private-configuration\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162550 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-bound-sa-token\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162550 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162438 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89d60295-85b5-41e0-a93c-9f4c77979d49-installation-pull-secrets\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162550 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdq6\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-kube-api-access-sxdq6\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.162550 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162540 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-bound-sa-token\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.162893 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162556 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klzsz\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-kube-api-access-klzsz\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.162893 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162572 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-certificates\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.162893 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162588 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-image-registry-private-configuration\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.162893 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162603 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-installation-pull-secrets\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:08.163085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.162916 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/89d60295-85b5-41e0-a93c-9f4c77979d49-ca-trust-extracted\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.163141 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.163095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/89d60295-85b5-41e0-a93c-9f4c77979d49-registry-certificates\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.163368 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.163343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89d60295-85b5-41e0-a93c-9f4c77979d49-trusted-ca\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.165056 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.165030 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-registry-tls\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.165388 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.165366 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/89d60295-85b5-41e0-a93c-9f4c77979d49-image-registry-private-configuration\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.165645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.165627 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/89d60295-85b5-41e0-a93c-9f4c77979d49-installation-pull-secrets\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.173822 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.173799 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-bound-sa-token\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.174003 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.173977 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxdq6\" (UniqueName: \"kubernetes.io/projected/89d60295-85b5-41e0-a93c-9f4c77979d49-kube-api-access-sxdq6\") pod \"image-registry-67c9fd5fd-zcbvc\" (UID: \"89d60295-85b5-41e0-a93c-9f4c77979d49\") " pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.208343 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.208315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:08.321618 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.321590 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qrv8d\"" Jul 27 14:18:08.329622 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.329602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:08.959486 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.959455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d7c595fcc-rvlls" Jul 27 14:18:08.993142 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.993114 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d7c595fcc-rvlls"] Jul 27 14:18:08.997285 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:08.997260 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d7c595fcc-rvlls"] Jul 27 14:18:09.070166 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.070137 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f1ba90fc-17d2-4c02-b130-3cf9d55349f2-registry-tls\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:18:09.271178 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.271138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:18:09.271353 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.271197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:18:09.273792 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.273765 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 14:18:09.273974 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.273811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 14:18:09.284196 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.284169 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13865f74-f907-40fe-9ad0-09ad853e1531-metrics-certs\") pod \"network-metrics-daemon-8rp8n\" (UID: \"13865f74-f907-40fe-9ad0-09ad853e1531\") " pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:18:09.284196 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.284192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e4a8cab-05ad-4c99-8461-5293ad3ff669-original-pull-secret\") pod \"global-pull-secret-syncer-whbh6\" (UID: \"8e4a8cab-05ad-4c99-8461-5293ad3ff669\") " pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:18:09.369800 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.369765 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nn5ms\"" Jul 27 14:18:09.372019 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.371989 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:18:09.374052 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.374031 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 14:18:09.377969 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.377947 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rp8n" Jul 27 14:18:09.384433 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.384411 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 14:18:09.395265 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.395246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlfvk\" (UniqueName: \"kubernetes.io/projected/c64ee3a8-cd70-4a40-acab-491bc4197b90-kube-api-access-vlfvk\") pod \"network-check-target-nxl7t\" (UID: \"c64ee3a8-cd70-4a40-acab-491bc4197b90\") " pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:18:09.464390 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.464357 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-xx9rd"] Jul 27 14:18:09.469238 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.469216 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:09.471657 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.471631 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 14:18:09.471998 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.471980 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pbmwb\"" Jul 27 14:18:09.472092 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.472017 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 14:18:09.475788 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.475753 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xx9rd"] Jul 27 14:18:09.559519 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.559448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whbh6" Jul 27 14:18:09.573341 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.573316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkbmn\" (UniqueName: \"kubernetes.io/projected/1fd5e6c1-164b-41c6-ba9d-5df83ed57094-kube-api-access-kkbmn\") pod \"downloads-7c97dc4555-xx9rd\" (UID: \"1fd5e6c1-164b-41c6-ba9d-5df83ed57094\") " pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:09.652141 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.652113 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ba90fc-17d2-4c02-b130-3cf9d55349f2" path="/var/lib/kubelet/pods/f1ba90fc-17d2-4c02-b130-3cf9d55349f2/volumes" Jul 27 14:18:09.665338 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.665317 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mmpms\"" Jul 27 14:18:09.673490 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.673465 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:18:09.673697 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.673676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkbmn\" (UniqueName: \"kubernetes.io/projected/1fd5e6c1-164b-41c6-ba9d-5df83ed57094-kube-api-access-kkbmn\") pod \"downloads-7c97dc4555-xx9rd\" (UID: \"1fd5e6c1-164b-41c6-ba9d-5df83ed57094\") " pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:09.684895 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.684872 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkbmn\" (UniqueName: \"kubernetes.io/projected/1fd5e6c1-164b-41c6-ba9d-5df83ed57094-kube-api-access-kkbmn\") pod \"downloads-7c97dc4555-xx9rd\" (UID: \"1fd5e6c1-164b-41c6-ba9d-5df83ed57094\") " pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:09.779389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.779358 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:09.899288 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.899256 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67c9fd5fd-zcbvc"] Jul 27 14:18:09.963923 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.963890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4rdh" event={"ID":"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4","Type":"ContainerStarted","Data":"9adeb2fc1bcb4707c84b343e36441e231647fb0c4acde9732830037219587278"} Jul 27 14:18:09.964916 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.964890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" event={"ID":"89d60295-85b5-41e0-a93c-9f4c77979d49","Type":"ContainerStarted","Data":"be6efb805d9f1fa1d4cb74b8165ce76d006b3fe64b6edacd982f51ed5585e4fd"} Jul 27 14:18:09.980693 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:09.980671 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-xx9rd"] Jul 27 14:18:09.983673 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:09.983651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd5e6c1_164b_41c6_ba9d_5df83ed57094.slice/crio-9842826f15147e882c67fa431b36884adcfbf0bb580293de805c561d54bcb9d9 WatchSource:0}: Error finding container 9842826f15147e882c67fa431b36884adcfbf0bb580293de805c561d54bcb9d9: Status 404 returned error can't find the container with id 9842826f15147e882c67fa431b36884adcfbf0bb580293de805c561d54bcb9d9 Jul 27 14:18:10.125483 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.125405 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whbh6"] Jul 27 14:18:10.128915 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:10.128281 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4a8cab_05ad_4c99_8461_5293ad3ff669.slice/crio-5cb5558e744962365c681ae064a0ef644b172a3876bbfce5a2f924f290782191 WatchSource:0}: Error finding container 5cb5558e744962365c681ae064a0ef644b172a3876bbfce5a2f924f290782191: Status 404 returned error can't find the container with id 5cb5558e744962365c681ae064a0ef644b172a3876bbfce5a2f924f290782191 Jul 27 14:18:10.129966 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.129943 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rp8n"] Jul 27 14:18:10.131592 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.130855 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nxl7t"] Jul 27 14:18:10.131838 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.131798 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd"] Jul 27 14:18:10.133610 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:10.133572 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64ee3a8_cd70_4a40_acab_491bc4197b90.slice/crio-55102572e5ead52a8495937268a330c0988f7479405c21aead10a7f2ed42207f WatchSource:0}: Error finding container 55102572e5ead52a8495937268a330c0988f7479405c21aead10a7f2ed42207f: Status 404 returned error can't find the container with id 55102572e5ead52a8495937268a330c0988f7479405c21aead10a7f2ed42207f Jul 27 14:18:10.134397 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:10.134373 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13865f74_f907_40fe_9ad0_09ad853e1531.slice/crio-104d12b2d1a765bdf54456f04178f9358e8007a5992e9f140ae375dc2f5a1ec3 WatchSource:0}: Error finding container 104d12b2d1a765bdf54456f04178f9358e8007a5992e9f140ae375dc2f5a1ec3: Status 404 returned error can't find the container with id 104d12b2d1a765bdf54456f04178f9358e8007a5992e9f140ae375dc2f5a1ec3 Jul 27 14:18:10.136723 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:10.136671 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2581d178_bbfa_4a51_8fcd_b28415048c45.slice/crio-e592cc0e184d20d9273f46ecd04c8b0da3185a57e055eea70ca06ddc51851990 WatchSource:0}: Error finding container e592cc0e184d20d9273f46ecd04c8b0da3185a57e055eea70ca06ddc51851990: Status 404 returned error can't find the container with id e592cc0e184d20d9273f46ecd04c8b0da3185a57e055eea70ca06ddc51851990 Jul 27 14:18:10.378819 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.378729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:18:10.381941 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.381914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d01b13ec-b607-425e-9ef0-ae71f22afad5-metrics-tls\") pod \"dns-default-d4vs9\" (UID: \"d01b13ec-b607-425e-9ef0-ae71f22afad5\") " pod="openshift-dns/dns-default-d4vs9" Jul 27 14:18:10.584175 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.583950 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9kwzw\"" Jul 27 14:18:10.591252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.591226 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d4vs9" Jul 27 14:18:10.751275 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.751236 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d4vs9"] Jul 27 14:18:10.757259 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:10.757175 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd01b13ec_b607_425e_9ef0_ae71f22afad5.slice/crio-f2c4ee9ba1220145ff65ce08b9f8bd8c425dd6fce830989a3b65420f0e6b19e3 WatchSource:0}: Error finding container f2c4ee9ba1220145ff65ce08b9f8bd8c425dd6fce830989a3b65420f0e6b19e3: Status 404 returned error can't find the container with id f2c4ee9ba1220145ff65ce08b9f8bd8c425dd6fce830989a3b65420f0e6b19e3 Jul 27 14:18:10.972959 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.972851 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xx9rd" event={"ID":"1fd5e6c1-164b-41c6-ba9d-5df83ed57094","Type":"ContainerStarted","Data":"9842826f15147e882c67fa431b36884adcfbf0bb580293de805c561d54bcb9d9"} Jul 27 14:18:10.974515 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.974484 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rp8n" event={"ID":"13865f74-f907-40fe-9ad0-09ad853e1531","Type":"ContainerStarted","Data":"104d12b2d1a765bdf54456f04178f9358e8007a5992e9f140ae375dc2f5a1ec3"} Jul 27 14:18:10.976669 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.976645 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" event={"ID":"2581d178-bbfa-4a51-8fcd-b28415048c45","Type":"ContainerStarted","Data":"e592cc0e184d20d9273f46ecd04c8b0da3185a57e055eea70ca06ddc51851990"} Jul 27 14:18:10.978849 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.978827 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" event={"ID":"89d60295-85b5-41e0-a93c-9f4c77979d49","Type":"ContainerStarted","Data":"884dadc44cfd3578e0ac3dd2578586593dc4089b57ea7de5a61c7025da4a6c5f"} Jul 27 14:18:10.979236 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.979191 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:10.981366 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.981339 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4vs9" event={"ID":"d01b13ec-b607-425e-9ef0-ae71f22afad5","Type":"ContainerStarted","Data":"f2c4ee9ba1220145ff65ce08b9f8bd8c425dd6fce830989a3b65420f0e6b19e3"} Jul 27 14:18:10.983057 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.983001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nxl7t" event={"ID":"c64ee3a8-cd70-4a40-acab-491bc4197b90","Type":"ContainerStarted","Data":"55102572e5ead52a8495937268a330c0988f7479405c21aead10a7f2ed42207f"} Jul 27 14:18:10.984932 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:10.984910 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whbh6" event={"ID":"8e4a8cab-05ad-4c99-8461-5293ad3ff669","Type":"ContainerStarted","Data":"5cb5558e744962365c681ae064a0ef644b172a3876bbfce5a2f924f290782191"} Jul 27 14:18:11.001901 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:11.001853 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" podStartSLOduration=4.001835695 podStartE2EDuration="4.001835695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:11.000071097 +0000 UTC m=+67.927704398" watchObservedRunningTime="2026-07-27 14:18:11.001835695 +0000 UTC m=+67.929468978" Jul 27 14:18:12.998750 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:12.998153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rp8n" event={"ID":"13865f74-f907-40fe-9ad0-09ad853e1531","Type":"ContainerStarted","Data":"0df3eae02d600dcc759ec6ffbaf94bb1f8a207441f05f4ad8768f9343709cf4b"} Jul 27 14:18:12.998750 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:12.998225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rp8n" event={"ID":"13865f74-f907-40fe-9ad0-09ad853e1531","Type":"ContainerStarted","Data":"1d2dfd7df33912a8c218ad3114447975d37fa901e714626028b9cf19c6f7e1d9"} Jul 27 14:18:13.018003 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:13.017840 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8rp8n" podStartSLOduration=68.019386011 podStartE2EDuration="1m10.017817409s" totalImagesPullingTime="1.998431398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:13.016374299 +0000 UTC m=+69.944007583" watchObservedRunningTime="2026-07-27 14:18:13.017817409 +0000 UTC m=+69.945450693" Jul 27 14:18:15.877403 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:15.877364 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp"] Jul 27 14:18:15.879566 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:15.879539 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:15.882628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:15.882411 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 27 14:18:15.882628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:15.882454 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-g4gp9\"" Jul 27 14:18:15.892853 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:15.892801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp"] Jul 27 14:18:15.925147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:15.925105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b259b92-fe71-4ca0-b9d5-6c7136d7684e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-v8tzp\" (UID: \"3b259b92-fe71-4ca0-b9d5-6c7136d7684e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:16.026538 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:16.026500 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b259b92-fe71-4ca0-b9d5-6c7136d7684e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-v8tzp\" (UID: \"3b259b92-fe71-4ca0-b9d5-6c7136d7684e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:16.026744 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:16.026666 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 27 14:18:16.026824 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:16.026769 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b259b92-fe71-4ca0-b9d5-6c7136d7684e-tls-certificates podName:3b259b92-fe71-4ca0-b9d5-6c7136d7684e nodeName:}" failed. No retries permitted until 2026-07-27 14:18:16.526743449 +0000 UTC m=+73.454376710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3b259b92-fe71-4ca0-b9d5-6c7136d7684e-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" (UID: "3b259b92-fe71-4ca0-b9d5-6c7136d7684e") : secret "prometheus-operator-admission-webhook-tls" not found Jul 27 14:18:16.530255 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:16.530209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b259b92-fe71-4ca0-b9d5-6c7136d7684e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-v8tzp\" (UID: \"3b259b92-fe71-4ca0-b9d5-6c7136d7684e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:16.533374 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:16.533334 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3b259b92-fe71-4ca0-b9d5-6c7136d7684e-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-v8tzp\" (UID: \"3b259b92-fe71-4ca0-b9d5-6c7136d7684e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:16.791469 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:16.791382 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:18.436263 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.436232 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-686b588bdf-56h5t"] Jul 27 14:18:18.440491 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.440464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.443636 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.443614 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 14:18:18.444039 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.443874 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 14:18:18.444692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.444667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 14:18:18.444830 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.444811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dkwv6\"" Jul 27 14:18:18.444931 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.444910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 14:18:18.445085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.445065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 14:18:18.459034 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.459006 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686b588bdf-56h5t"] Jul 27 14:18:18.545034 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.544998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-service-ca\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.545233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.545067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snvmk\" (UniqueName: \"kubernetes.io/projected/fbfa761f-a956-41e0-9504-30386fb2b07a-kube-api-access-snvmk\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.545233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.545126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-oauth-serving-cert\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.545233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.545152 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-serving-cert\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.545233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.545177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-oauth-config\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.545233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.545204 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-console-config\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.646327 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.646267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-oauth-serving-cert\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.646327 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.646318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-serving-cert\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.646569 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.646340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-oauth-config\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.646569 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.646366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-console-config\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.646569 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.646422 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-service-ca\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.646569 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.646466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snvmk\" (UniqueName: \"kubernetes.io/projected/fbfa761f-a956-41e0-9504-30386fb2b07a-kube-api-access-snvmk\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.647127 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.647101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-oauth-serving-cert\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.647468 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.647415 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-console-config\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.647468 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.647415 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-service-ca\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.649483 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.649458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-oauth-config\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.650068 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.650046 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-serving-cert\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.658923 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.658899 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snvmk\" (UniqueName: \"kubernetes.io/projected/fbfa761f-a956-41e0-9504-30386fb2b07a-kube-api-access-snvmk\") pod \"console-686b588bdf-56h5t\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:18.752865 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:18.752830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:20.657263 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:20.657229 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp"] Jul 27 14:18:20.661561 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:20.661531 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b259b92_fe71_4ca0_b9d5_6c7136d7684e.slice/crio-f3b3b4f4f2c8bec293ce37fcee8ddd43e5a594b459d7f4a8e1b843c5cb3da3ea WatchSource:0}: Error finding container f3b3b4f4f2c8bec293ce37fcee8ddd43e5a594b459d7f4a8e1b843c5cb3da3ea: Status 404 returned error can't find the container with id f3b3b4f4f2c8bec293ce37fcee8ddd43e5a594b459d7f4a8e1b843c5cb3da3ea Jul 27 14:18:20.684204 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:20.683972 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686b588bdf-56h5t"] Jul 27 14:18:20.693085 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:20.693045 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfa761f_a956_41e0_9504_30386fb2b07a.slice/crio-c2556a9ce2abe9cdfc4bee5355b01d532ea9695182884a5ac43d14b158ea2877 WatchSource:0}: Error finding container c2556a9ce2abe9cdfc4bee5355b01d532ea9695182884a5ac43d14b158ea2877: Status 404 returned error can't find the container with id c2556a9ce2abe9cdfc4bee5355b01d532ea9695182884a5ac43d14b158ea2877 Jul 27 14:18:21.031156 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.031121 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4vs9" event={"ID":"d01b13ec-b607-425e-9ef0-ae71f22afad5","Type":"ContainerStarted","Data":"d6e22633b60691686048e35cf92a05567c27c77ff50cd97efabfc0047f9d98fb"} Jul 27 14:18:21.031344 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.031182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d4vs9" event={"ID":"d01b13ec-b607-425e-9ef0-ae71f22afad5","Type":"ContainerStarted","Data":"eaa31170adaf433d9e567cd3ec1c5e1ca5f01b85917e3db1111e529886c97328"} Jul 27 14:18:21.031344 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.031226 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d4vs9" Jul 27 14:18:21.033551 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.033525 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w4rdh" event={"ID":"c7057f7f-861c-41ea-a7bd-30dc7d01a0e4","Type":"ContainerStarted","Data":"548afa52d9158a96c821584bed9b4990f266db884c61866d6250f6279780dd0f"} Jul 27 14:18:21.034910 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.034882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686b588bdf-56h5t" event={"ID":"fbfa761f-a956-41e0-9504-30386fb2b07a","Type":"ContainerStarted","Data":"c2556a9ce2abe9cdfc4bee5355b01d532ea9695182884a5ac43d14b158ea2877"} Jul 27 14:18:21.036380 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.036353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nxl7t" event={"ID":"c64ee3a8-cd70-4a40-acab-491bc4197b90","Type":"ContainerStarted","Data":"79c2a861565b72e45eab8334c832a25eb80478b772755fa74d9d2834d64998db"} Jul 27 14:18:21.036487 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.036471 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:18:21.037837 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.037792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whbh6" event={"ID":"8e4a8cab-05ad-4c99-8461-5293ad3ff669","Type":"ContainerStarted","Data":"af9a9f71d9ecf2866acc0207cc0b764b4e4d15164daff7a40d95f2412115b05b"} Jul 27 14:18:21.039045 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.039023 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" event={"ID":"3b259b92-fe71-4ca0-b9d5-6c7136d7684e","Type":"ContainerStarted","Data":"f3b3b4f4f2c8bec293ce37fcee8ddd43e5a594b459d7f4a8e1b843c5cb3da3ea"} Jul 27 14:18:21.040332 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.040311 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" event={"ID":"2581d178-bbfa-4a51-8fcd-b28415048c45","Type":"ContainerStarted","Data":"d29ac8a43262e710d1c9b269c1a9e229bada567f7bc293f31fa3daf7641525ee"} Jul 27 14:18:21.040534 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.040510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:21.042409 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.042389 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" Jul 27 14:18:21.053130 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.053088 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d4vs9" podStartSLOduration=33.332819865 podStartE2EDuration="43.053071646s" totalImagesPullingTime="9.720251781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:21.051772723 +0000 UTC m=+77.979406029" watchObservedRunningTime="2026-07-27 14:18:21.053071646 +0000 UTC m=+77.980704905" Jul 27 14:18:21.096017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.095974 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nxl7t" podStartSLOduration=67.750778179 podStartE2EDuration="1m18.095956866s" totalImagesPullingTime="10.345178687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:21.07294052 +0000 UTC m=+78.000573803" watchObservedRunningTime="2026-07-27 14:18:21.095956866 +0000 UTC m=+78.023590149" Jul 27 14:18:21.096398 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.096372 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-whbh6" podStartSLOduration=67.739450559 podStartE2EDuration="1m18.096364869s" totalImagesPullingTime="10.35691431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:21.095327844 +0000 UTC m=+78.022961127" watchObservedRunningTime="2026-07-27 14:18:21.096364869 +0000 UTC m=+78.023998150" Jul 27 14:18:21.118399 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.118358 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w4rdh" podStartSLOduration=16.9699062 podStartE2EDuration="36.118346371s" totalImagesPullingTime="19.148440171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:17:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:21.116902884 +0000 UTC m=+78.044536167" watchObservedRunningTime="2026-07-27 14:18:21.118346371 +0000 UTC m=+78.045979652" Jul 27 14:18:21.140312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:21.140269 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c57d57f6b-cqrpd" podStartSLOduration=3.762749603 podStartE2EDuration="14.140254733s" totalImagesPullingTime="10.37750513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:21.139461376 +0000 UTC m=+78.067094661" watchObservedRunningTime="2026-07-27 14:18:21.140254733 +0000 UTC m=+78.067888016" Jul 27 14:18:22.047454 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:22.047398 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" event={"ID":"3b259b92-fe71-4ca0-b9d5-6c7136d7684e","Type":"ContainerStarted","Data":"568dd1cc8925917c3d1e941cbf21fca345d85df6482e3fdfda3ab7bfde70b7a8"} Jul 27 14:18:22.065602 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:22.065557 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" podStartSLOduration=5.833297257 podStartE2EDuration="7.065542819s" totalImagesPullingTime="1.232245562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:22.065440678 +0000 UTC m=+78.993073962" watchObservedRunningTime="2026-07-27 14:18:22.065542819 +0000 UTC m=+78.993176122" Jul 27 14:18:23.053023 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.052986 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:23.059753 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.059686 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-v8tzp" Jul 27 14:18:23.932844 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.932817 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hf4wg"] Jul 27 14:18:23.937487 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.937468 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:23.940182 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.940158 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 27 14:18:23.940445 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.940423 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 14:18:23.940527 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.940447 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 27 14:18:23.941747 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.941493 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9cfrx\"" Jul 27 14:18:23.941747 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.941554 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 14:18:23.941747 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.941553 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 14:18:23.952653 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.952625 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hf4wg"] Jul 27 14:18:23.989192 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.989115 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:23.989192 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.989170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:23.989405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.989216 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:23.989405 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:23.989311 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwgvq\" (UniqueName: \"kubernetes.io/projected/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-kube-api-access-xwgvq\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.059516 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.059475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686b588bdf-56h5t" event={"ID":"fbfa761f-a956-41e0-9504-30386fb2b07a","Type":"ContainerStarted","Data":"d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41"} Jul 27 14:18:24.079658 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.079609 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-686b588bdf-56h5t" podStartSLOduration=2.87978593 podStartE2EDuration="6.079590847s" totalImagesPullingTime="3.199804917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:24.078892784 +0000 UTC m=+81.006526067" watchObservedRunningTime="2026-07-27 14:18:24.079590847 +0000 UTC m=+81.007224130" Jul 27 14:18:24.091035 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.090360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwgvq\" (UniqueName: \"kubernetes.io/projected/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-kube-api-access-xwgvq\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.091035 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.090425 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.091035 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.090469 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.091035 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.090514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.091035 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:24.090751 2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 27 14:18:24.091035 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:24.090827 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-tls podName:1b194be1-8e55-4b6f-ad41-4e6dc95bab4c nodeName:}" failed. No retries permitted until 2026-07-27 14:18:24.590805417 +0000 UTC m=+81.518438696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-hf4wg" (UID: "1b194be1-8e55-4b6f-ad41-4e6dc95bab4c") : secret "prometheus-operator-tls" not found Jul 27 14:18:24.091743 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.091676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.093287 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.093261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.099224 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.099194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwgvq\" (UniqueName: \"kubernetes.io/projected/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-kube-api-access-xwgvq\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.594602 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.594569 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.597219 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.597197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b194be1-8e55-4b6f-ad41-4e6dc95bab4c-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-hf4wg\" (UID: \"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:24.850112 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:24.850026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" Jul 27 14:18:25.987473 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:25.987339 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d5bd55c44-48xn9"] Jul 27 14:18:26.001413 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.001376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.002724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.002672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5bd55c44-48xn9"] Jul 27 14:18:26.009309 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.009286 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 14:18:26.108995 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.108955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-trusted-ca-bundle\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.109188 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.109018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-config\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.109188 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.109048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzjp6\" (UniqueName: \"kubernetes.io/projected/c164b49f-0588-47b6-bc5e-1c0bde2e7276-kube-api-access-bzjp6\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.109188 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.109072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-serving-cert\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.109188 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.109113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-oauth-config\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.109188 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.109158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-oauth-serving-cert\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.109188 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.109184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-service-ca\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210388 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzjp6\" (UniqueName: \"kubernetes.io/projected/c164b49f-0588-47b6-bc5e-1c0bde2e7276-kube-api-access-bzjp6\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210577 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-serving-cert\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210577 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-oauth-config\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210577 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210565 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-oauth-serving-cert\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210766 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-service-ca\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210766 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-trusted-ca-bundle\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.210766 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.210756 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-config\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.211681 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.211408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-service-ca\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.211681 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.211408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-oauth-serving-cert\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.211681 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.211511 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-config\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.211934 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.211777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-trusted-ca-bundle\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.213233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.213210 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-oauth-config\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.213233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.213224 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-serving-cert\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.225732 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.225695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzjp6\" (UniqueName: \"kubernetes.io/projected/c164b49f-0588-47b6-bc5e-1c0bde2e7276-kube-api-access-bzjp6\") pod \"console-d5bd55c44-48xn9\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:26.313990 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:26.313916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:28.334695 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:28.334661 2577 patch_prober.go:28] interesting pod/image-registry-67c9fd5fd-zcbvc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 14:18:28.335159 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:28.334732 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" podUID="89d60295-85b5-41e0-a93c-9f4c77979d49" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 14:18:28.753743 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:28.753694 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:28.753917 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:28.753777 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:28.760464 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:28.760441 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:29.082528 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:29.082450 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:18:31.049865 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:31.049835 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d4vs9" Jul 27 14:18:31.675291 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:31.675265 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5bd55c44-48xn9"] Jul 27 14:18:31.692948 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:31.692921 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-hf4wg"] Jul 27 14:18:31.861809 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:31.861741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc164b49f_0588_47b6_bc5e_1c0bde2e7276.slice/crio-c0a2ec1f01280e8aeeb0ecf221fbd270ab717628558651a3a4a9f1c1b6c343ba WatchSource:0}: Error finding container c0a2ec1f01280e8aeeb0ecf221fbd270ab717628558651a3a4a9f1c1b6c343ba: Status 404 returned error can't find the container with id c0a2ec1f01280e8aeeb0ecf221fbd270ab717628558651a3a4a9f1c1b6c343ba Jul 27 14:18:31.862565 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:31.862543 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b194be1_8e55_4b6f_ad41_4e6dc95bab4c.slice/crio-6f2ad609357d6b8029f02f5dd60a7a3fe9ada5d4c94e774e97925e8a51316759 WatchSource:0}: Error finding container 6f2ad609357d6b8029f02f5dd60a7a3fe9ada5d4c94e774e97925e8a51316759: Status 404 returned error can't find the container with id 6f2ad609357d6b8029f02f5dd60a7a3fe9ada5d4c94e774e97925e8a51316759 Jul 27 14:18:31.993537 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:31.993505 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67c9fd5fd-zcbvc" Jul 27 14:18:32.091304 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.091267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5bd55c44-48xn9" event={"ID":"c164b49f-0588-47b6-bc5e-1c0bde2e7276","Type":"ContainerStarted","Data":"cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2"} Jul 27 14:18:32.091748 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.091315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5bd55c44-48xn9" event={"ID":"c164b49f-0588-47b6-bc5e-1c0bde2e7276","Type":"ContainerStarted","Data":"c0a2ec1f01280e8aeeb0ecf221fbd270ab717628558651a3a4a9f1c1b6c343ba"} Jul 27 14:18:32.092548 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.092521 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" event={"ID":"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c","Type":"ContainerStarted","Data":"6f2ad609357d6b8029f02f5dd60a7a3fe9ada5d4c94e774e97925e8a51316759"} Jul 27 14:18:32.093956 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.093932 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-xx9rd" event={"ID":"1fd5e6c1-164b-41c6-ba9d-5df83ed57094","Type":"ContainerStarted","Data":"ee3396c6d6755be06bb9d560bc3b6733a36224cd61e3cb3d13a1ed3c7644983e"} Jul 27 14:18:32.094046 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.094032 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:32.095112 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.095088 2577 patch_prober.go:28] interesting pod/downloads-7c97dc4555-xx9rd container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body= Jul 27 14:18:32.095190 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.095132 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-xx9rd" podUID="1fd5e6c1-164b-41c6-ba9d-5df83ed57094" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" Jul 27 14:18:32.155567 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.155486 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-xx9rd" podStartSLOduration=1.2081292750000001 podStartE2EDuration="23.155470896s" totalImagesPullingTime="21.947341621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:32.154347847 +0000 UTC m=+89.081981129" watchObservedRunningTime="2026-07-27 14:18:32.155470896 +0000 UTC m=+89.083104177" Jul 27 14:18:32.155567 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:32.155556 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d5bd55c44-48xn9" podStartSLOduration=7.155552179 podStartE2EDuration="7.155552179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:32.129845704 +0000 UTC m=+89.057478987" watchObservedRunningTime="2026-07-27 14:18:32.155552179 +0000 UTC m=+89.083185461" Jul 27 14:18:33.115717 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:33.115672 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-xx9rd" Jul 27 14:18:35.108239 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:35.108201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" event={"ID":"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c","Type":"ContainerStarted","Data":"41b387ca8957a5aae467446aff84a746f7eed87c55cac56b61aa81bbdae6a63f"} Jul 27 14:18:35.108731 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:35.108265 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" event={"ID":"1b194be1-8e55-4b6f-ad41-4e6dc95bab4c","Type":"ContainerStarted","Data":"4c1afebf6ea6ea01e9fd5856956fd24d1edae30db1dc273a2be6ed9cf756ed2c"} Jul 27 14:18:35.128948 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:35.128895 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-hf4wg" podStartSLOduration=9.872532512 podStartE2EDuration="12.128876131s" totalImagesPullingTime="2.256343619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:35.127562152 +0000 UTC m=+92.055195458" watchObservedRunningTime="2026-07-27 14:18:35.128876131 +0000 UTC m=+92.056509416" Jul 27 14:18:36.314204 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:36.314163 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:36.314678 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:36.314241 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:36.319785 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:36.319763 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:37.120460 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.120425 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:18:37.179314 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.179273 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686b588bdf-56h5t"] Jul 27 14:18:37.347605 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.347560 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf"] Jul 27 14:18:37.375500 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.375430 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf"] Jul 27 14:18:37.375657 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.375584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.378271 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.378248 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 27 14:18:37.378396 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.378253 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7xn2d\"" Jul 27 14:18:37.379244 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.379195 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 27 14:18:37.437103 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.437069 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7mthw"] Jul 27 14:18:37.455867 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.455834 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.460493 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.460263 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 14:18:37.460493 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.460293 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 14:18:37.460493 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.460304 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 14:18:37.460493 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.460392 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5jzs5\"" Jul 27 14:18:37.507633 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.507595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9sjh\" (UniqueName: \"kubernetes.io/projected/262feac4-fdde-421a-bc8d-5d300762cb72-kube-api-access-h9sjh\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.507833 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.507646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/262feac4-fdde-421a-bc8d-5d300762cb72-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.507833 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.507747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/262feac4-fdde-421a-bc8d-5d300762cb72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.507833 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.507806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/262feac4-fdde-421a-bc8d-5d300762cb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.609143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/262feac4-fdde-421a-bc8d-5d300762cb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.609424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-tls\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.609424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9sjh\" (UniqueName: \"kubernetes.io/projected/262feac4-fdde-421a-bc8d-5d300762cb72-kube-api-access-h9sjh\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.609424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-textfile\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.609424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/262feac4-fdde-421a-bc8d-5d300762cb72-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.609424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-root\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.609424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc43623a-866a-410d-a5de-4fc472b44b4a-metrics-client-ca\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.609867 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.609414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.610062 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.610041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-wtmp\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.610245 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.610223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/262feac4-fdde-421a-bc8d-5d300762cb72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.610443 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.610422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.611231 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.610512 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/262feac4-fdde-421a-bc8d-5d300762cb72-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.611231 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.610558 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-sys\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.611231 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.610609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f897\" (UniqueName: \"kubernetes.io/projected/bc43623a-866a-410d-a5de-4fc472b44b4a-kube-api-access-8f897\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.616807 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.616781 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/262feac4-fdde-421a-bc8d-5d300762cb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.617144 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.617123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/262feac4-fdde-421a-bc8d-5d300762cb72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.620250 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.620230 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9sjh\" (UniqueName: \"kubernetes.io/projected/262feac4-fdde-421a-bc8d-5d300762cb72-kube-api-access-h9sjh\") pod \"openshift-state-metrics-b8f49f5c6-xd8kf\" (UID: \"262feac4-fdde-421a-bc8d-5d300762cb72\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.686890 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.686807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" Jul 27 14:18:37.711199 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711364 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-wtmp\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711364 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711364 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-sys\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711364 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f897\" (UniqueName: \"kubernetes.io/projected/bc43623a-866a-410d-a5de-4fc472b44b4a-kube-api-access-8f897\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711364 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711347 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-tls\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711383 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-textfile\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711406 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-root\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711403 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-sys\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711450 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-root\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711455 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-wtmp\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.711632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.711461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc43623a-866a-410d-a5de-4fc472b44b4a-metrics-client-ca\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.712145 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.712101 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc43623a-866a-410d-a5de-4fc472b44b4a-metrics-client-ca\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.712265 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.712203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-textfile\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.712452 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.712426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-accelerators-collector-config\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.714319 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.714276 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-tls\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.714438 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.714314 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc43623a-866a-410d-a5de-4fc472b44b4a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.722439 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.722411 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f897\" (UniqueName: \"kubernetes.io/projected/bc43623a-866a-410d-a5de-4fc472b44b4a-kube-api-access-8f897\") pod \"node-exporter-7mthw\" (UID: \"bc43623a-866a-410d-a5de-4fc472b44b4a\") " pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.767495 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.767135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7mthw" Jul 27 14:18:37.799349 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:37.799313 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc43623a_866a_410d_a5de_4fc472b44b4a.slice/crio-d9dff5bf5dbfe61defc1d18257182cbc11709e6be81222b1983ff15454454f04 WatchSource:0}: Error finding container d9dff5bf5dbfe61defc1d18257182cbc11709e6be81222b1983ff15454454f04: Status 404 returned error can't find the container with id d9dff5bf5dbfe61defc1d18257182cbc11709e6be81222b1983ff15454454f04 Jul 27 14:18:37.867828 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:37.867792 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf"] Jul 27 14:18:37.873045 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:37.873015 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262feac4_fdde_421a_bc8d_5d300762cb72.slice/crio-b4953880c23c95a79902b6acf86f2748f5c8ff9e1a27d0afeb89f703c11afd63 WatchSource:0}: Error finding container b4953880c23c95a79902b6acf86f2748f5c8ff9e1a27d0afeb89f703c11afd63: Status 404 returned error can't find the container with id b4953880c23c95a79902b6acf86f2748f5c8ff9e1a27d0afeb89f703c11afd63 Jul 27 14:18:38.121728 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.121676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mthw" event={"ID":"bc43623a-866a-410d-a5de-4fc472b44b4a","Type":"ContainerStarted","Data":"d9dff5bf5dbfe61defc1d18257182cbc11709e6be81222b1983ff15454454f04"} Jul 27 14:18:38.124017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.123987 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" event={"ID":"262feac4-fdde-421a-bc8d-5d300762cb72","Type":"ContainerStarted","Data":"858c96da691279de4ea0089205ca7fc9e791527569fc6b3cfbe71cb8f1c9fd1d"} Jul 27 14:18:38.124141 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.124051 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" event={"ID":"262feac4-fdde-421a-bc8d-5d300762cb72","Type":"ContainerStarted","Data":"1b679b1cbdc7b44fde89eea0e6fa49bb197da31ca576d2ec173ef56911263a8d"} Jul 27 14:18:38.124141 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.124083 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" event={"ID":"262feac4-fdde-421a-bc8d-5d300762cb72","Type":"ContainerStarted","Data":"b4953880c23c95a79902b6acf86f2748f5c8ff9e1a27d0afeb89f703c11afd63"} Jul 27 14:18:38.434295 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.434260 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 14:18:38.451963 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.451935 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.454904 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.454877 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 27 14:18:38.455049 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.454997 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 27 14:18:38.455128 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.454888 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 27 14:18:38.455415 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.455328 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 27 14:18:38.455415 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.455338 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 27 14:18:38.455677 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.455572 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 27 14:18:38.455769 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.455740 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 27 14:18:38.456224 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.456057 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 27 14:18:38.456630 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.456610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-j9v9k\"" Jul 27 14:18:38.461474 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.461448 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 14:18:38.462957 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.462935 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 27 14:18:38.619628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.619593 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.619903 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.619656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.619903 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.619698 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.619903 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.619755 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620108 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.619863 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620108 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.619975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620109 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp7vv\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-kube-api-access-kp7vv\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620305 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.620485 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.620442 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.721839 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.721839 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721873 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp7vv\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-kube-api-access-kp7vv\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.721973 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.722014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.722044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.722082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.722128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.722163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.722206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.723559 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.723340 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.724450 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.724130 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.726334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.726306 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.729862 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.729820 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.730143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.730117 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-web-config\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.730647 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.730617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-out\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.731067 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.731045 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.731522 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.731484 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.732102 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.732081 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.732930 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.732474 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.733491 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.733457 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.735034 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.735011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-volume\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.735452 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.735428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp7vv\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-kube-api-access-kp7vv\") pod \"alertmanager-main-0\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.764098 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.763934 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:18:38.951962 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:38.951930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 14:18:39.182561 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:39.182528 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa70ec1_f651_4959_b57c_90d07d7ed0e7.slice/crio-280a3d136504cc91154653ebdea441082ddbaf519ba7444faa9ee90670e2e456 WatchSource:0}: Error finding container 280a3d136504cc91154653ebdea441082ddbaf519ba7444faa9ee90670e2e456: Status 404 returned error can't find the container with id 280a3d136504cc91154653ebdea441082ddbaf519ba7444faa9ee90670e2e456 Jul 27 14:18:40.135742 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:40.135644 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc43623a-866a-410d-a5de-4fc472b44b4a" containerID="4b64f8a8c7abb6123922a797df6e8074f8ad83168527a64d83ae308452bdfb8a" exitCode=0 Jul 27 14:18:40.136617 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:40.135774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mthw" event={"ID":"bc43623a-866a-410d-a5de-4fc472b44b4a","Type":"ContainerDied","Data":"4b64f8a8c7abb6123922a797df6e8074f8ad83168527a64d83ae308452bdfb8a"} Jul 27 14:18:40.138938 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:40.138831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"280a3d136504cc91154653ebdea441082ddbaf519ba7444faa9ee90670e2e456"} Jul 27 14:18:42.100770 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.100731 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm"] Jul 27 14:18:42.131597 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.131566 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-596f4cb8c4-t9qtt"] Jul 27 14:18:42.131779 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.131713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.134771 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.134748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5qdvv\"" Jul 27 14:18:42.134896 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.134784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 14:18:42.147692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.147672 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm"] Jul 27 14:18:42.147866 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.147717 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596f4cb8c4-t9qtt"] Jul 27 14:18:42.147866 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.147805 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.148212 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.148166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" event={"ID":"262feac4-fdde-421a-bc8d-5d300762cb72","Type":"ContainerStarted","Data":"20eef215234a3c5cbf001bd6a0cdfa126930b177a1a440d8d92c76c6401db19a"} Jul 27 14:18:42.150430 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.150405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mthw" event={"ID":"bc43623a-866a-410d-a5de-4fc472b44b4a","Type":"ContainerStarted","Data":"bd841888e4035c13049880bc8ffbcfdf5c03dc9517f58441047dfffdd80eb86b"} Jul 27 14:18:42.150531 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.150454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7mthw" event={"ID":"bc43623a-866a-410d-a5de-4fc472b44b4a","Type":"ContainerStarted","Data":"a61c791185cad3103687998bb666ab9e52e55a8d87b858de32afe4a9950f8937"} Jul 27 14:18:42.151966 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.151940 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599" exitCode=0 Jul 27 14:18:42.152063 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.151973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599"} Jul 27 14:18:42.216360 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.216312 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-xd8kf" podStartSLOduration=2.014909294 podStartE2EDuration="5.216294594s" totalImagesPullingTime="3.2013853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:42.215124505 +0000 UTC m=+99.142757787" watchObservedRunningTime="2026-07-27 14:18:42.216294594 +0000 UTC m=+99.143927876" Jul 27 14:18:42.250692 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.250663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-trusted-ca-bundle\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.250875 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.250744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-serving-cert\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.250875 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.250783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-oauth-config\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.250875 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.250807 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfvc8\" (UniqueName: \"kubernetes.io/projected/43ee0dcc-afbf-4377-abc5-c3241dc3975b-kube-api-access-nfvc8\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.251289 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.251262 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-service-ca\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.251494 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.251440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w677q\" (UniqueName: \"kubernetes.io/projected/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-kube-api-access-w677q\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.251595 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.251504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-config\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.251595 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.251572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.251857 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.251598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-oauth-serving-cert\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-trusted-ca-bundle\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352141 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-serving-cert\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-oauth-config\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfvc8\" (UniqueName: \"kubernetes.io/projected/43ee0dcc-afbf-4377-abc5-c3241dc3975b-kube-api-access-nfvc8\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-service-ca\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352555 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w677q\" (UniqueName: \"kubernetes.io/projected/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-kube-api-access-w677q\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.352555 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-config\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.352555 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.352555 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.352324 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-oauth-serving-cert\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.353031 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:42.353008 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 27 14:18:42.353228 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:18:42.353199 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-monitoring-plugin-cert podName:5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb nodeName:}" failed. No retries permitted until 2026-07-27 14:18:42.85317317 +0000 UTC m=+99.780806446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-cq9vm" (UID: "5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb") : secret "monitoring-plugin-cert" not found Jul 27 14:18:42.353342 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.353239 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-trusted-ca-bundle\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.353342 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.353323 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-oauth-serving-cert\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.353461 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.353321 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-config\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.353461 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.353369 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-service-ca\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.355072 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.355052 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-oauth-config\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.355158 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.355128 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-serving-cert\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.366303 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.366280 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w677q\" (UniqueName: \"kubernetes.io/projected/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-kube-api-access-w677q\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.368868 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.368850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfvc8\" (UniqueName: \"kubernetes.io/projected/43ee0dcc-afbf-4377-abc5-c3241dc3975b-kube-api-access-nfvc8\") pod \"console-596f4cb8c4-t9qtt\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.457280 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.457249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:42.624811 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.624719 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7mthw" podStartSLOduration=3.757128792 podStartE2EDuration="5.624683257s" totalImagesPullingTime="1.760182544s" totalInitContainerRuntime="107.371921ms" isStatefulPod=true podCreationTimestamp="2026-07-27 14:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:42.282880916 +0000 UTC m=+99.210514217" watchObservedRunningTime="2026-07-27 14:18:42.624683257 +0000 UTC m=+99.552316610" Jul 27 14:18:42.625220 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.625201 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-596f4cb8c4-t9qtt"] Jul 27 14:18:42.627841 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:42.627816 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ee0dcc_afbf_4377_abc5_c3241dc3975b.slice/crio-e32964d3179f142118dd7f0cb4f3314ee0a45b1dd05a2af11b51f97ca5efe888 WatchSource:0}: Error finding container e32964d3179f142118dd7f0cb4f3314ee0a45b1dd05a2af11b51f97ca5efe888: Status 404 returned error can't find the container with id e32964d3179f142118dd7f0cb4f3314ee0a45b1dd05a2af11b51f97ca5efe888 Jul 27 14:18:42.855619 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.855585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:42.858045 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:42.858019 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-cq9vm\" (UID: \"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:43.040670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.040634 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:43.159133 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.159089 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596f4cb8c4-t9qtt" event={"ID":"43ee0dcc-afbf-4377-abc5-c3241dc3975b","Type":"ContainerStarted","Data":"f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c"} Jul 27 14:18:43.159563 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.159155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596f4cb8c4-t9qtt" event={"ID":"43ee0dcc-afbf-4377-abc5-c3241dc3975b","Type":"ContainerStarted","Data":"e32964d3179f142118dd7f0cb4f3314ee0a45b1dd05a2af11b51f97ca5efe888"} Jul 27 14:18:43.182322 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.182277 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-596f4cb8c4-t9qtt" podStartSLOduration=1.182258058 podStartE2EDuration="1.182258058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:43.181326199 +0000 UTC m=+100.108959481" watchObservedRunningTime="2026-07-27 14:18:43.182258058 +0000 UTC m=+100.109891340" Jul 27 14:18:43.194035 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.194015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm"] Jul 27 14:18:43.196408 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:43.196382 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b50c5c5_6273_4bfd_93fe_2fff6a1e69eb.slice/crio-c904a23f1ce4cfeff01202d9d113f910b5f6b4f2cf5a7676eb6a6489dceed837 WatchSource:0}: Error finding container c904a23f1ce4cfeff01202d9d113f910b5f6b4f2cf5a7676eb6a6489dceed837: Status 404 returned error can't find the container with id c904a23f1ce4cfeff01202d9d113f910b5f6b4f2cf5a7676eb6a6489dceed837 Jul 27 14:18:43.677439 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.677409 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:18:43.699345 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.699315 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.705118 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705085 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 14:18:43.705305 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705282 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 14:18:43.705539 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705511 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 14:18:43.705661 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705561 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 14:18:43.705661 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 14:18:43.705835 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705517 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 14:18:43.705913 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.705876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 14:18:43.706253 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.706164 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 14:18:43.706253 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.706200 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:18:43.706430 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.706308 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 14:18:43.706430 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.706423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 14:18:43.706755 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.706737 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dqj32ne90t604\"" Jul 27 14:18:43.707504 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.706996 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 14:18:43.707504 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.707055 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nxgrp\"" Jul 27 14:18:43.707504 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.707008 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 14:18:43.707799 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.707783 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 14:18:43.709153 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.708919 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 14:18:43.714635 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.714615 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 14:18:43.866462 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-config\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866643 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866477 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866643 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866643 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866831 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866831 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866831 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866831 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866790 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.866831 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866814 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmx4\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-kube-api-access-pbmx4\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866971 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.866987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867002 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.867001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.867020 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.867033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.867077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.867149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.867207 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.867194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968531 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968441 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmx4\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-kube-api-access-pbmx4\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968531 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968487 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968531 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968563 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968584 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968612 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-config\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.968972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.969659 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.968997 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.969659 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.969036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.969783 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.969672 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.970543 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.970022 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.970543 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.970472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.971501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.971474 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.973354 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.973054 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.973354 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.973161 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.973519 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.973441 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.975142 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.975123 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.976185 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.976160 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-config\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.977312 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.977124 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.977823 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.977805 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.979176 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.979129 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.980439 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.980216 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.980439 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.980285 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmx4\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-kube-api-access-pbmx4\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.980632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.980580 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.981158 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.981023 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.981158 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.981119 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.981723 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.981475 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.981723 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.981665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:43.982252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:43.982228 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:44.014561 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:44.014531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:44.167640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:44.167557 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" event={"ID":"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb","Type":"ContainerStarted","Data":"c904a23f1ce4cfeff01202d9d113f910b5f6b4f2cf5a7676eb6a6489dceed837"} Jul 27 14:18:44.225842 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:44.225760 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:18:44.579742 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:44.579699 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23db7125_aedf_4137_b60c_ed115e1672d2.slice/crio-bfca89ba4c3518f637917cd1130afe0e33aec51fada20a7aea3fe99999a2e51d WatchSource:0}: Error finding container bfca89ba4c3518f637917cd1130afe0e33aec51fada20a7aea3fe99999a2e51d: Status 404 returned error can't find the container with id bfca89ba4c3518f637917cd1130afe0e33aec51fada20a7aea3fe99999a2e51d Jul 27 14:18:45.173340 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:45.173305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"bfca89ba4c3518f637917cd1130afe0e33aec51fada20a7aea3fe99999a2e51d"} Jul 27 14:18:46.179619 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.179588 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" exitCode=0 Jul 27 14:18:46.180087 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.179679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} Jul 27 14:18:46.185843 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.185817 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72"} Jul 27 14:18:46.185988 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.185894 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392"} Jul 27 14:18:46.185988 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.185936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466"} Jul 27 14:18:46.185988 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.185973 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895"} Jul 27 14:18:46.186112 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.186010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2"} Jul 27 14:18:46.187323 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.187300 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" event={"ID":"5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb","Type":"ContainerStarted","Data":"1428a003665a5751a1b8927c8b69527d0b6de196188da36facd5a46a78d37294"} Jul 27 14:18:46.187460 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.187421 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:46.192570 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.192548 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" Jul 27 14:18:46.232850 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:46.232808 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-cq9vm" podStartSLOduration=2.0410908 podStartE2EDuration="4.232792843s" totalImagesPullingTime="2.191702043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:46.232037132 +0000 UTC m=+103.159670410" watchObservedRunningTime="2026-07-27 14:18:46.232792843 +0000 UTC m=+103.160426125" Jul 27 14:18:48.199340 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.199302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerStarted","Data":"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835"} Jul 27 14:18:48.234370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.234322 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.47223274 podStartE2EDuration="10.234306763s" totalImagesPullingTime="6.745657516s" totalInitContainerRuntime="16.416507ms" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:48.232426273 +0000 UTC m=+105.160059555" watchObservedRunningTime="2026-07-27 14:18:48.234306763 +0000 UTC m=+105.161940045" Jul 27 14:18:48.767903 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.767858 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596f4cb8c4-t9qtt"] Jul 27 14:18:48.816676 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.816642 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-876dc8cd6-6mnd2"] Jul 27 14:18:48.839347 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.837604 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-876dc8cd6-6mnd2"] Jul 27 14:18:48.839347 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.837734 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.911985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.911947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-service-ca\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.912190 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.912001 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-config\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.912190 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.912088 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-oauth-serving-cert\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.912190 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.912126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsl7t\" (UniqueName: \"kubernetes.io/projected/45f5e921-d798-4ef1-b557-2543f6a24ffd-kube-api-access-gsl7t\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.912190 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.912169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-trusted-ca-bundle\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.912381 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.912237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-serving-cert\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:48.912381 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:48.912264 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-oauth-config\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-oauth-serving-cert\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013262 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsl7t\" (UniqueName: \"kubernetes.io/projected/45f5e921-d798-4ef1-b557-2543f6a24ffd-kube-api-access-gsl7t\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-trusted-ca-bundle\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013354 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-serving-cert\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-oauth-config\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-service-ca\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.013983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.013443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-config\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.014460 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.014265 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-config\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.014616 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.014588 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-oauth-serving-cert\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.015143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.015106 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-trusted-ca-bundle\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.015528 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.015506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-service-ca\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.017439 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.017381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-oauth-config\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.017562 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.017486 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-serving-cert\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.024287 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.024126 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsl7t\" (UniqueName: \"kubernetes.io/projected/45f5e921-d798-4ef1-b557-2543f6a24ffd-kube-api-access-gsl7t\") pod \"console-876dc8cd6-6mnd2\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.159736 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.159686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:49.358513 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:49.358353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-876dc8cd6-6mnd2"] Jul 27 14:18:49.361440 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:18:49.361407 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f5e921_d798_4ef1_b557_2543f6a24ffd.slice/crio-169c97f4159535d01aae333d3ae947483d319f1d34328a47de602aba4c503f9f WatchSource:0}: Error finding container 169c97f4159535d01aae333d3ae947483d319f1d34328a47de602aba4c503f9f: Status 404 returned error can't find the container with id 169c97f4159535d01aae333d3ae947483d319f1d34328a47de602aba4c503f9f Jul 27 14:18:50.209922 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:50.209892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc8cd6-6mnd2" event={"ID":"45f5e921-d798-4ef1-b557-2543f6a24ffd","Type":"ContainerStarted","Data":"f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73"} Jul 27 14:18:50.210150 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:50.209940 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc8cd6-6mnd2" event={"ID":"45f5e921-d798-4ef1-b557-2543f6a24ffd","Type":"ContainerStarted","Data":"169c97f4159535d01aae333d3ae947483d319f1d34328a47de602aba4c503f9f"} Jul 27 14:18:50.237148 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:50.237101 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-876dc8cd6-6mnd2" podStartSLOduration=2.237083788 podStartE2EDuration="2.237083788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:50.236459288 +0000 UTC m=+107.164092582" watchObservedRunningTime="2026-07-27 14:18:50.237083788 +0000 UTC m=+107.164717071" Jul 27 14:18:52.049832 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:52.049796 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nxl7t" Jul 27 14:18:52.221465 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:52.221432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} Jul 27 14:18:52.221621 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:52.221495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} Jul 27 14:18:52.457770 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:52.457661 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:18:55.237223 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:55.237185 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} Jul 27 14:18:55.237621 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:55.237277 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} Jul 27 14:18:55.237621 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:55.237307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} Jul 27 14:18:55.237621 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:55.237334 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerStarted","Data":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} Jul 27 14:18:55.272585 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:55.272532 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.396383166 podStartE2EDuration="12.272509061s" totalImagesPullingTime="7.858547834s" totalInitContainerRuntime="17.578061ms" isStatefulPod=false podCreationTimestamp="2026-07-27 14:18:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:18:55.269698534 +0000 UTC m=+112.197331816" watchObservedRunningTime="2026-07-27 14:18:55.272509061 +0000 UTC m=+112.200142357" Jul 27 14:18:59.015089 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:59.015047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:18:59.160409 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:59.160372 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:59.160604 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:59.160510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:59.165094 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:59.165073 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:59.255923 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:59.255899 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:18:59.317489 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:18:59.317413 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5bd55c44-48xn9"] Jul 27 14:19:02.204508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.204444 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-686b588bdf-56h5t" podUID="fbfa761f-a956-41e0-9504-30386fb2b07a" containerName="console" containerID="cri-o://d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41" gracePeriod=15 Jul 27 14:19:02.474045 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.473981 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:19:02.534642 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.534615 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-oauth-config\") pod \"fbfa761f-a956-41e0-9504-30386fb2b07a\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " Jul 27 14:19:02.534808 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.534648 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-oauth-serving-cert\") pod \"fbfa761f-a956-41e0-9504-30386fb2b07a\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " Jul 27 14:19:02.534808 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.534664 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-serving-cert\") pod \"fbfa761f-a956-41e0-9504-30386fb2b07a\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " Jul 27 14:19:02.534808 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.534687 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snvmk\" (UniqueName: \"kubernetes.io/projected/fbfa761f-a956-41e0-9504-30386fb2b07a-kube-api-access-snvmk\") pod \"fbfa761f-a956-41e0-9504-30386fb2b07a\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " Jul 27 14:19:02.534808 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.534736 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-console-config\") pod \"fbfa761f-a956-41e0-9504-30386fb2b07a\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " Jul 27 14:19:02.534808 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.534795 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-service-ca\") pod \"fbfa761f-a956-41e0-9504-30386fb2b07a\" (UID: \"fbfa761f-a956-41e0-9504-30386fb2b07a\") " Jul 27 14:19:02.535224 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.535192 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-console-config" (OuterVolumeSpecName: "console-config") pod "fbfa761f-a956-41e0-9504-30386fb2b07a" (UID: "fbfa761f-a956-41e0-9504-30386fb2b07a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:02.535224 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.535209 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-service-ca" (OuterVolumeSpecName: "service-ca") pod "fbfa761f-a956-41e0-9504-30386fb2b07a" (UID: "fbfa761f-a956-41e0-9504-30386fb2b07a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:02.535397 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.535200 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fbfa761f-a956-41e0-9504-30386fb2b07a" (UID: "fbfa761f-a956-41e0-9504-30386fb2b07a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:02.537018 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.536994 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fbfa761f-a956-41e0-9504-30386fb2b07a" (UID: "fbfa761f-a956-41e0-9504-30386fb2b07a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:02.537109 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.537039 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fbfa761f-a956-41e0-9504-30386fb2b07a" (UID: "fbfa761f-a956-41e0-9504-30386fb2b07a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:02.537109 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.537045 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbfa761f-a956-41e0-9504-30386fb2b07a-kube-api-access-snvmk" (OuterVolumeSpecName: "kube-api-access-snvmk") pod "fbfa761f-a956-41e0-9504-30386fb2b07a" (UID: "fbfa761f-a956-41e0-9504-30386fb2b07a"). InnerVolumeSpecName "kube-api-access-snvmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:19:02.635714 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.635675 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-oauth-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:02.635891 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.635728 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-oauth-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:02.635891 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.635738 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fbfa761f-a956-41e0-9504-30386fb2b07a-console-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:02.635891 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.635746 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snvmk\" (UniqueName: \"kubernetes.io/projected/fbfa761f-a956-41e0-9504-30386fb2b07a-kube-api-access-snvmk\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:02.635891 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.635756 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-console-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:02.635891 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:02.635764 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fbfa761f-a956-41e0-9504-30386fb2b07a-service-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:03.269571 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.269538 2577 generic.go:356] "Generic (PLEG): container finished" podID="fbfa761f-a956-41e0-9504-30386fb2b07a" containerID="d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41" exitCode=0 Jul 27 14:19:03.270081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.269586 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686b588bdf-56h5t" Jul 27 14:19:03.270081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.269621 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686b588bdf-56h5t" event={"ID":"fbfa761f-a956-41e0-9504-30386fb2b07a","Type":"ContainerDied","Data":"d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41"} Jul 27 14:19:03.270081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.269669 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686b588bdf-56h5t" event={"ID":"fbfa761f-a956-41e0-9504-30386fb2b07a","Type":"ContainerDied","Data":"c2556a9ce2abe9cdfc4bee5355b01d532ea9695182884a5ac43d14b158ea2877"} Jul 27 14:19:03.270081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.269688 2577 scope.go:117] "RemoveContainer" containerID="d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41" Jul 27 14:19:03.278776 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.278751 2577 scope.go:117] "RemoveContainer" containerID="d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41" Jul 27 14:19:03.279037 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:19:03.279020 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41\": container with ID starting with d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41 not found: ID does not exist" containerID="d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41" Jul 27 14:19:03.279086 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.279045 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41"} err="failed to get container status \"d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41\": rpc error: code = NotFound desc = could not find container \"d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41\": container with ID starting with d00c1b2c82a8e92204703154c6f73c6fc61e5c2e0443982a6fe0e29949e59c41 not found: ID does not exist" Jul 27 14:19:03.292297 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.292267 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686b588bdf-56h5t"] Jul 27 14:19:03.293670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.293647 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-686b588bdf-56h5t"] Jul 27 14:19:03.653881 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:03.653797 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbfa761f-a956-41e0-9504-30386fb2b07a" path="/var/lib/kubelet/pods/fbfa761f-a956-41e0-9504-30386fb2b07a/volumes" Jul 27 14:19:13.792217 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:13.792160 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-596f4cb8c4-t9qtt" podUID="43ee0dcc-afbf-4377-abc5-c3241dc3975b" containerName="console" containerID="cri-o://f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c" gracePeriod=15 Jul 27 14:19:14.081966 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.081942 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:19:14.137826 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137795 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-trusted-ca-bundle\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.137972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137848 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfvc8\" (UniqueName: \"kubernetes.io/projected/43ee0dcc-afbf-4377-abc5-c3241dc3975b-kube-api-access-nfvc8\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.137972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137878 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-oauth-serving-cert\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.137972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137896 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-serving-cert\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.137972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137927 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-config\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.137972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137947 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-oauth-config\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.138233 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.137995 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-service-ca\") pod \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\" (UID: \"43ee0dcc-afbf-4377-abc5-c3241dc3975b\") " Jul 27 14:19:14.138289 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.138255 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:14.138342 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.138282 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-config" (OuterVolumeSpecName: "console-config") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:14.138342 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.138312 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:14.138632 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.138608 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-service-ca" (OuterVolumeSpecName: "service-ca") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:14.140103 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.140078 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:14.140187 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.140100 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:14.140187 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.140101 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ee0dcc-afbf-4377-abc5-c3241dc3975b-kube-api-access-nfvc8" (OuterVolumeSpecName: "kube-api-access-nfvc8") pod "43ee0dcc-afbf-4377-abc5-c3241dc3975b" (UID: "43ee0dcc-afbf-4377-abc5-c3241dc3975b"). InnerVolumeSpecName "kube-api-access-nfvc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:19:14.239628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239600 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfvc8\" (UniqueName: \"kubernetes.io/projected/43ee0dcc-afbf-4377-abc5-c3241dc3975b-kube-api-access-nfvc8\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.239628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239625 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-oauth-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.239628 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239636 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.239827 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239645 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.239827 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239653 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43ee0dcc-afbf-4377-abc5-c3241dc3975b-console-oauth-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.239827 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239661 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-service-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.239827 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.239669 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43ee0dcc-afbf-4377-abc5-c3241dc3975b-trusted-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:14.320724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.320618 2577 generic.go:356] "Generic (PLEG): container finished" podID="43ee0dcc-afbf-4377-abc5-c3241dc3975b" containerID="f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c" exitCode=0 Jul 27 14:19:14.320724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.320668 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-596f4cb8c4-t9qtt" Jul 27 14:19:14.320724 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.320687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596f4cb8c4-t9qtt" event={"ID":"43ee0dcc-afbf-4377-abc5-c3241dc3975b","Type":"ContainerDied","Data":"f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c"} Jul 27 14:19:14.320922 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.320753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-596f4cb8c4-t9qtt" event={"ID":"43ee0dcc-afbf-4377-abc5-c3241dc3975b","Type":"ContainerDied","Data":"e32964d3179f142118dd7f0cb4f3314ee0a45b1dd05a2af11b51f97ca5efe888"} Jul 27 14:19:14.320922 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.320783 2577 scope.go:117] "RemoveContainer" containerID="f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c" Jul 27 14:19:14.337531 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.337513 2577 scope.go:117] "RemoveContainer" containerID="f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c" Jul 27 14:19:14.337778 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:19:14.337759 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c\": container with ID starting with f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c not found: ID does not exist" containerID="f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c" Jul 27 14:19:14.337849 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.337791 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c"} err="failed to get container status \"f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c\": rpc error: code = NotFound desc = could not find container \"f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c\": container with ID starting with f31ac2fbd737c211d6cc7359badb43d08b883e43cf2ffa66ec79981cb25e691c not found: ID does not exist" Jul 27 14:19:14.348413 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.348390 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-596f4cb8c4-t9qtt"] Jul 27 14:19:14.353423 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:14.353211 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-596f4cb8c4-t9qtt"] Jul 27 14:19:15.654592 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:15.654556 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43ee0dcc-afbf-4377-abc5-c3241dc3975b" path="/var/lib/kubelet/pods/43ee0dcc-afbf-4377-abc5-c3241dc3975b/volumes" Jul 27 14:19:24.339606 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.339558 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d5bd55c44-48xn9" podUID="c164b49f-0588-47b6-bc5e-1c0bde2e7276" containerName="console" containerID="cri-o://cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2" gracePeriod=15 Jul 27 14:19:24.617279 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.617216 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:19:24.724157 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724122 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzjp6\" (UniqueName: \"kubernetes.io/projected/c164b49f-0588-47b6-bc5e-1c0bde2e7276-kube-api-access-bzjp6\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724321 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724166 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-trusted-ca-bundle\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724321 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724215 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-oauth-config\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724321 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724250 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-serving-cert\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724321 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724274 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-oauth-serving-cert\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724321 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724306 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-service-ca\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724585 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724336 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-config\") pod \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\" (UID: \"c164b49f-0588-47b6-bc5e-1c0bde2e7276\") " Jul 27 14:19:24.724751 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724629 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:24.724856 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724779 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-service-ca" (OuterVolumeSpecName: "service-ca") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:24.724856 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724787 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:24.724856 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.724814 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-config" (OuterVolumeSpecName: "console-config") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:24.726315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.726282 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:24.726315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.726305 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:24.726449 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.726369 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c164b49f-0588-47b6-bc5e-1c0bde2e7276-kube-api-access-bzjp6" (OuterVolumeSpecName: "kube-api-access-bzjp6") pod "c164b49f-0588-47b6-bc5e-1c0bde2e7276" (UID: "c164b49f-0588-47b6-bc5e-1c0bde2e7276"). InnerVolumeSpecName "kube-api-access-bzjp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:19:24.824874 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824846 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-trusted-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:24.824874 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824869 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-oauth-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:24.824874 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824878 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:24.825054 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824886 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-oauth-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:24.825054 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824895 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-service-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:24.825054 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824903 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c164b49f-0588-47b6-bc5e-1c0bde2e7276-console-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:24.825054 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:24.824911 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzjp6\" (UniqueName: \"kubernetes.io/projected/c164b49f-0588-47b6-bc5e-1c0bde2e7276-kube-api-access-bzjp6\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:25.366371 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.366336 2577 generic.go:356] "Generic (PLEG): container finished" podID="c164b49f-0588-47b6-bc5e-1c0bde2e7276" containerID="cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2" exitCode=0 Jul 27 14:19:25.366861 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.366386 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5bd55c44-48xn9" Jul 27 14:19:25.366861 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.366388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5bd55c44-48xn9" event={"ID":"c164b49f-0588-47b6-bc5e-1c0bde2e7276","Type":"ContainerDied","Data":"cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2"} Jul 27 14:19:25.366861 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.366509 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5bd55c44-48xn9" event={"ID":"c164b49f-0588-47b6-bc5e-1c0bde2e7276","Type":"ContainerDied","Data":"c0a2ec1f01280e8aeeb0ecf221fbd270ab717628558651a3a4a9f1c1b6c343ba"} Jul 27 14:19:25.366861 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.366536 2577 scope.go:117] "RemoveContainer" containerID="cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2" Jul 27 14:19:25.374800 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.374784 2577 scope.go:117] "RemoveContainer" containerID="cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2" Jul 27 14:19:25.375029 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:19:25.375010 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2\": container with ID starting with cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2 not found: ID does not exist" containerID="cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2" Jul 27 14:19:25.375077 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.375036 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2"} err="failed to get container status \"cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2\": rpc error: code = NotFound desc = could not find container \"cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2\": container with ID starting with cd97bcf1993711b6a0e4867a385cc826a6cc6b7b14d6c217ab831b1bd902a5a2 not found: ID does not exist" Jul 27 14:19:25.388327 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.388302 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5bd55c44-48xn9"] Jul 27 14:19:25.394599 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.394581 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d5bd55c44-48xn9"] Jul 27 14:19:25.654146 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:25.654075 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c164b49f-0588-47b6-bc5e-1c0bde2e7276" path="/var/lib/kubelet/pods/c164b49f-0588-47b6-bc5e-1c0bde2e7276/volumes" Jul 27 14:19:44.015648 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:44.015606 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:19:44.035064 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:44.035036 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:19:44.451801 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:44.451724 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:19:57.828527 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:57.828449 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 14:19:58.489062 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.489022 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="alertmanager" containerID="cri-o://17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2" gracePeriod=120 Jul 27 14:19:58.489256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.489088 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-metric" containerID="cri-o://eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72" gracePeriod=120 Jul 27 14:19:58.489256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.489109 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="prom-label-proxy" containerID="cri-o://8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835" gracePeriod=120 Jul 27 14:19:58.489256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.489132 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-web" containerID="cri-o://fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466" gracePeriod=120 Jul 27 14:19:58.489256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.489149 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="config-reloader" containerID="cri-o://ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895" gracePeriod=120 Jul 27 14:19:58.489256 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.489166 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy" containerID="cri-o://1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392" gracePeriod=120 Jul 27 14:19:58.858029 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.857950 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76cd89f5b5-2vf4n"] Jul 27 14:19:58.858370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858303 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbfa761f-a956-41e0-9504-30386fb2b07a" containerName="console" Jul 27 14:19:58.858370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858315 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbfa761f-a956-41e0-9504-30386fb2b07a" containerName="console" Jul 27 14:19:58.858370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858323 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c164b49f-0588-47b6-bc5e-1c0bde2e7276" containerName="console" Jul 27 14:19:58.858370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858329 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c164b49f-0588-47b6-bc5e-1c0bde2e7276" containerName="console" Jul 27 14:19:58.858370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858336 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ee0dcc-afbf-4377-abc5-c3241dc3975b" containerName="console" Jul 27 14:19:58.858370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858342 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ee0dcc-afbf-4377-abc5-c3241dc3975b" containerName="console" Jul 27 14:19:58.858584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858390 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ee0dcc-afbf-4377-abc5-c3241dc3975b" containerName="console" Jul 27 14:19:58.858584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858399 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c164b49f-0588-47b6-bc5e-1c0bde2e7276" containerName="console" Jul 27 14:19:58.858584 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.858406 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbfa761f-a956-41e0-9504-30386fb2b07a" containerName="console" Jul 27 14:19:58.860602 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.860540 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.874095 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.874072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cd89f5b5-2vf4n"] Jul 27 14:19:58.905281 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-oauth-serving-cert\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.905424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsch\" (UniqueName: \"kubernetes.io/projected/3381c149-9860-429f-b806-62ba1917f5eb-kube-api-access-6wsch\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.905424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-console-config\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.905511 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-trusted-ca-bundle\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.905511 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-serving-cert\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.905573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905523 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-oauth-config\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:58.905573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:58.905548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-service-ca\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.006855 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-console-config\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.006855 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-trusted-ca-bundle\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007086 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-serving-cert\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007086 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-oauth-config\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007086 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-service-ca\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007086 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-oauth-serving-cert\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007086 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.006983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsch\" (UniqueName: \"kubernetes.io/projected/3381c149-9860-429f-b806-62ba1917f5eb-kube-api-access-6wsch\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007636 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.007612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-oauth-serving-cert\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007756 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.007630 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-console-config\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007756 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.007687 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-service-ca\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.007927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.007907 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-trusted-ca-bundle\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.009215 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.009191 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-oauth-config\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.009389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.009371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-serving-cert\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.015547 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.015518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsch\" (UniqueName: \"kubernetes.io/projected/3381c149-9860-429f-b806-62ba1917f5eb-kube-api-access-6wsch\") pod \"console-76cd89f5b5-2vf4n\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.170123 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.170049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:19:59.297481 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.297454 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cd89f5b5-2vf4n"] Jul 27 14:19:59.299988 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:19:59.299956 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3381c149_9860_429f_b806_62ba1917f5eb.slice/crio-7ef79d171cba88d92fcb89996ccbd4a8aad985cd495d7480623e3f54a2ae6daa WatchSource:0}: Error finding container 7ef79d171cba88d92fcb89996ccbd4a8aad985cd495d7480623e3f54a2ae6daa: Status 404 returned error can't find the container with id 7ef79d171cba88d92fcb89996ccbd4a8aad985cd495d7480623e3f54a2ae6daa Jul 27 14:19:59.496408 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496380 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835" exitCode=0 Jul 27 14:19:59.496408 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496404 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392" exitCode=0 Jul 27 14:19:59.496408 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496410 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895" exitCode=0 Jul 27 14:19:59.496634 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496416 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2" exitCode=0 Jul 27 14:19:59.496634 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835"} Jul 27 14:19:59.496634 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496522 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392"} Jul 27 14:19:59.496634 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895"} Jul 27 14:19:59.496634 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.496591 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2"} Jul 27 14:19:59.498041 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.498015 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd89f5b5-2vf4n" event={"ID":"3381c149-9860-429f-b806-62ba1917f5eb","Type":"ContainerStarted","Data":"ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada"} Jul 27 14:19:59.498134 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.498056 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd89f5b5-2vf4n" event={"ID":"3381c149-9860-429f-b806-62ba1917f5eb","Type":"ContainerStarted","Data":"7ef79d171cba88d92fcb89996ccbd4a8aad985cd495d7480623e3f54a2ae6daa"} Jul 27 14:19:59.519588 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.519519 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76cd89f5b5-2vf4n" podStartSLOduration=1.519505779 podStartE2EDuration="1.519505779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:19:59.519012792 +0000 UTC m=+176.446646071" watchObservedRunningTime="2026-07-27 14:19:59.519505779 +0000 UTC m=+176.447139060" Jul 27 14:19:59.725516 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.725495 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:19:59.812985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.812918 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.812985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.812961 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-tls-assets\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.812999 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-out\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813030 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-metrics-client-ca\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813071 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-main-tls\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813104 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-web-config\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-web\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813167 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813163 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-cluster-tls-config\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813463 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813189 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813463 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813215 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp7vv\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-kube-api-access-kp7vv\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813463 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813259 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-trusted-ca-bundle\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813463 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813292 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-volume\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813463 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813331 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-main-db\") pod \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\" (UID: \"2fa70ec1-f651-4959-b57c-90d07d7ed0e7\") " Jul 27 14:19:59.813463 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813417 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:59.813769 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813727 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 14:19:59.813834 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.813785 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-metrics-client-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.814220 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.814177 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:19:59.815870 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.815842 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.815966 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.815869 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:19:59.816365 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.816269 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-kube-api-access-kp7vv" (OuterVolumeSpecName: "kube-api-access-kp7vv") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "kube-api-access-kp7vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:19:59.816365 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.816305 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-out" (OuterVolumeSpecName: "config-out") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 14:19:59.816365 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.816315 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.816365 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.816332 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.816918 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.816899 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.817579 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.817552 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-volume" (OuterVolumeSpecName: "config-volume") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.820389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.820369 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.826281 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.826261 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-web-config" (OuterVolumeSpecName: "web-config") pod "2fa70ec1-f651-4959-b57c-90d07d7ed0e7" (UID: "2fa70ec1-f651-4959-b57c-90d07d7ed0e7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:19:59.914590 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914550 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-main-tls\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.914590 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914587 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-web-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.914590 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914601 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914612 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-cluster-tls-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914621 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914630 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp7vv\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-kube-api-access-kp7vv\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914638 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914648 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-volume\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914657 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-alertmanager-main-db\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914665 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914674 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-tls-assets\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:19:59.915020 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:19:59.914681 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fa70ec1-f651-4959-b57c-90d07d7ed0e7-config-out\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:00.506133 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506103 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72" exitCode=0 Jul 27 14:20:00.506133 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506133 2577 generic.go:356] "Generic (PLEG): container finished" podID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerID="fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466" exitCode=0 Jul 27 14:20:00.506315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72"} Jul 27 14:20:00.506315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506208 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 27 14:20:00.506315 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506282 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466"} Jul 27 14:20:00.506423 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2fa70ec1-f651-4959-b57c-90d07d7ed0e7","Type":"ContainerDied","Data":"280a3d136504cc91154653ebdea441082ddbaf519ba7444faa9ee90670e2e456"} Jul 27 14:20:00.506423 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.506360 2577 scope.go:117] "RemoveContainer" containerID="8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835" Jul 27 14:20:00.519535 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.519517 2577 scope.go:117] "RemoveContainer" containerID="eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72" Jul 27 14:20:00.526306 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.526290 2577 scope.go:117] "RemoveContainer" containerID="1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392" Jul 27 14:20:00.532909 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.532891 2577 scope.go:117] "RemoveContainer" containerID="fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466" Jul 27 14:20:00.534639 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.534619 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 14:20:00.539067 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.539048 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 27 14:20:00.540881 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.540864 2577 scope.go:117] "RemoveContainer" containerID="ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895" Jul 27 14:20:00.547508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.547491 2577 scope.go:117] "RemoveContainer" containerID="17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2" Jul 27 14:20:00.554147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.554131 2577 scope.go:117] "RemoveContainer" containerID="6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599" Jul 27 14:20:00.560786 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.560764 2577 scope.go:117] "RemoveContainer" containerID="8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835" Jul 27 14:20:00.561021 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.561002 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835\": container with ID starting with 8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835 not found: ID does not exist" containerID="8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835" Jul 27 14:20:00.561090 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561032 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835"} err="failed to get container status \"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835\": rpc error: code = NotFound desc = could not find container \"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835\": container with ID starting with 8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835 not found: ID does not exist" Jul 27 14:20:00.561090 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561056 2577 scope.go:117] "RemoveContainer" containerID="eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72" Jul 27 14:20:00.561304 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.561286 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72\": container with ID starting with eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72 not found: ID does not exist" containerID="eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72" Jul 27 14:20:00.561345 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561311 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72"} err="failed to get container status \"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72\": rpc error: code = NotFound desc = could not find container \"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72\": container with ID starting with eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72 not found: ID does not exist" Jul 27 14:20:00.561345 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561328 2577 scope.go:117] "RemoveContainer" containerID="1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392" Jul 27 14:20:00.561522 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.561506 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392\": container with ID starting with 1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392 not found: ID does not exist" containerID="1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392" Jul 27 14:20:00.561586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561528 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392"} err="failed to get container status \"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392\": rpc error: code = NotFound desc = could not find container \"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392\": container with ID starting with 1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392 not found: ID does not exist" Jul 27 14:20:00.561586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561547 2577 scope.go:117] "RemoveContainer" containerID="fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466" Jul 27 14:20:00.561790 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.561773 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466\": container with ID starting with fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466 not found: ID does not exist" containerID="fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466" Jul 27 14:20:00.561834 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561794 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466"} err="failed to get container status \"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466\": rpc error: code = NotFound desc = could not find container \"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466\": container with ID starting with fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466 not found: ID does not exist" Jul 27 14:20:00.561834 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.561807 2577 scope.go:117] "RemoveContainer" containerID="ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895" Jul 27 14:20:00.562014 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.561997 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895\": container with ID starting with ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895 not found: ID does not exist" containerID="ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895" Jul 27 14:20:00.562050 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562018 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895"} err="failed to get container status \"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895\": rpc error: code = NotFound desc = could not find container \"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895\": container with ID starting with ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895 not found: ID does not exist" Jul 27 14:20:00.562050 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562042 2577 scope.go:117] "RemoveContainer" containerID="17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2" Jul 27 14:20:00.562214 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.562196 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2\": container with ID starting with 17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2 not found: ID does not exist" containerID="17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2" Jul 27 14:20:00.562270 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562220 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2"} err="failed to get container status \"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2\": rpc error: code = NotFound desc = could not find container \"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2\": container with ID starting with 17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2 not found: ID does not exist" Jul 27 14:20:00.562270 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562239 2577 scope.go:117] "RemoveContainer" containerID="6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599" Jul 27 14:20:00.562460 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:00.562446 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599\": container with ID starting with 6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599 not found: ID does not exist" containerID="6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599" Jul 27 14:20:00.562501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562465 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599"} err="failed to get container status \"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599\": rpc error: code = NotFound desc = could not find container \"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599\": container with ID starting with 6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599 not found: ID does not exist" Jul 27 14:20:00.562501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562477 2577 scope.go:117] "RemoveContainer" containerID="8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835" Jul 27 14:20:00.562674 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562650 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835"} err="failed to get container status \"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835\": rpc error: code = NotFound desc = could not find container \"8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835\": container with ID starting with 8c6bf293514e4fa2f9ed266f7374c63c630c82b9dc32c7336884c4ca29cdd835 not found: ID does not exist" Jul 27 14:20:00.562770 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562676 2577 scope.go:117] "RemoveContainer" containerID="eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72" Jul 27 14:20:00.562945 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562929 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72"} err="failed to get container status \"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72\": rpc error: code = NotFound desc = could not find container \"eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72\": container with ID starting with eab08c188aaa6186905f82907dbe5c99f6f8663ef5e9fd1bacfb6715a9e00e72 not found: ID does not exist" Jul 27 14:20:00.562992 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.562946 2577 scope.go:117] "RemoveContainer" containerID="1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392" Jul 27 14:20:00.563133 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563113 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392"} err="failed to get container status \"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392\": rpc error: code = NotFound desc = could not find container \"1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392\": container with ID starting with 1930738d8e05a662a78c517588e1ad98780a44b10742356aca59a4e524bd1392 not found: ID does not exist" Jul 27 14:20:00.563198 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563133 2577 scope.go:117] "RemoveContainer" containerID="fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466" Jul 27 14:20:00.563304 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563289 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466"} err="failed to get container status \"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466\": rpc error: code = NotFound desc = could not find container \"fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466\": container with ID starting with fede2ec0317ae6256f951cd862d3e72899f8e4891298c78c518777145bda4466 not found: ID does not exist" Jul 27 14:20:00.563347 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563307 2577 scope.go:117] "RemoveContainer" containerID="ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895" Jul 27 14:20:00.563495 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563480 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895"} err="failed to get container status \"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895\": rpc error: code = NotFound desc = could not find container \"ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895\": container with ID starting with ca53db4e8399428cb4c1009d9e46ef31979e25d0d98a369b34568d50a5e44895 not found: ID does not exist" Jul 27 14:20:00.563559 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563497 2577 scope.go:117] "RemoveContainer" containerID="17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2" Jul 27 14:20:00.563721 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563684 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2"} err="failed to get container status \"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2\": rpc error: code = NotFound desc = could not find container \"17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2\": container with ID starting with 17bc94d73d2b2f94478769ffe7124ceffb12b3b6e2e45c3384bbf5aa3c3eb0b2 not found: ID does not exist" Jul 27 14:20:00.563765 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563721 2577 scope.go:117] "RemoveContainer" containerID="6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599" Jul 27 14:20:00.563946 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:00.563928 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599"} err="failed to get container status \"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599\": rpc error: code = NotFound desc = could not find container \"6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599\": container with ID starting with 6465682f804978e44ec144c9b48fd9597ef61a6875a821d4047d951e50678599 not found: ID does not exist" Jul 27 14:20:01.654100 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:01.654062 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" path="/var/lib/kubelet/pods/2fa70ec1-f651-4959-b57c-90d07d7ed0e7/volumes" Jul 27 14:20:02.085898 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.085857 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:20:02.086287 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.086237 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="prometheus" containerID="cri-o://861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" gracePeriod=600 Jul 27 14:20:02.086625 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.086601 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" gracePeriod=600 Jul 27 14:20:02.086761 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.086740 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy" containerID="cri-o://8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" gracePeriod=600 Jul 27 14:20:02.086839 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.086825 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-web" containerID="cri-o://ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" gracePeriod=600 Jul 27 14:20:02.086911 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.086895 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="thanos-sidecar" containerID="cri-o://44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" gracePeriod=600 Jul 27 14:20:02.086984 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.086968 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="config-reloader" containerID="cri-o://6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" gracePeriod=600 Jul 27 14:20:02.340336 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.340270 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.436424 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436391 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-tls\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436436 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-serving-certs-ca-bundle\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436469 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-1\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436511 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-0\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-web-config\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436574 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-metrics-client-certs\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436881 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436617 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-thanos-prometheus-http-client-file\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436881 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436642 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-db\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.436881 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436674 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-2\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437024 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436886 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.437024 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.436957 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.437024 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437014 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437171 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-kube-rbac-proxy\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437223 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437167 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-trusted-ca-bundle\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437223 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437175 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.437223 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437212 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-metrics-client-ca\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437375 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437240 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437375 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437274 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-config-out\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437375 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437313 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-grpc-tls\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437375 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437341 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-tls-assets\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437375 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437366 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbmx4\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-kube-api-access-pbmx4\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437623 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437395 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-kubelet-serving-ca-bundle\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437623 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437431 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-config\") pod \"23db7125-aedf-4137-b60c-ed115e1672d2\" (UID: \"23db7125-aedf-4137-b60c-ed115e1672d2\") " Jul 27 14:20:02.437623 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.437608 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.438124 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.438097 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 14:20:02.438533 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.438459 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.438533 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.438497 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.438533 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.438518 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.438533 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.438532 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.439732 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.439453 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.439829 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.439768 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.439829 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.439798 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.439970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.439839 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-config" (OuterVolumeSpecName: "config") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.440027 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.440003 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.440235 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.440205 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:02.440235 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.440216 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.440359 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.440299 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.441251 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.441224 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-config-out" (OuterVolumeSpecName: "config-out") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 14:20:02.441511 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.441490 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-kube-api-access-pbmx4" (OuterVolumeSpecName: "kube-api-access-pbmx4") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "kube-api-access-pbmx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:20:02.441599 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.441505 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:20:02.441655 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.441631 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.442053 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.442030 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.442267 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.442250 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.448852 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.448831 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-web-config" (OuterVolumeSpecName: "web-config") pod "23db7125-aedf-4137-b60c-ed115e1672d2" (UID: "23db7125-aedf-4137-b60c-ed115e1672d2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:02.517630 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517595 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" exitCode=0 Jul 27 14:20:02.517630 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517626 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" exitCode=0 Jul 27 14:20:02.517630 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517636 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" exitCode=0 Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517646 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" exitCode=0 Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517656 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" exitCode=0 Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517665 2577 generic.go:356] "Generic (PLEG): container finished" podID="23db7125-aedf-4137-b60c-ed115e1672d2" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" exitCode=0 Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517687 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517680 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517801 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517849 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517867 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.517927 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} Jul 27 14:20:02.518334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517934 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} Jul 27 14:20:02.518334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.517975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} Jul 27 14:20:02.518334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.518018 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"23db7125-aedf-4137-b60c-ed115e1672d2","Type":"ContainerDied","Data":"bfca89ba4c3518f637917cd1130afe0e33aec51fada20a7aea3fe99999a2e51d"} Jul 27 14:20:02.526034 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.526019 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.537300 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.537281 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.539407 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539387 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-grpc-tls\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.539508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539411 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-tls-assets\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.539508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539448 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbmx4\" (UniqueName: \"kubernetes.io/projected/23db7125-aedf-4137-b60c-ed115e1672d2-kube-api-access-pbmx4\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.539508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539466 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.539508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539480 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.539508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539492 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.539508 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539505 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-web-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539518 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-metrics-client-certs\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539531 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539545 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-k8s-db\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539559 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539573 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-kube-rbac-proxy\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539587 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539602 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23db7125-aedf-4137-b60c-ed115e1672d2-configmap-metrics-client-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539615 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/23db7125-aedf-4137-b60c-ed115e1672d2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.540017 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.539629 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/23db7125-aedf-4137-b60c-ed115e1672d2-config-out\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:02.544121 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.544079 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.545722 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.545681 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:20:02.551307 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.551290 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.552459 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.552430 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:20:02.557599 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.557583 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.564170 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.564153 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.570484 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.570468 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.570780 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.570761 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.570851 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.570789 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} err="failed to get container status \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" Jul 27 14:20:02.570851 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.570810 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.571035 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.571017 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.571092 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571044 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} err="failed to get container status \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" Jul 27 14:20:02.571092 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571068 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.571313 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.571298 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.571374 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571320 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} err="failed to get container status \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" Jul 27 14:20:02.571374 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571341 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.571543 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.571527 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.571602 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571549 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} err="failed to get container status \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" Jul 27 14:20:02.571602 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571568 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.571837 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.571806 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.571874 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571846 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} err="failed to get container status \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" Jul 27 14:20:02.571874 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.571867 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.572105 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.572089 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.572166 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572111 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} err="failed to get container status \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" Jul 27 14:20:02.572166 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572130 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.572365 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:02.572350 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.572399 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572369 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} err="failed to get container status \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" Jul 27 14:20:02.572399 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572387 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.572585 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572566 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} err="failed to get container status \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" Jul 27 14:20:02.572668 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572586 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.572795 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572778 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} err="failed to get container status \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" Jul 27 14:20:02.572843 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572795 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.572967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572950 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} err="failed to get container status \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" Jul 27 14:20:02.573014 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.572967 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.573171 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573153 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} err="failed to get container status \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" Jul 27 14:20:02.573241 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573173 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.573352 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573334 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} err="failed to get container status \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" Jul 27 14:20:02.573408 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573352 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.573505 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573489 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} err="failed to get container status \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" Jul 27 14:20:02.573554 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573505 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.573721 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573684 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} err="failed to get container status \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" Jul 27 14:20:02.573721 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573715 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.573894 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573877 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} err="failed to get container status \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" Jul 27 14:20:02.573944 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.573895 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.574091 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574072 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} err="failed to get container status \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" Jul 27 14:20:02.574133 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574091 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.574253 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574238 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} err="failed to get container status \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" Jul 27 14:20:02.574299 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574253 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.574457 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574441 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} err="failed to get container status \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" Jul 27 14:20:02.574503 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574458 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.574644 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574626 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} err="failed to get container status \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" Jul 27 14:20:02.574735 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574645 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.574842 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574825 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} err="failed to get container status \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" Jul 27 14:20:02.574910 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.574845 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.577296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.577274 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} err="failed to get container status \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" Jul 27 14:20:02.577296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.577297 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.577745 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.577726 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} err="failed to get container status \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" Jul 27 14:20:02.577806 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.577746 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.577995 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.577973 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} err="failed to get container status \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" Jul 27 14:20:02.578056 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.577997 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.578268 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578248 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} err="failed to get container status \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" Jul 27 14:20:02.578313 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578270 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.578496 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578472 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} err="failed to get container status \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" Jul 27 14:20:02.578554 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578497 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.578737 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578695 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} err="failed to get container status \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" Jul 27 14:20:02.578792 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578738 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.578932 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578916 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} err="failed to get container status \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" Jul 27 14:20:02.578932 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.578931 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.579136 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.579118 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} err="failed to get container status \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" Jul 27 14:20:02.579180 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.579137 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.579344 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.579316 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} err="failed to get container status \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" Jul 27 14:20:02.579344 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.579344 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.579784 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.579744 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} err="failed to get container status \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" Jul 27 14:20:02.579784 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.579769 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.580258 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580078 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} err="failed to get container status \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" Jul 27 14:20:02.580258 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580102 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.580334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580306 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} err="failed to get container status \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" Jul 27 14:20:02.580334 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580322 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.580521 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580499 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} err="failed to get container status \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" Jul 27 14:20:02.580562 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580523 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.580779 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580760 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} err="failed to get container status \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" Jul 27 14:20:02.580833 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.580780 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.581030 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581011 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} err="failed to get container status \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" Jul 27 14:20:02.581030 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581030 2577 scope.go:117] "RemoveContainer" containerID="a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757" Jul 27 14:20:02.581243 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581227 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757"} err="failed to get container status \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": rpc error: code = NotFound desc = could not find container \"a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757\": container with ID starting with a142e6a6b812952c2061e908a906a76803d0c07e724825faed5a894fdd508757 not found: ID does not exist" Jul 27 14:20:02.581297 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581244 2577 scope.go:117] "RemoveContainer" containerID="8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5" Jul 27 14:20:02.581461 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581433 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5"} err="failed to get container status \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": rpc error: code = NotFound desc = could not find container \"8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5\": container with ID starting with 8c4a17fb7a31b197d99719adf4e9cd386d04098d9c963052627b96e23f1244c5 not found: ID does not exist" Jul 27 14:20:02.581461 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581449 2577 scope.go:117] "RemoveContainer" containerID="ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac" Jul 27 14:20:02.581639 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581621 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:20:02.581696 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581656 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac"} err="failed to get container status \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": rpc error: code = NotFound desc = could not find container \"ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac\": container with ID starting with ad236459b34d3df57286290a85fc9594c51b39b16ba80cb953b1a6074aa618ac not found: ID does not exist" Jul 27 14:20:02.581696 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581676 2577 scope.go:117] "RemoveContainer" containerID="44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77" Jul 27 14:20:02.581924 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581895 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77"} err="failed to get container status \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": rpc error: code = NotFound desc = could not find container \"44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77\": container with ID starting with 44e71bcc1ca417353e2088bc3c999d2200aaa40d97ca3aa6c86450b50e268c77 not found: ID does not exist" Jul 27 14:20:02.581972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581925 2577 scope.go:117] "RemoveContainer" containerID="6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9" Jul 27 14:20:02.581972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581959 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="init-config-reloader" Jul 27 14:20:02.581972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581971 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="init-config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581980 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-web" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581985 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-web" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.581995 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582003 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582012 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="alertmanager" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582018 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="alertmanager" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582027 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582034 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582042 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="init-config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582050 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="init-config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582058 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582066 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="config-reloader" Jul 27 14:20:02.582074 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582078 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-web" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582085 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-web" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582095 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-metric" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582103 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-metric" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582114 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-thanos" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582122 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-thanos" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582134 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582132 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9"} err="failed to get container status \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": rpc error: code = NotFound desc = could not find container \"6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9\": container with ID starting with 6c04482ef5e699fdc07f5eb752ca654933aa56796aefe1bc8a7f710236b2f7c9 not found: ID does not exist" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582166 2577 scope.go:117] "RemoveContainer" containerID="861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582142 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582217 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="prometheus" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582226 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="prometheus" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582243 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="prom-label-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582250 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="prom-label-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582258 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="thanos-sidecar" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582264 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="thanos-sidecar" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582327 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="prom-label-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582336 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582341 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-web" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582350 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582358 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="config-reloader" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582367 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="thanos-sidecar" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582375 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-web" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582383 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="kube-rbac-proxy-metric" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582389 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="kube-rbac-proxy-thanos" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582376 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c"} err="failed to get container status \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": rpc error: code = NotFound desc = could not find container \"861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c\": container with ID starting with 861d124d2556a1bd1277bc2458a7f7c0ac88db9836f0488a26de5d5b6569fc8c not found: ID does not exist" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582406 2577 scope.go:117] "RemoveContainer" containerID="05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582397 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="config-reloader" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582449 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" containerName="prometheus" Jul 27 14:20:02.582578 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582458 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa70ec1-f651-4959-b57c-90d07d7ed0e7" containerName="alertmanager" Jul 27 14:20:02.583819 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.582617 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5"} err="failed to get container status \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": rpc error: code = NotFound desc = could not find container \"05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5\": container with ID starting with 05c67ed32ca0681aa33bbc34a5f2ce8ac11c774a4246a07c273298984f2c99b5 not found: ID does not exist" Jul 27 14:20:02.585476 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.585461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.589396 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589377 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 14:20:02.589582 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 14:20:02.589582 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589532 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 14:20:02.589768 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589588 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 14:20:02.589768 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589693 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 14:20:02.589768 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589716 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 14:20:02.589768 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589744 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 14:20:02.589949 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.589823 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 14:20:02.590068 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590048 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nxgrp\"" Jul 27 14:20:02.590164 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590088 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 14:20:02.590164 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590116 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 14:20:02.590252 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590233 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dqj32ne90t604\"" Jul 27 14:20:02.590537 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590493 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 14:20:02.590537 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590525 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 14:20:02.590772 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.590694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 14:20:02.592530 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.592513 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 14:20:02.594460 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.594443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 14:20:02.599695 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.599678 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:20:02.741194 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741194 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-web-config\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-config\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aabb1f3-2835-4ae9-9b77-ac466b986754-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmlx7\" (UniqueName: \"kubernetes.io/projected/0aabb1f3-2835-4ae9-9b77-ac466b986754-kube-api-access-bmlx7\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741538 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aabb1f3-2835-4ae9-9b77-ac466b986754-config-out\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.741645 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.742214 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.742214 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741822 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.742214 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.741853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843176 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843095 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843176 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843176 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843176 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843516 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-web-config\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843516 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843516 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843667 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843667 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843667 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-config\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843692 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aabb1f3-2835-4ae9-9b77-ac466b986754-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmlx7\" (UniqueName: \"kubernetes.io/projected/0aabb1f3-2835-4ae9-9b77-ac466b986754-kube-api-access-bmlx7\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.843854 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843852 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aabb1f3-2835-4ae9-9b77-ac466b986754-config-out\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843969 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.843992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.844330 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.844372 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.844447 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.844405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.845010 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.844984 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.846670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.846347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.846670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.846380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-web-config\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.846670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.846380 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.846670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.846508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aabb1f3-2835-4ae9-9b77-ac466b986754-config-out\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.846670 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.846523 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.847225 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.847194 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.847577 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.847554 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.847673 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.847655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-config\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.847824 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.847809 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.848457 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.848437 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.848849 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.848833 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aabb1f3-2835-4ae9-9b77-ac466b986754-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.848943 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.848929 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aabb1f3-2835-4ae9-9b77-ac466b986754-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.849743 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.849727 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0aabb1f3-2835-4ae9-9b77-ac466b986754-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.856856 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.856838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmlx7\" (UniqueName: \"kubernetes.io/projected/0aabb1f3-2835-4ae9-9b77-ac466b986754-kube-api-access-bmlx7\") pod \"prometheus-k8s-0\" (UID: \"0aabb1f3-2835-4ae9-9b77-ac466b986754\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:02.897040 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:02.897017 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:03.028296 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:03.028272 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 14:20:03.030283 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:20:03.030255 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aabb1f3_2835_4ae9_9b77_ac466b986754.slice/crio-7c62da2a818956b537ea6ecf0dfe348deb72020ca3d488d9beb4ddc96799c399 WatchSource:0}: Error finding container 7c62da2a818956b537ea6ecf0dfe348deb72020ca3d488d9beb4ddc96799c399: Status 404 returned error can't find the container with id 7c62da2a818956b537ea6ecf0dfe348deb72020ca3d488d9beb4ddc96799c399 Jul 27 14:20:03.523121 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:03.523093 2577 generic.go:356] "Generic (PLEG): container finished" podID="0aabb1f3-2835-4ae9-9b77-ac466b986754" containerID="204e526ea7bae63d695a06c51940a72a135e4573cf08d68930d97d0b123b140f" exitCode=0 Jul 27 14:20:03.523301 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:03.523180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerDied","Data":"204e526ea7bae63d695a06c51940a72a135e4573cf08d68930d97d0b123b140f"} Jul 27 14:20:03.523301 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:03.523240 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"7c62da2a818956b537ea6ecf0dfe348deb72020ca3d488d9beb4ddc96799c399"} Jul 27 14:20:03.656274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:03.656251 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23db7125-aedf-4137-b60c-ed115e1672d2" path="/var/lib/kubelet/pods/23db7125-aedf-4137-b60c-ed115e1672d2/volumes" Jul 27 14:20:04.530340 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.530302 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"dde088a7b442f5e7b381b46beeb7fd0e9b4dd13d8c0fa876898ce4a392288362"} Jul 27 14:20:04.530803 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.530369 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"629fc0076834e76f2282f987c8143405e9bbd6f651e0023ec7f3b6fbb6229c8c"} Jul 27 14:20:04.530803 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.530395 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"3b600fabb6c4387c8e3c5d203345f937033a9531eb35cc2793a7092d3a1cec33"} Jul 27 14:20:04.530803 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.530421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"2866d1ed266731f5dd33e9015eb09df3f6c9c6de08fc59bf0048152fdd4b1646"} Jul 27 14:20:04.530803 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.530443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"e642fa279e1e929b8b35c0e457901f0817be70393a26243024dfdf754c54fa46"} Jul 27 14:20:04.530803 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.530468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aabb1f3-2835-4ae9-9b77-ac466b986754","Type":"ContainerStarted","Data":"dab9320d0406aabd4486412e655c992856824d18ae71c87ef8aca516cce6e490"} Jul 27 14:20:04.562107 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:04.562063 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.541560198 podStartE2EDuration="2.562047459s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.487261ms" isStatefulPod=false podCreationTimestamp="2026-07-27 14:20:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:20:04.559749774 +0000 UTC m=+181.487383056" watchObservedRunningTime="2026-07-27 14:20:04.562047459 +0000 UTC m=+181.489680741" Jul 27 14:20:07.898101 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:07.898049 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:20:09.171248 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:09.171217 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:20:09.171730 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:09.171290 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:20:09.176013 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:09.175992 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:20:09.553004 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:09.552981 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:20:09.588049 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:09.588019 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-876dc8cd6-6mnd2"] Jul 27 14:20:34.607581 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.607545 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-876dc8cd6-6mnd2" podUID="45f5e921-d798-4ef1-b557-2543f6a24ffd" containerName="console" containerID="cri-o://f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73" gracePeriod=15 Jul 27 14:20:34.856535 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.856513 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:20:34.909327 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909241 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-oauth-config\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909327 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909297 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-serving-cert\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909327 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909329 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-oauth-serving-cert\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909364 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-trusted-ca-bundle\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909402 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-config\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909447 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-service-ca\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909491 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsl7t\" (UniqueName: \"kubernetes.io/projected/45f5e921-d798-4ef1-b557-2543f6a24ffd-kube-api-access-gsl7t\") pod \"45f5e921-d798-4ef1-b557-2543f6a24ffd\" (UID: \"45f5e921-d798-4ef1-b557-2543f6a24ffd\") " Jul 27 14:20:34.909850 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909806 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:34.909967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909872 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-config" (OuterVolumeSpecName: "console-config") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:34.909967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909893 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-service-ca" (OuterVolumeSpecName: "service-ca") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:34.909967 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.909880 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:20:34.911376 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.911354 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:34.911473 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.911456 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f5e921-d798-4ef1-b557-2543f6a24ffd-kube-api-access-gsl7t" (OuterVolumeSpecName: "kube-api-access-gsl7t") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "kube-api-access-gsl7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:20:34.911528 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:34.911476 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "45f5e921-d798-4ef1-b557-2543f6a24ffd" (UID: "45f5e921-d798-4ef1-b557-2543f6a24ffd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:20:35.010101 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010070 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-trusted-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.010101 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010095 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.010257 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010108 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-service-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.010257 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010121 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsl7t\" (UniqueName: \"kubernetes.io/projected/45f5e921-d798-4ef1-b557-2543f6a24ffd-kube-api-access-gsl7t\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.010257 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010134 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-oauth-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.010257 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010145 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/45f5e921-d798-4ef1-b557-2543f6a24ffd-console-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.010257 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.010156 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/45f5e921-d798-4ef1-b557-2543f6a24ffd-oauth-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:20:35.640683 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.640651 2577 generic.go:356] "Generic (PLEG): container finished" podID="45f5e921-d798-4ef1-b557-2543f6a24ffd" containerID="f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73" exitCode=0 Jul 27 14:20:35.641090 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.640720 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc8cd6-6mnd2" Jul 27 14:20:35.641090 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.640735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc8cd6-6mnd2" event={"ID":"45f5e921-d798-4ef1-b557-2543f6a24ffd","Type":"ContainerDied","Data":"f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73"} Jul 27 14:20:35.641090 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.640794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc8cd6-6mnd2" event={"ID":"45f5e921-d798-4ef1-b557-2543f6a24ffd","Type":"ContainerDied","Data":"169c97f4159535d01aae333d3ae947483d319f1d34328a47de602aba4c503f9f"} Jul 27 14:20:35.641090 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.640824 2577 scope.go:117] "RemoveContainer" containerID="f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73" Jul 27 14:20:35.648805 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.648788 2577 scope.go:117] "RemoveContainer" containerID="f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73" Jul 27 14:20:35.649063 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:20:35.649047 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73\": container with ID starting with f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73 not found: ID does not exist" containerID="f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73" Jul 27 14:20:35.649108 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.649072 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73"} err="failed to get container status \"f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73\": rpc error: code = NotFound desc = could not find container \"f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73\": container with ID starting with f0e27223af80e2725bee24cdfd5ead358112f4145bc9525572bf70109d325a73 not found: ID does not exist" Jul 27 14:20:35.660573 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.660548 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-876dc8cd6-6mnd2"] Jul 27 14:20:35.666115 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:35.666097 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-876dc8cd6-6mnd2"] Jul 27 14:20:37.653372 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:20:37.653339 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f5e921-d798-4ef1-b557-2543f6a24ffd" path="/var/lib/kubelet/pods/45f5e921-d798-4ef1-b557-2543f6a24ffd/volumes" Jul 27 14:21:02.898147 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:21:02.898100 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:21:02.913199 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:21:02.913173 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:21:03.753983 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:21:03.753900 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 14:22:03.472802 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:22:03.472775 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 14:23:56.811187 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.811152 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7487f44745-mf5mq"] Jul 27 14:23:56.811633 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.811436 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f5e921-d798-4ef1-b557-2543f6a24ffd" containerName="console" Jul 27 14:23:56.811633 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.811446 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f5e921-d798-4ef1-b557-2543f6a24ffd" containerName="console" Jul 27 14:23:56.811633 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.811494 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f5e921-d798-4ef1-b557-2543f6a24ffd" containerName="console" Jul 27 14:23:56.814219 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.814204 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.830589 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.830567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7487f44745-mf5mq"] Jul 27 14:23:56.917713 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-oauth-serving-cert\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.917877 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-service-ca\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.917877 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917756 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47v8\" (UniqueName: \"kubernetes.io/projected/ecb504b6-29bd-4888-b49d-c3bfe15d6230-kube-api-access-g47v8\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.917877 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-oauth-config\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.917877 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-serving-cert\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.917877 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-config\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:56.918081 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:56.917897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-trusted-ca-bundle\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-oauth-serving-cert\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018586 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-service-ca\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018841 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47v8\" (UniqueName: \"kubernetes.io/projected/ecb504b6-29bd-4888-b49d-c3bfe15d6230-kube-api-access-g47v8\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018841 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-oauth-config\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018841 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-serving-cert\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018841 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-config\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.018841 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.018781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-trusted-ca-bundle\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.019383 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.019359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-service-ca\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.019383 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.019376 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-oauth-serving-cert\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.019544 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.019472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-config\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.019691 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.019671 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecb504b6-29bd-4888-b49d-c3bfe15d6230-trusted-ca-bundle\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.021037 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.021013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-oauth-config\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.021164 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.021147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ecb504b6-29bd-4888-b49d-c3bfe15d6230-console-serving-cert\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.026954 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.026932 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47v8\" (UniqueName: \"kubernetes.io/projected/ecb504b6-29bd-4888-b49d-c3bfe15d6230-kube-api-access-g47v8\") pod \"console-7487f44745-mf5mq\" (UID: \"ecb504b6-29bd-4888-b49d-c3bfe15d6230\") " pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.122881 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.122828 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:23:57.252726 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.252528 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7487f44745-mf5mq"] Jul 27 14:23:57.255581 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:23:57.255555 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb504b6_29bd_4888_b49d_c3bfe15d6230.slice/crio-57942fb81cc314a826db7b7604b32ead017c37a15179b05c19f0365019dc399d WatchSource:0}: Error finding container 57942fb81cc314a826db7b7604b32ead017c37a15179b05c19f0365019dc399d: Status 404 returned error can't find the container with id 57942fb81cc314a826db7b7604b32ead017c37a15179b05c19f0365019dc399d Jul 27 14:23:57.350828 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.350794 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7487f44745-mf5mq" event={"ID":"ecb504b6-29bd-4888-b49d-c3bfe15d6230","Type":"ContainerStarted","Data":"d7c7d1167da46eaa42711efaebd9d68c3886c01314808a17a0e585d05b31767e"} Jul 27 14:23:57.350955 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.350846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7487f44745-mf5mq" event={"ID":"ecb504b6-29bd-4888-b49d-c3bfe15d6230","Type":"ContainerStarted","Data":"57942fb81cc314a826db7b7604b32ead017c37a15179b05c19f0365019dc399d"} Jul 27 14:23:57.371154 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:23:57.371094 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7487f44745-mf5mq" podStartSLOduration=1.371074738 podStartE2EDuration="1.371074738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 14:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:23:57.369831808 +0000 UTC m=+414.297465090" watchObservedRunningTime="2026-07-27 14:23:57.371074738 +0000 UTC m=+414.298708020" Jul 27 14:24:07.123110 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:07.123069 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:24:07.123498 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:07.123133 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:24:07.127860 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:07.127830 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:24:07.397660 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:07.397584 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7487f44745-mf5mq" Jul 27 14:24:07.444084 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:07.444053 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cd89f5b5-2vf4n"] Jul 27 14:24:32.463154 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.463037 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76cd89f5b5-2vf4n" podUID="3381c149-9860-429f-b806-62ba1917f5eb" containerName="console" containerID="cri-o://ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada" gracePeriod=15 Jul 27 14:24:32.707910 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.707890 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:24:32.813202 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813171 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-console-config\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813361 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813218 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-oauth-serving-cert\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813361 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813235 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-service-ca\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813361 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813266 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-trusted-ca-bundle\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813361 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813293 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wsch\" (UniqueName: \"kubernetes.io/projected/3381c149-9860-429f-b806-62ba1917f5eb-kube-api-access-6wsch\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813361 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813308 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-serving-cert\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813361 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813338 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-oauth-config\") pod \"3381c149-9860-429f-b806-62ba1917f5eb\" (UID: \"3381c149-9860-429f-b806-62ba1917f5eb\") " Jul 27 14:24:32.813691 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813664 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-console-config" (OuterVolumeSpecName: "console-config") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:24:32.813787 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813695 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:24:32.813856 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813827 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:24:32.813903 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.813838 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 14:24:32.815411 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.815390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:24:32.815497 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.815450 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3381c149-9860-429f-b806-62ba1917f5eb-kube-api-access-6wsch" (OuterVolumeSpecName: "kube-api-access-6wsch") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "kube-api-access-6wsch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 14:24:32.815497 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.815450 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3381c149-9860-429f-b806-62ba1917f5eb" (UID: "3381c149-9860-429f-b806-62ba1917f5eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 14:24:32.914419 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914395 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-console-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:32.914419 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914418 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-oauth-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:32.914593 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914427 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-service-ca\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:32.914593 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914436 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3381c149-9860-429f-b806-62ba1917f5eb-trusted-ca-bundle\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:32.914593 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914444 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wsch\" (UniqueName: \"kubernetes.io/projected/3381c149-9860-429f-b806-62ba1917f5eb-kube-api-access-6wsch\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:32.914593 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914453 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-serving-cert\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:32.914593 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:32.914461 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3381c149-9860-429f-b806-62ba1917f5eb-console-oauth-config\") on node \"ip-10-0-139-60.ec2.internal\" DevicePath \"\"" Jul 27 14:24:33.490626 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.490589 2577 generic.go:356] "Generic (PLEG): container finished" podID="3381c149-9860-429f-b806-62ba1917f5eb" containerID="ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada" exitCode=0 Jul 27 14:24:33.491085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.490632 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cd89f5b5-2vf4n" Jul 27 14:24:33.491085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.490652 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd89f5b5-2vf4n" event={"ID":"3381c149-9860-429f-b806-62ba1917f5eb","Type":"ContainerDied","Data":"ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada"} Jul 27 14:24:33.491085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.490716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cd89f5b5-2vf4n" event={"ID":"3381c149-9860-429f-b806-62ba1917f5eb","Type":"ContainerDied","Data":"7ef79d171cba88d92fcb89996ccbd4a8aad985cd495d7480623e3f54a2ae6daa"} Jul 27 14:24:33.491085 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.490731 2577 scope.go:117] "RemoveContainer" containerID="ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada" Jul 27 14:24:33.498729 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.498691 2577 scope.go:117] "RemoveContainer" containerID="ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada" Jul 27 14:24:33.499009 ip-10-0-139-60 kubenswrapper[2577]: E0727 14:24:33.498989 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada\": container with ID starting with ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada not found: ID does not exist" containerID="ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada" Jul 27 14:24:33.499056 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.499017 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada"} err="failed to get container status \"ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada\": rpc error: code = NotFound desc = could not find container \"ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada\": container with ID starting with ba0b2ccb117bffb070d39bbd47223310b52a7a9d44215b57c1cf8dd741be5ada not found: ID does not exist" Jul 27 14:24:33.510870 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.510848 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76cd89f5b5-2vf4n"] Jul 27 14:24:33.514634 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.514612 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76cd89f5b5-2vf4n"] Jul 27 14:24:33.653485 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:24:33.653447 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3381c149-9860-429f-b806-62ba1917f5eb" path="/var/lib/kubelet/pods/3381c149-9860-429f-b806-62ba1917f5eb/volumes" Jul 27 14:46:57.961689 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:46:57.961614 2577 ???:1] "http: TLS handshake error from 10.0.133.223:55768: EOF" Jul 27 14:46:57.965891 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:46:57.965869 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-whbh6_8e4a8cab-05ad-4c99-8461-5293ad3ff669/global-pull-secret-syncer/0.log" Jul 27 14:46:58.083050 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:46:58.083018 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-trgmd_b5dbd46e-019e-4696-a73a-12646e9a02e6/konnectivity-agent/0.log" Jul 27 14:46:58.167495 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:46:58.167468 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-60.ec2.internal_35d86f8dc10c2acea0b453421180560d/haproxy/0.log" Jul 27 14:47:01.948663 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:01.948580 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-cq9vm_5b50c5c5-6273-4bfd-93fe-2fff6a1e69eb/monitoring-plugin/0.log" Jul 27 14:47:01.949389 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:01.949367 2577 ???:1] "http: TLS handshake error from 10.0.139.60:50016: EOF" Jul 27 14:47:02.030519 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.030482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mthw_bc43623a-866a-410d-a5de-4fc472b44b4a/node-exporter/0.log" Jul 27 14:47:02.067911 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.067886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mthw_bc43623a-866a-410d-a5de-4fc472b44b4a/kube-rbac-proxy/0.log" Jul 27 14:47:02.127436 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.127412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7mthw_bc43623a-866a-410d-a5de-4fc472b44b4a/init-textfile/0.log" Jul 27 14:47:02.469964 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.469939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xd8kf_262feac4-fdde-421a-bc8d-5d300762cb72/kube-rbac-proxy-main/0.log" Jul 27 14:47:02.500179 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.500155 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xd8kf_262feac4-fdde-421a-bc8d-5d300762cb72/kube-rbac-proxy-self/0.log" Jul 27 14:47:02.542904 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.542879 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-xd8kf_262feac4-fdde-421a-bc8d-5d300762cb72/openshift-state-metrics/0.log" Jul 27 14:47:02.604370 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.604337 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/prometheus/0.log" Jul 27 14:47:02.654502 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.654474 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/config-reloader/0.log" Jul 27 14:47:02.692430 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.692403 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/thanos-sidecar/0.log" Jul 27 14:47:02.727143 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.727079 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/kube-rbac-proxy-web/0.log" Jul 27 14:47:02.760665 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.760643 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/kube-rbac-proxy/0.log" Jul 27 14:47:02.804435 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.804412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/kube-rbac-proxy-thanos/0.log" Jul 27 14:47:02.846726 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.846684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aabb1f3-2835-4ae9-9b77-ac466b986754/init-config-reloader/0.log" Jul 27 14:47:02.898939 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.898910 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hf4wg_1b194be1-8e55-4b6f-ad41-4e6dc95bab4c/prometheus-operator/0.log" Jul 27 14:47:02.956433 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:02.956405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-hf4wg_1b194be1-8e55-4b6f-ad41-4e6dc95bab4c/kube-rbac-proxy/0.log" Jul 27 14:47:03.013883 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:03.013849 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-v8tzp_3b259b92-fe71-4ca0-b9d5-6c7136d7684e/prometheus-operator-admission-webhook/0.log" Jul 27 14:47:05.564103 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.564070 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842"] Jul 27 14:47:05.564514 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.564381 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3381c149-9860-429f-b806-62ba1917f5eb" containerName="console" Jul 27 14:47:05.564514 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.564392 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3381c149-9860-429f-b806-62ba1917f5eb" containerName="console" Jul 27 14:47:05.564514 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.564439 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3381c149-9860-429f-b806-62ba1917f5eb" containerName="console" Jul 27 14:47:05.567080 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.567063 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.571123 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.571101 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbxjx\"/\"openshift-service-ca.crt\"" Jul 27 14:47:05.571123 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.571117 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbxjx\"/\"kube-root-ca.crt\"" Jul 27 14:47:05.571274 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.571101 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rbxjx\"/\"default-dockercfg-p8wn4\"" Jul 27 14:47:05.585501 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.585470 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842"] Jul 27 14:47:05.674756 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.674697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckgts\" (UniqueName: \"kubernetes.io/projected/f0d71799-81d1-45e1-9459-a0d445153de0-kube-api-access-ckgts\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.674970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.674817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-proc\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.674970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.674866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-podres\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.674970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.674902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-sys\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.674970 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.674927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-lib-modules\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.682024 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.681999 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7487f44745-mf5mq_ecb504b6-29bd-4888-b49d-c3bfe15d6230/console/0.log" Jul 27 14:47:05.731522 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.731494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-xx9rd_1fd5e6c1-164b-41c6-ba9d-5df83ed57094/download-server/0.log" Jul 27 14:47:05.775776 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-sys\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.775985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-lib-modules\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.775985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775831 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckgts\" (UniqueName: \"kubernetes.io/projected/f0d71799-81d1-45e1-9459-a0d445153de0-kube-api-access-ckgts\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.775985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775891 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-proc\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.775985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-sys\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.775985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-podres\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.775985 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775968 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-proc\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.776267 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.775996 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-lib-modules\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.776267 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.776056 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d71799-81d1-45e1-9459-a0d445153de0-podres\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.784297 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.784274 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckgts\" (UniqueName: \"kubernetes.io/projected/f0d71799-81d1-45e1-9459-a0d445153de0-kube-api-access-ckgts\") pod \"perf-node-gather-daemonset-qn842\" (UID: \"f0d71799-81d1-45e1-9459-a0d445153de0\") " pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:05.876613 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:05.876523 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:06.004478 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:06.004399 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842"] Jul 27 14:47:06.006672 ip-10-0-139-60 kubenswrapper[2577]: W0727 14:47:06.006640 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0d71799_81d1_45e1_9459_a0d445153de0.slice/crio-39b6c9613d34d292be4ba7ec0fa0275afd501134798703b2aeae13ce3e89cf00 WatchSource:0}: Error finding container 39b6c9613d34d292be4ba7ec0fa0275afd501134798703b2aeae13ce3e89cf00: Status 404 returned error can't find the container with id 39b6c9613d34d292be4ba7ec0fa0275afd501134798703b2aeae13ce3e89cf00 Jul 27 14:47:06.237723 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:06.237676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" event={"ID":"f0d71799-81d1-45e1-9459-a0d445153de0","Type":"ContainerStarted","Data":"a59ed91eed7c6719782c8ae3de898dff48264750b62fc3f383dec7207515ec87"} Jul 27 14:47:06.237918 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:06.237753 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" event={"ID":"f0d71799-81d1-45e1-9459-a0d445153de0","Type":"ContainerStarted","Data":"39b6c9613d34d292be4ba7ec0fa0275afd501134798703b2aeae13ce3e89cf00"} Jul 27 14:47:06.237918 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:06.237782 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:06.254133 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:06.254082 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" podStartSLOduration=1.254065653 podStartE2EDuration="1.254065653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 14:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 14:47:06.253798916 +0000 UTC m=+1803.181432195" watchObservedRunningTime="2026-07-27 14:47:06.254065653 +0000 UTC m=+1803.181698937" Jul 27 14:47:07.110313 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:07.110290 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d4vs9_d01b13ec-b607-425e-9ef0-ae71f22afad5/dns/0.log" Jul 27 14:47:07.140814 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:07.140784 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d4vs9_d01b13ec-b607-425e-9ef0-ae71f22afad5/kube-rbac-proxy/0.log" Jul 27 14:47:07.206010 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:07.205979 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-blx2n_c676d3df-c2f0-4367-adcc-4a9850947bdc/dns-node-resolver/0.log" Jul 27 14:47:07.682719 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:07.682684 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67c9fd5fd-zcbvc_89d60295-85b5-41e0-a93c-9f4c77979d49/registry/0.log" Jul 27 14:47:07.706355 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:07.706328 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2v9c6_9dc80248-a8f6-46db-b4f4-709ab9483e98/node-ca/0.log" Jul 27 14:47:09.010921 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:09.010888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pj5hp_57736bb5-55bd-45f0-aaf7-c1229e54a8bc/serve-healthcheck-canary/0.log" Jul 27 14:47:09.643899 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:09.643865 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4rdh_c7057f7f-861c-41ea-a7bd-30dc7d01a0e4/kube-rbac-proxy/0.log" Jul 27 14:47:09.691622 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:09.691596 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4rdh_c7057f7f-861c-41ea-a7bd-30dc7d01a0e4/exporter/0.log" Jul 27 14:47:09.742812 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:09.742787 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w4rdh_c7057f7f-861c-41ea-a7bd-30dc7d01a0e4/extractor/0.log" Jul 27 14:47:12.251088 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:12.251052 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rbxjx/perf-node-gather-daemonset-qn842" Jul 27 14:47:15.501640 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.501609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5hfk6_934d5a8e-bb6f-4b51-811c-0d4d081d143c/kube-multus/0.log" Jul 27 14:47:15.737093 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.737064 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/kube-multus-additional-cni-plugins/0.log" Jul 27 14:47:15.762071 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.762046 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/egress-router-binary-copy/0.log" Jul 27 14:47:15.788212 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.788184 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/cni-plugins/0.log" Jul 27 14:47:15.815965 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.815938 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/bond-cni-plugin/0.log" Jul 27 14:47:15.840806 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.840778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/routeoverride-cni/0.log" Jul 27 14:47:15.863771 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.863740 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/whereabouts-cni-bincopy/0.log" Jul 27 14:47:15.887304 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:15.887277 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zbfkv_a874b4ad-7e47-49d1-8a8f-e7d90039a1a7/whereabouts-cni/0.log" Jul 27 14:47:16.149062 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:16.148977 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8rp8n_13865f74-f907-40fe-9ad0-09ad853e1531/network-metrics-daemon/0.log" Jul 27 14:47:16.178572 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:16.178540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8rp8n_13865f74-f907-40fe-9ad0-09ad853e1531/kube-rbac-proxy/0.log" Jul 27 14:47:17.027912 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.027875 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/ovn-controller/0.log" Jul 27 14:47:17.070012 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.069988 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/ovn-acl-logging/0.log" Jul 27 14:47:17.099513 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.099483 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/kube-rbac-proxy-node/0.log" Jul 27 14:47:17.126562 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.126534 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 14:47:17.162580 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.162547 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/northd/0.log" Jul 27 14:47:17.196815 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.196788 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/nbdb/0.log" Jul 27 14:47:17.233103 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.233077 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/sbdb/0.log" Jul 27 14:47:17.295393 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:17.295312 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c77qg_630f147a-b279-4728-80fb-08388320ed95/ovnkube-controller/0.log" Jul 27 14:47:18.831972 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:18.831943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nxl7t_c64ee3a8-cd70-4a40-acab-491bc4197b90/network-check-target-container/0.log" Jul 27 14:47:19.737629 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:19.737603 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-78mn2_2d4903fe-9140-46e9-9cd2-78b87ed4abb1/iptables-alerter/0.log" Jul 27 14:47:20.451900 ip-10-0-139-60 kubenswrapper[2577]: I0727 14:47:20.451862 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-g2x4z_a27b13dc-6809-44f9-919c-d98e8f1123fb/tuned/0.log"