Jul 16 07:32:40.881517 ip-10-0-141-197 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 07:32:40.881527 ip-10-0-141-197 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 07:32:40.881534 ip-10-0-141-197 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 07:32:40.881758 ip-10-0-141-197 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 07:32:50.917189 ip-10-0-141-197 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 07:32:50.917208 ip-10-0-141-197 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c91defe988c24650a9810dde413e2eea -- Jul 16 07:34:46.796816 ip-10-0-141-197 systemd[1]: Starting Kubernetes Kubelet... Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.536440 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548710 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548725 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548731 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548736 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548740 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548745 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548755 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 07:34:47.594532 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548761 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548766 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548771 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548776 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548780 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548790 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548795 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548799 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548804 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548809 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548813 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548818 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548822 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548827 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548834 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548839 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548844 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548852 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548856 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548861 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 07:34:47.599423 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548866 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548870 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548877 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548883 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548887 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548892 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548896 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548901 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548906 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548917 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548923 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548928 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548933 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548938 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548943 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548947 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548951 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548956 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548963 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 07:34:47.600327 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548968 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548972 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548982 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548986 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548989 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548994 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.548998 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549003 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549008 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549013 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549018 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549022 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549026 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549032 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549036 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549045 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549050 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549054 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549058 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549062 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 07:34:47.606095 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549066 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549070 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549075 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549082 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549088 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549093 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549097 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549106 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549111 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549116 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549124 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549128 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549132 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549137 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549141 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549146 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549151 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549156 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549164 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 07:34:47.606952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549168 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549173 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549178 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549183 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549187 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549191 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549196 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549200 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549205 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549209 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549214 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549219 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549227 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.549232 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551252 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551264 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551268 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551273 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551278 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551283 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 07:34:47.607854 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551288 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551293 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551298 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551303 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551307 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551312 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551316 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551325 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551330 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551334 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551339 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551343 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551348 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551358 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551362 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551368 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551373 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551378 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551382 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551386 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 07:34:47.612766 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551395 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551400 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551404 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551408 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551413 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551417 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551421 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551426 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551433 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551438 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551442 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551447 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551456 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551460 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551465 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551470 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551474 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551479 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551483 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 07:34:47.613627 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551487 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551492 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551497 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551501 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551505 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551509 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551521 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551526 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551531 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551535 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551544 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551549 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551553 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551558 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551562 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551569 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551574 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551579 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551589 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551594 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 07:34:47.614527 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551617 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551623 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551628 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551632 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551636 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551643 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551648 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551653 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551657 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551662 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551670 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551675 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551680 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551684 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551689 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551693 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551697 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551702 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551708 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551713 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 07:34:47.617576 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551717 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551721 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551731 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551735 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551740 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551744 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551749 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551753 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551757 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551762 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551768 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551773 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551779 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.551785 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552811 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552825 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552831 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552836 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552841 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 07:34:47.618451 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552847 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552852 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552856 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552861 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552865 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552870 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552874 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552879 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552883 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552891 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552896 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552902 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552907 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552912 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552916 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552922 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552927 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552935 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552940 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 07:34:47.621978 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552945 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552949 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552958 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552963 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552967 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552972 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552977 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552981 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552985 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 07:34:47.622882 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.552989 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 07:34:47.850299 ip-10-0-141-197 systemd[1]: Started Kubernetes Kubelet. Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769254 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769278 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769282 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769286 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769289 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769293 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769299 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769305 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769308 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769313 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769316 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769320 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769323 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769326 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769329 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769332 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769336 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769339 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769342 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 07:34:47.854902 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769345 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769348 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769350 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769356 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769359 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769366 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769371 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769376 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769379 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769384 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769390 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769393 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769399 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769402 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769409 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769412 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769415 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769420 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769423 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 07:34:47.856104 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769425 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769430 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769433 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769436 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769440 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769445 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769448 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769451 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769457 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769460 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769463 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769467 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769470 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769476 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769479 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769487 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769493 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769497 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769500 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769505 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 07:34:47.858492 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769508 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769513 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769516 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769522 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769527 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769531 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.769534 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769833 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769855 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769868 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769876 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769890 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769895 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769901 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769905 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769909 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769912 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769916 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769921 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769924 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769928 2570 flags.go:64] FLAG: --cgroup-root="" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769931 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769934 2570 flags.go:64] FLAG: --client-ca-file="" Jul 16 07:34:47.859582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769937 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769941 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769946 2570 flags.go:64] FLAG: --cluster-domain="" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769949 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769953 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769956 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769960 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769964 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769968 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769971 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769975 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769979 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769982 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769985 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769989 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769992 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.769998 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770002 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770005 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770008 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770012 2570 flags.go:64] FLAG: --enable-server="true" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770017 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770027 2570 flags.go:64] FLAG: --event-burst="100" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770031 2570 flags.go:64] FLAG: --event-qps="50" Jul 16 07:34:47.861560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770034 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770038 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770041 2570 flags.go:64] FLAG: --eviction-hard="" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770046 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770049 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770052 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770055 2570 flags.go:64] FLAG: --eviction-soft="" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770059 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770062 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770065 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770068 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770071 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770075 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770077 2570 flags.go:64] FLAG: --feature-gates="" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770082 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770085 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770089 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770093 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770096 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770099 2570 flags.go:64] FLAG: --help="false" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770104 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-141-197.ec2.internal" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770107 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770111 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 07:34:47.862366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770114 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770118 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770121 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770125 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770128 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770131 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770134 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770138 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770142 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770145 2570 flags.go:64] FLAG: --kube-reserved="" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770148 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770151 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770155 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770158 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770161 2570 flags.go:64] FLAG: --lock-file="" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770164 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770167 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770170 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770177 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770180 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770183 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770186 2570 flags.go:64] FLAG: --logging-format="text" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770189 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770193 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 07:34:47.863830 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770196 2570 flags.go:64] FLAG: --manifest-url="" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770199 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770206 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770209 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770214 2570 flags.go:64] FLAG: --max-pods="110" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770218 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770221 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770224 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770227 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770231 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770234 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770237 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770247 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770250 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770254 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770258 2570 flags.go:64] FLAG: --pod-cidr="" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770262 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770277 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770283 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770286 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770289 2570 flags.go:64] FLAG: --port="10250" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770293 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770296 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06e8f60c417d754f8" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770299 2570 flags.go:64] FLAG: --qos-reserved="" Jul 16 07:34:47.866300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770303 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770306 2570 flags.go:64] FLAG: --register-node="true" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770309 2570 flags.go:64] FLAG: --register-with-taints="" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770313 2570 flags.go:64] FLAG: --registry-burst="10" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770317 2570 flags.go:64] FLAG: --registry-qps="5" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770320 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770323 2570 flags.go:64] FLAG: --reserved-memory="" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770327 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770332 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770335 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770339 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770341 2570 flags.go:64] FLAG: --runonce="false" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770345 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770348 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770352 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770355 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770358 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770362 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770365 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770369 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770372 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770376 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770379 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770382 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770385 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 07:34:47.867069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770389 2570 flags.go:64] FLAG: --system-cgroups="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770392 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770400 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770403 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770406 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770411 2570 flags.go:64] FLAG: --tls-min-version="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770414 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770417 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770420 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770423 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770427 2570 flags.go:64] FLAG: --v="2" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770431 2570 flags.go:64] FLAG: --version="false" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770436 2570 flags.go:64] FLAG: --vmodule="" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770440 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.770443 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770622 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770628 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770632 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770635 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770638 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770642 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770648 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 07:34:47.867835 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770652 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770656 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770659 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770663 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770666 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770669 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770672 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770675 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770678 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770681 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770684 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770687 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770690 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770693 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770696 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770698 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770701 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770704 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770707 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770710 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 07:34:47.868445 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770713 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770715 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770718 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770723 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770726 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770729 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770733 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770735 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770739 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770743 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770745 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770748 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770751 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770755 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770760 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770764 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770767 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770769 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770773 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 07:34:47.868998 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770776 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770779 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770781 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770784 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770787 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770791 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770794 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770796 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770799 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770802 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770805 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770807 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770810 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770813 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770815 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770818 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770821 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770824 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770828 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770831 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 07:34:47.869519 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770834 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770841 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770844 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770847 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770850 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770853 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770856 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770858 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770861 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770864 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770867 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770870 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770872 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770875 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770878 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770881 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770884 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770887 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770890 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770894 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 07:34:47.870094 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770897 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770899 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770902 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770905 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770908 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770910 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770913 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770916 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770919 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770921 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770924 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770927 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.770930 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.771960 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.779639 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 07:34:47.870657 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.779661 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.779685 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.779691 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779772 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779778 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779781 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779785 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779788 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779792 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779795 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779798 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779801 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779804 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779807 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779809 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779812 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779815 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779818 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779821 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779824 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 07:34:47.871076 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779826 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779829 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779832 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779835 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779837 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779840 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779843 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779846 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779848 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779851 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779854 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779856 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779861 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779864 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779866 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779869 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779872 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779874 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779877 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779880 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 07:34:47.871652 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779883 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779885 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779888 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779891 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779894 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779897 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779899 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779902 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779904 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779908 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779910 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779913 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779916 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779918 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779921 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779924 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779927 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779929 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779932 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779935 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 07:34:47.872197 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779938 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779942 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779946 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779950 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779957 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779961 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779964 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779967 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779970 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779972 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779975 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779978 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779981 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779983 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779986 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779989 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779992 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.779996 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780000 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 07:34:47.872746 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780003 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780005 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780008 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780011 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780014 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780017 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780019 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780022 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780025 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780028 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780030 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780033 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780036 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780038 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780041 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780044 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780047 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780052 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780056 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 07:34:47.873273 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780061 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780063 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780067 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780069 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.780075 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780202 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780207 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780210 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780213 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780216 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780219 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780222 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780225 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780228 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780231 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 07:34:47.873836 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780233 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780237 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780239 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780242 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780245 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780247 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780250 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780253 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780255 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780258 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780261 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780264 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780266 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780269 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780272 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780276 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780280 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780283 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780286 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780291 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 07:34:47.874247 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780294 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780297 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780300 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780302 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780305 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780308 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780311 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780313 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780316 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780319 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780321 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780325 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780329 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780332 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780335 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780339 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780342 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780344 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780347 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 07:34:47.874806 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780350 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780352 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780355 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780358 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780360 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780363 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780366 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780368 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780373 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780377 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780380 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780383 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780390 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780393 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780396 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780399 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780402 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780404 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780407 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780410 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 07:34:47.875322 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780413 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780416 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780419 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780421 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780426 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780430 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780434 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780438 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780441 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780445 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780448 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780451 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780454 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780457 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780460 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780463 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780466 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780469 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780471 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 07:34:47.875884 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780474 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780478 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780482 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780485 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780488 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780491 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780494 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780497 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780500 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780503 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:47.780506 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.780511 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.780672 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.783122 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 07:34:47.876418 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.784947 2570 server.go:1019] "Starting client certificate rotation" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.785057 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.785087 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.788013 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.789322 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.814846 2570 log.go:25] "Validated CRI v1 runtime API" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.817170 2570 log.go:25] "Validated CRI v1 image API" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.817924 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.821079 2570 fs.go:135] Filesystem UUIDs: map[78a7a9db-20b7-406b-a1d4-d2d6129f7825:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9ee6583d-3fa5-473f-9e54-72e2d3d267b7:/dev/nvme0n1p4] Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.821095 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 07:34:47.876820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.827083 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.827970 2570 manager.go:216] Machine: {Timestamp:2026-07-16 07:34:47.8263658 +0000 UTC m=+0.909791411 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124430 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d64d580c1a7a7f7f7bd2b9b5a4b26 SystemUUID:ec2d64d5-80c1-a7a7-f7f7-bd2b9b5a4b26 BootID:c91defe9-88c2-4650-a981-0dde413e2eea Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:62:2f:58:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:62:2f:58:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:cd:a0:2a:8b:37 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.828082 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.828177 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.831783 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.831813 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.832504 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.832513 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.832521 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.833403 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.834952 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838619 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838743 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838772 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838781 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838792 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838803 2570 kubelet.go:398] "Adding apiserver pod source" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.838812 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 07:34:47.877107 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.839253 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.839268 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.841676 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.843869 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.843899 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844109 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844123 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844129 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844135 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844144 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844151 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844789 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844796 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844803 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844812 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844821 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.844829 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.845547 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.845558 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.848419 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.848441 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.848565 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.849232 2570 server.go:1268] "Started kubelet" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.850205 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.851141 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgjkb" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.851469 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.851468 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.851503 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.852775 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.858235 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-197.ec2.internal.18c2b4e2a1050e58 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-197.ec2.internal,UID:ip-10-0-141-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-197.ec2.internal,},FirstTimestamp:2026-07-16 07:34:47.849209432 +0000 UTC m=+0.932635043,LastTimestamp:2026-07-16 07:34:47.849209432 +0000 UTC m=+0.932635043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-197.ec2.internal,}" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.860591 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.860792 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jgjkb" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.860985 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.861441 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.863300 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.863895 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.863905 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.864068 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.864126 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.864131 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 16 07:34:47.877684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865028 2570 factory.go:55] Registering systemd factory Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865043 2570 factory.go:223] Registration of the systemd container factory successfully Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865231 2570 factory.go:153] Registering CRI-O factory Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865239 2570 factory.go:223] Registration of the crio container factory successfully Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865287 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865310 2570 factory.go:103] Registering Raw factory Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865325 2570 manager.go:1196] Started watching for new ooms in manager Jul 16 07:34:47.878822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.865729 2570 manager.go:349] Starting recovery of all containers Jul 16 07:34:47.912985 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.912828 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 07:34:47.913215 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.913189 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 07:34:47.924306 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.924288 2570 manager.go:354] Recovery completed Jul 16 07:34:47.929315 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.929299 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:47.931702 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.931682 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:47.931786 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.931714 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:47.931786 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.931726 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:47.932325 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.932311 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 07:34:47.932405 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.932326 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 07:34:47.932405 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.932346 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 16 07:34:47.932504 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.932314 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:47.933171 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.933154 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:47.933247 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.933183 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:47.933247 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.933199 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:47.933754 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.933740 2570 policy_none.go:49] "None policy: Start" Jul 16 07:34:47.933791 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.933759 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 07:34:47.933791 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.933770 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 07:34:47.935019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.935007 2570 policy_none.go:47] "Start" Jul 16 07:34:47.963944 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.963827 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:47.968168 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968154 2570 manager.go:337] "Starting Device Plugin manager" Jul 16 07:34:47.968235 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.968190 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 07:34:47.968235 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968199 2570 server.go:87] "Starting device plugin registration server" Jul 16 07:34:47.968463 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968444 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 07:34:47.968549 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968465 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 07:34:47.968628 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968566 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 07:34:47.968675 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968663 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 07:34:47.968675 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:47.968672 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 07:34:47.969347 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.969304 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 07:34:47.969427 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:47.969376 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.069210 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.069177 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:48.070346 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.070215 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:48.070346 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.070247 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:48.070346 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.070261 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:48.070346 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.070289 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.071142 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.071120 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 07:34:48.072467 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.072448 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 07:34:48.072567 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.072488 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 07:34:48.072567 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.072509 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 07:34:48.072567 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.072542 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 07:34:48.075142 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.075123 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 07:34:48.079063 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.079048 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.079118 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.079071 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-197.ec2.internal\": node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.126648 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.126560 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.173301 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.173251 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal"] Jul 16 07:34:48.173398 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.173350 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:48.175403 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.175387 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:48.175466 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.175421 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:48.175466 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.175435 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:48.177326 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.177292 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:48.177496 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.177420 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.177496 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.177457 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:48.178522 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.178505 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:48.178614 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.178550 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:48.178614 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.178566 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:48.178614 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.178577 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:48.178614 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.178606 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:48.178614 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.178618 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:48.179857 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.179840 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.179907 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.179879 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 07:34:48.180568 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.180552 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 16 07:34:48.180636 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.180585 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 07:34:48.180636 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.180620 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 16 07:34:48.207193 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.207172 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-197.ec2.internal\" not found" node="ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.211312 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.211297 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-197.ec2.internal\" not found" node="ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.227668 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.227649 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.267300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.267273 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.267300 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.267300 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6527244e4faae6846389be1f06153b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-197.ec2.internal\" (UID: \"c6527244e4faae6846389be1f06153b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.267433 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.267324 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.327904 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.327866 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.368391 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.368359 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.368482 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.368395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.368482 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.368420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6527244e4faae6846389be1f06153b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-197.ec2.internal\" (UID: \"c6527244e4faae6846389be1f06153b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.368577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.368480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.368577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.368505 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6527244e4faae6846389be1f06153b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-197.ec2.internal\" (UID: \"c6527244e4faae6846389be1f06153b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.368577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.368480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.432425 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.432341 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.510367 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.510336 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.514834 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.514348 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.532680 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.532654 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.633013 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.632955 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.733945 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.733871 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 16 07:34:48.748680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.748657 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 07:34:48.783675 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.783647 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 07:34:48.783801 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.783782 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 07:34:48.783840 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.783818 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 07:34:48.829209 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.829183 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 07:34:48.839402 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.839384 2570 apiserver.go:52] "Watching apiserver" Jul 16 07:34:48.848709 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.848688 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 07:34:48.849067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.849043 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-fndf5","openshift-multus/multus-additional-cni-plugins-ckmxr","openshift-network-operator/iptables-alerter-7d7dp","openshift-ovn-kubernetes/ovnkube-node-c82rv","kube-system/global-pull-secret-syncer-n4w27","kube-system/konnectivity-agent-xv44f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z","openshift-dns/node-resolver-ftm7n","openshift-image-registry/node-ca-swllx","openshift-multus/multus-x57fx","openshift-multus/network-metrics-daemon-l4h5h","openshift-network-diagnostics/network-check-target-ghxkm"] Jul 16 07:34:48.850733 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.850711 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.852223 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.852205 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.852962 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.852944 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.853291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.853276 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-54mbg\"" Jul 16 07:34:48.853374 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.853287 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.853374 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.853279 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.854477 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.854452 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 07:34:48.854611 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.854510 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 07:34:48.854795 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.854764 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 07:34:48.854795 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.854774 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.854943 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.854818 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.854943 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.854763 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.855362 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.855346 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-76j2l\"" Jul 16 07:34:48.855419 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.855391 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.856589 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.856143 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.856589 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.856165 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.856589 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.856235 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:34:48.856589 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.856253 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d2mhl\"" Jul 16 07:34:48.857380 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.857361 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 07:34:48.857469 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.857388 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 07:34:48.857626 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.857589 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wgs7x\"" Jul 16 07:34:48.858016 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.857997 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.858687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.858665 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.858785 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.858729 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 07:34:48.858964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.858949 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 07:34:48.858964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.858957 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 07:34:48.859154 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.859135 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.859872 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.859853 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.861145 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.861117 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.861744 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.861725 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 07:34:48.862324 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.862307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4m6lt\"" Jul 16 07:34:48.862599 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.862578 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.863491 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.863471 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 07:34:48.863622 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.863525 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 07:34:48.864066 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.864050 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.864799 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.864782 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.865748 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.865499 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:48.865748 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.865597 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:34:48.865940 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.865904 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 07:29:48 +0000 UTC" deadline="2028-04-22 17:37:30.16923523 +0000 UTC" Jul 16 07:34:48.866000 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.865941 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15514h2m41.30329791s" Jul 16 07:34:48.866788 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.866769 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:48.866870 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.866832 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:34:48.870806 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870781 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29f81e96-432a-41e3-b159-058a80df912d-kubelet-config\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.870915 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f9d1de6-7708-4052-bf74-69942a00060e-konnectivity-ca\") pod \"konnectivity-agent-xv44f\" (UID: \"1f9d1de6-7708-4052-bf74-69942a00060e\") " pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.870915 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870845 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysctl-conf\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.870915 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.870915 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870875 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.870915 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-os-release\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870925 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870958 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/071d312d-e91b-4fd5-8f37-75542d91e02e-iptables-alerter-script\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870982 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/071d312d-e91b-4fd5-8f37-75542d91e02e-host-slash\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.870999 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-hostroot\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-var-lib-kubelet\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwnl6\" (UniqueName: \"kubernetes.io/projected/25464234-ad7d-4a8b-83a8-10622b2dadf9-kube-api-access-lwnl6\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-var-lib-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871098 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871116 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-cnibin\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871105 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871136 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871147 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871140 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-os-release\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871174 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871180 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-kubelet\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871206 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 07:34:48.871224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871206 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v9sm\" (UniqueName: \"kubernetes.io/projected/071d312d-e91b-4fd5-8f37-75542d91e02e-kube-api-access-4v9sm\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871256 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-systemd\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871274 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-node-log\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871290 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-cni-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-conf-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871357 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-registration-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-sys-fs\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871405 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-multus-certs\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871422 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65pn\" (UniqueName: \"kubernetes.io/projected/5f2283c1-1781-4426-861a-57b756592e32-kube-api-access-r65pn\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871428 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871459 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph46p\" (UniqueName: \"kubernetes.io/projected/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-kube-api-access-ph46p\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871483 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871513 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-kubelet\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871552 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovn-node-metrics-cert\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871589 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-k8s-cni-cncf-io\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.871942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871609 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-etc-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871631 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysctl-d\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-slash\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871663 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-socket-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-cnibin\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-host\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jng6c\" (UniqueName: \"kubernetes.io/projected/ee02ac0c-274f-466b-9276-6d34a25ff5e8-kube-api-access-jng6c\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29f81e96-432a-41e3-b159-058a80df912d-dbus\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871785 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f9d1de6-7708-4052-bf74-69942a00060e-agent-certs\") pod \"konnectivity-agent-xv44f\" (UID: \"1f9d1de6-7708-4052-bf74-69942a00060e\") " pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-hosts-file\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871849 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-run\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovnkube-config\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871880 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f2283c1-1781-4426-861a-57b756592e32-cni-binary-copy\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.872637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871904 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-cni-multus\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871936 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-modprobe-d\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871955 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-sys\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871973 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-cni-netd\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.871992 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-socket-dir-parent\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872009 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1794a42d-89f3-4427-b522-b332f8372121-serviceca\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25464234-ad7d-4a8b-83a8-10622b2dadf9-tmp\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872069 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-ovn\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovnkube-script-lib\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872105 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-cni-bin\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysconfig\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-env-overrides\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872151 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qb8g\" (UniqueName: \"kubernetes.io/projected/58282c1f-5320-4143-816b-8960d7edea15-kube-api-access-5qb8g\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1794a42d-89f3-4427-b522-b332f8372121-host\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-tuned\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872224 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-run-netns\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-system-cni-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872254 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-netns\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-etc-kubernetes\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872294 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx6g7\" (UniqueName: \"kubernetes.io/projected/1794a42d-89f3-4427-b522-b332f8372121-kube-api-access-nx6g7\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872314 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gv9t\" (UniqueName: \"kubernetes.io/projected/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-kube-api-access-4gv9t\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872357 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-kubernetes\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-lib-modules\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-systemd-units\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-device-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872478 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f2283c1-1781-4426-861a-57b756592e32-multus-daemon-config\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872510 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-system-cni-dir\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-tmp-dir\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872663 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7grll\" (UniqueName: \"kubernetes.io/projected/6321e88a-c2ec-43ec-b710-5f721552f43f-kube-api-access-7grll\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-systemd\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872708 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-log-socket\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.873643 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872723 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-cni-bin\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.874160 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.872755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.874741 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.874601 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4bbzq\"" Jul 16 07:34:48.874741 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.874614 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kpdxw\"" Jul 16 07:34:48.874741 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.874627 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cbthp\"" Jul 16 07:34:48.874741 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.874703 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rnjjx\"" Jul 16 07:34:48.885274 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.885259 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal"] Jul 16 07:34:48.892482 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.892461 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 07:34:48.892659 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.892536 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 16 07:34:48.892659 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.892552 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 07:34:48.911843 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.911826 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 07:34:48.911922 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.911845 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal"] Jul 16 07:34:48.924409 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.924391 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hn8fg" Jul 16 07:34:48.936121 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.936100 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hn8fg" Jul 16 07:34:48.965272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.965251 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 07:34:48.973183 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973164 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25464234-ad7d-4a8b-83a8-10622b2dadf9-tmp\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973288 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973192 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-ovn\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973288 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973211 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovnkube-script-lib\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973288 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-cni-bin\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973288 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973243 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysconfig\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973288 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-env-overrides\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-ovn\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-cni-bin\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973329 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysconfig\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973421 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qb8g\" (UniqueName: \"kubernetes.io/projected/58282c1f-5320-4143-816b-8960d7edea15-kube-api-access-5qb8g\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973463 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1794a42d-89f3-4427-b522-b332f8372121-host\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973482 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-tuned\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-run-netns\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973537 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973516 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-system-cni-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-netns\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973576 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-etc-kubernetes\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx6g7\" (UniqueName: \"kubernetes.io/projected/1794a42d-89f3-4427-b522-b332f8372121-kube-api-access-nx6g7\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973609 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gv9t\" (UniqueName: \"kubernetes.io/projected/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-kube-api-access-4gv9t\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973631 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-kubernetes\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973648 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-lib-modules\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-systemd-units\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973699 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1794a42d-89f3-4427-b522-b332f8372121-host\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973701 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973732 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-etc-kubernetes\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973777 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-device-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973819 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-lib-modules\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973826 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f2283c1-1781-4426-861a-57b756592e32-multus-daemon-config\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-system-cni-dir\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-tmp-dir\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973928 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovnkube-script-lib\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.973964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973946 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7grll\" (UniqueName: \"kubernetes.io/projected/6321e88a-c2ec-43ec-b710-5f721552f43f-kube-api-access-7grll\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.973972 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-run-netns\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974035 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-system-cni-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974042 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-system-cni-dir\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974094 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-netns\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-systemd-units\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.974131 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974139 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-kubernetes\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974151 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-device-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.974192 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:49.474169806 +0000 UTC m=+2.557595418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974219 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-systemd\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974233 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-tmp-dir\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974255 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-log-socket\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974275 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-systemd\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974286 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-log-socket\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-cni-bin\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974328 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.974777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29f81e96-432a-41e3-b159-058a80df912d-kubelet-config\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974372 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-cni-bin\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974383 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f9d1de6-7708-4052-bf74-69942a00060e-konnectivity-ca\") pod \"konnectivity-agent-xv44f\" (UID: \"1f9d1de6-7708-4052-bf74-69942a00060e\") " pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974392 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysctl-conf\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974411 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/29f81e96-432a-41e3-b159-058a80df912d-kubelet-config\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974492 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f2283c1-1781-4426-861a-57b756592e32-multus-daemon-config\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974508 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-env-overrides\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974539 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysctl-conf\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974548 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-os-release\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974632 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-os-release\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974646 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/071d312d-e91b-4fd5-8f37-75542d91e02e-iptables-alerter-script\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/071d312d-e91b-4fd5-8f37-75542d91e02e-host-slash\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974731 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.975680 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-hostroot\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974780 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974788 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/071d312d-e91b-4fd5-8f37-75542d91e02e-host-slash\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-var-lib-kubelet\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974860 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-hostroot\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwnl6\" (UniqueName: \"kubernetes.io/projected/25464234-ad7d-4a8b-83a8-10622b2dadf9-kube-api-access-lwnl6\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974907 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-var-lib-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-cnibin\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.974984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-os-release\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-kubelet\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975035 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1f9d1de6-7708-4052-bf74-69942a00060e-konnectivity-ca\") pod \"konnectivity-agent-xv44f\" (UID: \"1f9d1de6-7708-4052-bf74-69942a00060e\") " pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v9sm\" (UniqueName: \"kubernetes.io/projected/071d312d-e91b-4fd5-8f37-75542d91e02e-kube-api-access-4v9sm\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975099 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-systemd\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975119 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-cnibin\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975145 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-var-lib-kubelet\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975172 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-node-log\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975174 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975127 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-node-log\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.976530 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975208 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-os-release\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975221 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-cni-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975232 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/071d312d-e91b-4fd5-8f37-75542d91e02e-iptables-alerter-script\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975211 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-var-lib-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-conf-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975248 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-kubelet\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975292 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-conf-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975309 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-run-systemd\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975326 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-registration-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975382 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-sys-fs\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-multus-certs\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975431 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65pn\" (UniqueName: \"kubernetes.io/projected/5f2283c1-1781-4426-861a-57b756592e32-kube-api-access-r65pn\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975455 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975486 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph46p\" (UniqueName: \"kubernetes.io/projected/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-kube-api-access-ph46p\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975493 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-multus-certs\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.977385 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-kubelet\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovn-node-metrics-cert\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975580 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-k8s-cni-cncf-io\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-etc-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysctl-d\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975457 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-cni-dir\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975626 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-kubelet\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975450 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-sys-fs\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-slash\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975694 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-run-k8s-cni-cncf-io\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975694 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-slash\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975696 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975727 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-etc-openvswitch\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-socket-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975771 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-cnibin\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975793 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-host\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975818 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975821 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-sysctl-d\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jng6c\" (UniqueName: \"kubernetes.io/projected/ee02ac0c-274f-466b-9276-6d34a25ff5e8-kube-api-access-jng6c\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975869 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-cnibin\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975878 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29f81e96-432a-41e3-b159-058a80df912d-dbus\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975745 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975921 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975955 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-run-ovn-kubernetes\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975950 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f9d1de6-7708-4052-bf74-69942a00060e-agent-certs\") pod \"konnectivity-agent-xv44f\" (UID: \"1f9d1de6-7708-4052-bf74-69942a00060e\") " pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975986 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58282c1f-5320-4143-816b-8960d7edea15-cni-binary-copy\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.975989 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-socket-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-hosts-file\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976042 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/29f81e96-432a-41e3-b159-058a80df912d-dbus\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976052 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-run\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976009 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-host\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976114 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6321e88a-c2ec-43ec-b710-5f721552f43f-registration-dir\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976136 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-hosts-file\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.978687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovnkube-config\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976185 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-run\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976189 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f2283c1-1781-4426-861a-57b756592e32-cni-binary-copy\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976214 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-cni-multus\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-modprobe-d\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.976259 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976267 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-sys\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976290 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-cni-netd\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:48.976317 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:34:49.476300354 +0000 UTC m=+2.559725954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-socket-dir-parent\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976341 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee02ac0c-274f-466b-9276-6d34a25ff5e8-host-cni-netd\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976394 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-multus-socket-dir-parent\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1794a42d-89f3-4427-b522-b332f8372121-serviceca\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976481 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-modprobe-d\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976439 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f2283c1-1781-4426-861a-57b756592e32-host-var-lib-cni-multus\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976664 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25464234-ad7d-4a8b-83a8-10622b2dadf9-sys\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976740 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovnkube-config\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.976915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58282c1f-5320-4143-816b-8960d7edea15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.977084 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1794a42d-89f3-4427-b522-b332f8372121-serviceca\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.977274 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f2283c1-1781-4426-861a-57b756592e32-cni-binary-copy\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.977770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25464234-ad7d-4a8b-83a8-10622b2dadf9-etc-tuned\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.977848 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25464234-ad7d-4a8b-83a8-10622b2dadf9-tmp\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.978653 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1f9d1de6-7708-4052-bf74-69942a00060e-agent-certs\") pod \"konnectivity-agent-xv44f\" (UID: \"1f9d1de6-7708-4052-bf74-69942a00060e\") " pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:48.979848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.978668 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee02ac0c-274f-466b-9276-6d34a25ff5e8-ovn-node-metrics-cert\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.984630 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.984524 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qb8g\" (UniqueName: \"kubernetes.io/projected/58282c1f-5320-4143-816b-8960d7edea15-kube-api-access-5qb8g\") pod \"multus-additional-cni-plugins-ckmxr\" (UID: \"58282c1f-5320-4143-816b-8960d7edea15\") " pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:48.986438 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.986253 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gv9t\" (UniqueName: \"kubernetes.io/projected/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-kube-api-access-4gv9t\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:48.986438 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.986427 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7grll\" (UniqueName: \"kubernetes.io/projected/6321e88a-c2ec-43ec-b710-5f721552f43f-kube-api-access-7grll\") pod \"aws-ebs-csi-driver-node-zrr8z\" (UID: \"6321e88a-c2ec-43ec-b710-5f721552f43f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:48.986801 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.986723 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwnl6\" (UniqueName: \"kubernetes.io/projected/25464234-ad7d-4a8b-83a8-10622b2dadf9-kube-api-access-lwnl6\") pod \"tuned-fndf5\" (UID: \"25464234-ad7d-4a8b-83a8-10622b2dadf9\") " pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:48.987080 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.987062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jng6c\" (UniqueName: \"kubernetes.io/projected/ee02ac0c-274f-466b-9276-6d34a25ff5e8-kube-api-access-jng6c\") pod \"ovnkube-node-c82rv\" (UID: \"ee02ac0c-274f-466b-9276-6d34a25ff5e8\") " pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:48.987157 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.987062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph46p\" (UniqueName: \"kubernetes.io/projected/4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2-kube-api-access-ph46p\") pod \"node-resolver-ftm7n\" (UID: \"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2\") " pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:48.987557 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.987537 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v9sm\" (UniqueName: \"kubernetes.io/projected/071d312d-e91b-4fd5-8f37-75542d91e02e-kube-api-access-4v9sm\") pod \"iptables-alerter-7d7dp\" (UID: \"071d312d-e91b-4fd5-8f37-75542d91e02e\") " pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:48.988209 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.988191 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65pn\" (UniqueName: \"kubernetes.io/projected/5f2283c1-1781-4426-861a-57b756592e32-kube-api-access-r65pn\") pod \"multus-x57fx\" (UID: \"5f2283c1-1781-4426-861a-57b756592e32\") " pod="openshift-multus/multus-x57fx" Jul 16 07:34:48.988420 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:48.988404 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx6g7\" (UniqueName: \"kubernetes.io/projected/1794a42d-89f3-4427-b522-b332f8372121-kube-api-access-nx6g7\") pod \"node-ca-swllx\" (UID: \"1794a42d-89f3-4427-b522-b332f8372121\") " pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:49.005228 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.005210 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x57fx" Jul 16 07:34:49.077505 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.077465 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:49.084457 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.084429 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:34:49.084457 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.084462 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:34:49.084651 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.084477 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:49.084651 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.084548 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:49.584527158 +0000 UTC m=+2.667952758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:49.167183 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.167142 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6527244e4faae6846389be1f06153b7.slice/crio-58a725044cbec89552d618eed30a8914f647c3e52a545318c295e30b4ebaab27 WatchSource:0}: Error finding container 58a725044cbec89552d618eed30a8914f647c3e52a545318c295e30b4ebaab27: Status 404 returned error can't find the container with id 58a725044cbec89552d618eed30a8914f647c3e52a545318c295e30b4ebaab27 Jul 16 07:34:49.174480 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.174448 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 07:34:49.177361 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.177343 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fndf5" Jul 16 07:34:49.180021 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.179999 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb34bbdde37be762e22d213be20c7bb.slice/crio-6e3a913bac4b3790e0e9b82090d49be3fe6f6b6b6ffbba2459876a69d17e9288 WatchSource:0}: Error finding container 6e3a913bac4b3790e0e9b82090d49be3fe6f6b6b6ffbba2459876a69d17e9288: Status 404 returned error can't find the container with id 6e3a913bac4b3790e0e9b82090d49be3fe6f6b6b6ffbba2459876a69d17e9288 Jul 16 07:34:49.185966 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.185946 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25464234_ad7d_4a8b_83a8_10622b2dadf9.slice/crio-f77dc96f1716988a1d19911189fda7b5facc426790a94247c43740c984e24120 WatchSource:0}: Error finding container f77dc96f1716988a1d19911189fda7b5facc426790a94247c43740c984e24120: Status 404 returned error can't find the container with id f77dc96f1716988a1d19911189fda7b5facc426790a94247c43740c984e24120 Jul 16 07:34:49.194683 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.194665 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" Jul 16 07:34:49.203961 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.203938 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58282c1f_5320_4143_816b_8960d7edea15.slice/crio-0ffdd9fcf22f9f658e7c74265ab9308bee69117adb5f1b7f91f0325a5a2523df WatchSource:0}: Error finding container 0ffdd9fcf22f9f658e7c74265ab9308bee69117adb5f1b7f91f0325a5a2523df: Status 404 returned error can't find the container with id 0ffdd9fcf22f9f658e7c74265ab9308bee69117adb5f1b7f91f0325a5a2523df Jul 16 07:34:49.213146 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.213131 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7d7dp" Jul 16 07:34:49.218346 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.218327 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:34:49.221735 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.221717 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071d312d_e91b_4fd5_8f37_75542d91e02e.slice/crio-53367e06ca0e809ef6ad012babc20287f8b1bd59b51ecaa1279614b10831e6a2 WatchSource:0}: Error finding container 53367e06ca0e809ef6ad012babc20287f8b1bd59b51ecaa1279614b10831e6a2: Status 404 returned error can't find the container with id 53367e06ca0e809ef6ad012babc20287f8b1bd59b51ecaa1279614b10831e6a2 Jul 16 07:34:49.226545 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.226505 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee02ac0c_274f_466b_9276_6d34a25ff5e8.slice/crio-0f235079c8e04e00db4a926e850c3e6f28348ab9ac123398f0f1f6d5e8489971 WatchSource:0}: Error finding container 0f235079c8e04e00db4a926e850c3e6f28348ab9ac123398f0f1f6d5e8489971: Status 404 returned error can't find the container with id 0f235079c8e04e00db4a926e850c3e6f28348ab9ac123398f0f1f6d5e8489971 Jul 16 07:34:49.249560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.249497 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:34:49.254623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.254606 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" Jul 16 07:34:49.258751 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.258729 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9d1de6_7708_4052_bf74_69942a00060e.slice/crio-9031378ae7bb33affcb3a3f8cfc1fa5b4e92ad4de60776f4e0e62db608641576 WatchSource:0}: Error finding container 9031378ae7bb33affcb3a3f8cfc1fa5b4e92ad4de60776f4e0e62db608641576: Status 404 returned error can't find the container with id 9031378ae7bb33affcb3a3f8cfc1fa5b4e92ad4de60776f4e0e62db608641576 Jul 16 07:34:49.263168 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.263149 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6321e88a_c2ec_43ec_b710_5f721552f43f.slice/crio-92ca335fb399438aa321ba1d83cea77c81165db877a123de6f33e15bdc6585eb WatchSource:0}: Error finding container 92ca335fb399438aa321ba1d83cea77c81165db877a123de6f33e15bdc6585eb: Status 404 returned error can't find the container with id 92ca335fb399438aa321ba1d83cea77c81165db877a123de6f33e15bdc6585eb Jul 16 07:34:49.266966 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.266950 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ftm7n" Jul 16 07:34:49.273209 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.273193 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-swllx" Jul 16 07:34:49.276428 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.276299 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9d8c73_9b6b_4c12_8cef_f7b0c43d68f2.slice/crio-03557ef21368ebc69b010d14be61df0fc35907821510a9d76aae827939bca51e WatchSource:0}: Error finding container 03557ef21368ebc69b010d14be61df0fc35907821510a9d76aae827939bca51e: Status 404 returned error can't find the container with id 03557ef21368ebc69b010d14be61df0fc35907821510a9d76aae827939bca51e Jul 16 07:34:49.283388 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.283364 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1794a42d_89f3_4427_b522_b332f8372121.slice/crio-06b4a52f3b265c18983df275899ec45a34e55912516feb992278d161d9a736a6 WatchSource:0}: Error finding container 06b4a52f3b265c18983df275899ec45a34e55912516feb992278d161d9a736a6: Status 404 returned error can't find the container with id 06b4a52f3b265c18983df275899ec45a34e55912516feb992278d161d9a736a6 Jul 16 07:34:49.443981 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.443945 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 07:34:49.457952 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:34:49.457927 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2283c1_1781_4426_861a_57b756592e32.slice/crio-c7e73ebb1b41f7ed5257784309231b62129cdd62968e205d37c4d7e9285642f6 WatchSource:0}: Error finding container c7e73ebb1b41f7ed5257784309231b62129cdd62968e205d37c4d7e9285642f6: Status 404 returned error can't find the container with id c7e73ebb1b41f7ed5257784309231b62129cdd62968e205d37c4d7e9285642f6 Jul 16 07:34:49.480970 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.480944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:49.481070 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.480982 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:49.481116 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.481094 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:49.481151 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.481137 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:50.481121962 +0000 UTC m=+3.564547558 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:49.481197 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.481095 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:49.481231 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.481219 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:34:50.481205477 +0000 UTC m=+3.564631080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:49.682694 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.682615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:49.683592 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.682796 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:34:49.683592 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.682822 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:34:49.683592 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.682835 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:49.683592 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:49.682919 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:50.682896882 +0000 UTC m=+3.766322490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:49.939193 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.939014 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 07:29:49 +0000 UTC" deadline="2028-03-13 01:29:13.918890924 +0000 UTC" Jul 16 07:34:49.939193 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:49.939080 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14537h54m23.979815685s" Jul 16 07:34:50.073775 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.073697 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:50.073955 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.073827 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:34:50.074281 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.074230 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:50.074366 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.074328 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:34:50.074564 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.074548 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:50.074679 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.074658 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:34:50.086280 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.086224 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xv44f" event={"ID":"1f9d1de6-7708-4052-bf74-69942a00060e","Type":"ContainerStarted","Data":"9031378ae7bb33affcb3a3f8cfc1fa5b4e92ad4de60776f4e0e62db608641576"} Jul 16 07:34:50.102007 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.101874 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"0f235079c8e04e00db4a926e850c3e6f28348ab9ac123398f0f1f6d5e8489971"} Jul 16 07:34:50.111038 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.110930 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerStarted","Data":"0ffdd9fcf22f9f658e7c74265ab9308bee69117adb5f1b7f91f0325a5a2523df"} Jul 16 07:34:50.125475 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.125440 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" event={"ID":"c6527244e4faae6846389be1f06153b7","Type":"ContainerStarted","Data":"58a725044cbec89552d618eed30a8914f647c3e52a545318c295e30b4ebaab27"} Jul 16 07:34:50.140641 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.138828 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7d7dp" event={"ID":"071d312d-e91b-4fd5-8f37-75542d91e02e","Type":"ContainerStarted","Data":"53367e06ca0e809ef6ad012babc20287f8b1bd59b51ecaa1279614b10831e6a2"} Jul 16 07:34:50.142925 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.142870 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fndf5" event={"ID":"25464234-ad7d-4a8b-83a8-10622b2dadf9","Type":"ContainerStarted","Data":"f77dc96f1716988a1d19911189fda7b5facc426790a94247c43740c984e24120"} Jul 16 07:34:50.157111 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.157075 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerStarted","Data":"6e3a913bac4b3790e0e9b82090d49be3fe6f6b6b6ffbba2459876a69d17e9288"} Jul 16 07:34:50.166797 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.166768 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x57fx" event={"ID":"5f2283c1-1781-4426-861a-57b756592e32","Type":"ContainerStarted","Data":"c7e73ebb1b41f7ed5257784309231b62129cdd62968e205d37c4d7e9285642f6"} Jul 16 07:34:50.189849 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.189774 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-swllx" event={"ID":"1794a42d-89f3-4427-b522-b332f8372121","Type":"ContainerStarted","Data":"06b4a52f3b265c18983df275899ec45a34e55912516feb992278d161d9a736a6"} Jul 16 07:34:50.210770 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.210737 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftm7n" event={"ID":"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2","Type":"ContainerStarted","Data":"03557ef21368ebc69b010d14be61df0fc35907821510a9d76aae827939bca51e"} Jul 16 07:34:50.236024 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.235932 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" event={"ID":"6321e88a-c2ec-43ec-b710-5f721552f43f","Type":"ContainerStarted","Data":"92ca335fb399438aa321ba1d83cea77c81165db877a123de6f33e15bdc6585eb"} Jul 16 07:34:50.311644 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.311593 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 07:34:50.491833 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.491733 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:50.491833 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.491828 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:50.492075 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.491971 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:50.492075 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.492039 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:34:52.492019149 +0000 UTC m=+5.575444762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:50.492505 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.492481 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:50.492616 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.492543 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:52.492525619 +0000 UTC m=+5.575951219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:50.693510 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.693470 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:50.694020 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.693652 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:34:50.694020 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.693672 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:34:50.694020 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.693686 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:50.694020 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:50.693753 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:52.693732726 +0000 UTC m=+5.777158337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:50.939916 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.939782 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 07:29:49 +0000 UTC" deadline="2028-03-17 22:17:05.126940748 +0000 UTC" Jul 16 07:34:50.939916 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:50.939851 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14654h42m14.187094693s" Jul 16 07:34:51.837621 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:51.837577 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 07:34:52.074948 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:52.074869 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:52.075126 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.075024 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:34:52.075126 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:52.075050 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:52.075288 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.075164 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:34:52.075288 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:52.075233 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:52.075422 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.075325 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:34:52.506397 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:52.506295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:52.506573 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:52.506404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:52.506674 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.506581 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:52.506674 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.506659 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:34:56.506635296 +0000 UTC m=+9.590060918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:52.507109 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.507083 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:52.507225 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.507147 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:56.507130016 +0000 UTC m=+9.590555647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:52.708283 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:52.708241 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:52.708495 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.708469 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:34:52.708495 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.708491 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:34:52.708657 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.708504 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:52.708657 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:52.708584 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:34:56.708546059 +0000 UTC m=+9.791971659 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:54.074602 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:54.074563 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:54.074602 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:54.074591 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:54.075201 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:54.074569 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:54.075201 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:54.074706 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:34:54.075201 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:54.074759 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:34:54.075201 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:54.074860 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:34:56.073151 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:56.073108 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:56.073669 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.073265 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:34:56.073749 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:56.073702 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:56.073830 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.073807 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:34:56.073941 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:56.073891 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:56.074007 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.073990 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:34:56.544170 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:56.544077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:56.544170 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:56.544137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:56.544399 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.544237 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:56.544399 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.544304 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:35:04.544283649 +0000 UTC m=+17.627709261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:34:56.544399 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.544237 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:56.544399 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.544367 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:35:04.544353286 +0000 UTC m=+17.627778897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:34:56.746185 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:56.746146 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:56.746406 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.746379 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:34:56.746502 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.746418 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:34:56.746502 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.746434 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:56.746645 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:56.746503 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:35:04.746482301 +0000 UTC m=+17.829907912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:34:58.073046 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:58.073003 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:34:58.073458 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:58.073132 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:34:58.080428 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:58.076664 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:34:58.080428 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:58.076828 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:34:58.080428 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:34:58.078480 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:34:58.080428 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:34:58.078605 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:00.072960 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:00.072928 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:00.073421 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:00.072980 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:00.073421 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:00.072928 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:00.073421 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:00.073059 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:00.073421 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:00.073178 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:00.073421 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:00.073257 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:02.073218 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:02.073182 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:02.073675 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:02.073223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:02.073675 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:02.073187 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:02.073675 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:02.073329 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:02.073675 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:02.073479 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:02.073675 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:02.073588 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:04.072955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:04.072918 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:04.073404 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:04.072974 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:04.073404 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:04.072915 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:04.073404 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.073067 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:04.073404 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.073156 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:04.073404 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.073256 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:04.611090 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:04.611055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:04.611272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:04.611122 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:04.611272 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.611219 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:35:04.611272 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.611229 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:35:04.611385 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.611275 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:35:20.611260633 +0000 UTC m=+33.694686247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:35:04.611385 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.611290 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:35:20.611284306 +0000 UTC m=+33.694709900 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:35:04.812169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:04.812134 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:04.812362 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.812273 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:35:04.812362 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.812294 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:35:04.812362 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.812307 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:35:04.812507 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:04.812362 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:35:20.812344406 +0000 UTC m=+33.895770027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:35:06.073087 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:06.072847 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:06.073554 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:06.072848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:06.073554 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:06.073182 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:06.073554 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:06.072920 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:06.073554 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:06.073280 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:06.073554 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:06.073374 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:08.076732 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:08.076701 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:08.077210 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:08.076864 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:08.077210 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:08.076876 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:08.077210 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:08.076967 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:08.077210 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:08.077023 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:08.077210 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:08.077094 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:10.072824 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.072762 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:10.073110 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:10.072886 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:10.073315 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.073295 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:10.073435 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:10.073412 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:10.073493 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.073463 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:10.073567 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:10.073556 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:10.278703 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.278654 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x57fx" event={"ID":"5f2283c1-1781-4426-861a-57b756592e32","Type":"ContainerStarted","Data":"e3e334adfbf36b8911b86a19b7ae31d4d8a60df3117280a9e8f9a43f2956199b"} Jul 16 07:35:10.280220 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.280195 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"9c89c3be2396396e235ceb317e753f0551e6d1c6215c1b5c2ffb92b7320282bf"} Jul 16 07:35:10.281415 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.281397 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" event={"ID":"c6527244e4faae6846389be1f06153b7","Type":"ContainerStarted","Data":"78df9452598e8bce9aaec5baa071b185382d393606de65bc629639ae54a034e7"} Jul 16 07:35:10.285238 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.285155 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fndf5" event={"ID":"25464234-ad7d-4a8b-83a8-10622b2dadf9","Type":"ContainerStarted","Data":"5ba04cbef3ca7beeb29bc066e89223d68bcd7a5475b3bf905f5e0134349faabf"} Jul 16 07:35:10.297494 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.296859 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x57fx" podStartSLOduration=1.784955406 podStartE2EDuration="22.296843785s" totalImagesPullingTime="20.511888379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:10.296643071 +0000 UTC m=+23.380068688" watchObservedRunningTime="2026-07-16 07:35:10.296843785 +0000 UTC m=+23.380269404" Jul 16 07:35:10.313266 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.313225 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fndf5" podStartSLOduration=1.554919926 podStartE2EDuration="22.313211808s" totalImagesPullingTime="20.758291882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:10.312979437 +0000 UTC m=+23.396405054" watchObservedRunningTime="2026-07-16 07:35:10.313211808 +0000 UTC m=+23.396637449" Jul 16 07:35:10.326933 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:10.326889 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" podStartSLOduration=21.326874388 podStartE2EDuration="21.326874388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:10.326505672 +0000 UTC m=+23.409931288" watchObservedRunningTime="2026-07-16 07:35:10.326874388 +0000 UTC m=+23.410300004" Jul 16 07:35:11.290513 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.290062 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-swllx" event={"ID":"1794a42d-89f3-4427-b522-b332f8372121","Type":"ContainerStarted","Data":"ddb4f8ec496d18ea8a1373105ef53e9d7cc99353fac75b719cc026666eddf02d"} Jul 16 07:35:11.292952 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.292924 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ftm7n" event={"ID":"4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2","Type":"ContainerStarted","Data":"57a2974cbcb0811ec3d9a1ed7e05bbca4570bc5634579c4958b54834ac7c9818"} Jul 16 07:35:11.294684 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.294660 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" event={"ID":"6321e88a-c2ec-43ec-b710-5f721552f43f","Type":"ContainerStarted","Data":"80a07505abb6a90802c9e6240f348389561422e3adff169c2135bde5b4e0ee76"} Jul 16 07:35:11.296063 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.296044 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xv44f" event={"ID":"1f9d1de6-7708-4052-bf74-69942a00060e","Type":"ContainerStarted","Data":"bb67c97dd8087916ec417fceae0321932f4a76d5dbcb6dfe180eb2792d738f5e"} Jul 16 07:35:11.298226 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298211 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:35:11.298504 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298484 2570 generic.go:356] "Generic (PLEG): container finished" podID="ee02ac0c-274f-466b-9276-6d34a25ff5e8" containerID="7ad6b43a667ddf05869b0e607413dd512b33e68e951ce8e38cbfc8ea7e5f6eae" exitCode=1 Jul 16 07:35:11.298593 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298558 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"625db6dda0493eeadbb49912eb6a39844fdbdd606598643e2a9d9fe39dbeaa3f"} Jul 16 07:35:11.298646 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298616 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"7ca3e23f6e0cfc364037a62dfbccb5ff198258c10194ecff8351bc6319ae29c9"} Jul 16 07:35:11.298689 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298651 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"94a126d1df6a0d044121f0e32e4aa315efe489ecc24febfd0ae5a5ae08a0afcf"} Jul 16 07:35:11.298689 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298680 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"36cc7ae2154834a34b0a5c4f9633b8d8baf8f1837c8b85b782213a67b0420ec8"} Jul 16 07:35:11.298748 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.298717 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerDied","Data":"7ad6b43a667ddf05869b0e607413dd512b33e68e951ce8e38cbfc8ea7e5f6eae"} Jul 16 07:35:11.299826 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.299808 2570 generic.go:356] "Generic (PLEG): container finished" podID="58282c1f-5320-4143-816b-8960d7edea15" containerID="ac9289fbcc61282a7908d4d554f5ad558fee3e9ade9ee57f6b66418f5f1c4a7c" exitCode=0 Jul 16 07:35:11.299904 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.299871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerDied","Data":"ac9289fbcc61282a7908d4d554f5ad558fee3e9ade9ee57f6b66418f5f1c4a7c"} Jul 16 07:35:11.301151 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.301129 2570 generic.go:356] "Generic (PLEG): container finished" podID="2bb34bbdde37be762e22d213be20c7bb" containerID="e9639d6539de7dfcb4b2847f6fbd7844bf030ba20c823eae7f53584394867585" exitCode=0 Jul 16 07:35:11.301238 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.301175 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerDied","Data":"e9639d6539de7dfcb4b2847f6fbd7844bf030ba20c823eae7f53584394867585"} Jul 16 07:35:11.305542 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.305494 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-swllx" podStartSLOduration=2.646809945 podStartE2EDuration="23.305482833s" totalImagesPullingTime="20.658672888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:11.305189023 +0000 UTC m=+24.388614659" watchObservedRunningTime="2026-07-16 07:35:11.305482833 +0000 UTC m=+24.388908450" Jul 16 07:35:11.319570 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.319509 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ftm7n" podStartSLOduration=2.655665684 podStartE2EDuration="23.31949935s" totalImagesPullingTime="20.663833666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:11.319110056 +0000 UTC m=+24.402535674" watchObservedRunningTime="2026-07-16 07:35:11.31949935 +0000 UTC m=+24.402924967" Jul 16 07:35:11.772123 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.772099 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 07:35:11.983071 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.982910 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T07:35:11.772117618Z","UUID":"9b6aafd7-4ac2-402a-861c-56e2116736d2","Handler":null,"Name":"","Endpoint":""} Jul 16 07:35:11.984577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.984554 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 07:35:11.984686 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:11.984596 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 07:35:12.076702 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.076672 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:12.076922 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.076770 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:12.076922 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:12.076779 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:12.076922 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:12.076888 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:12.077087 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.076939 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:12.077087 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:12.076999 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:12.305354 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.305271 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" event={"ID":"6321e88a-c2ec-43ec-b710-5f721552f43f","Type":"ContainerStarted","Data":"17cb3807d993d1d0f6983b6c1c295e8661f1edd949a0e24b8782c563259c356d"} Jul 16 07:35:12.307922 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.306990 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7d7dp" event={"ID":"071d312d-e91b-4fd5-8f37-75542d91e02e","Type":"ContainerStarted","Data":"b9e9f9f496ba17941ba4446e522343bb337df0a834ade1a6e05b8c2f4b039fcf"} Jul 16 07:35:12.312662 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.312627 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerStarted","Data":"0386b5135149a0aee05e55059dbd8b735dc2f614d000306fda56564180a3d23e"} Jul 16 07:35:12.326433 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.326382 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xv44f" podStartSLOduration=3.64247245 podStartE2EDuration="24.326366655s" totalImagesPullingTime="20.683894205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:11.366160159 +0000 UTC m=+24.449585773" watchObservedRunningTime="2026-07-16 07:35:12.326366655 +0000 UTC m=+25.409792272" Jul 16 07:35:12.327011 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.326977 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7d7dp" podStartSLOduration=3.606187171 podStartE2EDuration="24.326965407s" totalImagesPullingTime="20.720778236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:12.326436313 +0000 UTC m=+25.409861933" watchObservedRunningTime="2026-07-16 07:35:12.326965407 +0000 UTC m=+25.410391027" Jul 16 07:35:12.345402 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:12.345356 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" podStartSLOduration=23.345344883 podStartE2EDuration="23.345344883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:12.345034291 +0000 UTC m=+25.428459927" watchObservedRunningTime="2026-07-16 07:35:12.345344883 +0000 UTC m=+25.428770502" Jul 16 07:35:13.318782 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:13.318755 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:35:13.319245 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:13.319224 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"4c384527a8d72123484d6d813e8a84e0ea56e1d4119ebe91d99bfc7d2932860f"} Jul 16 07:35:14.073729 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:14.073552 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:14.073893 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:14.073552 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:14.073893 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:14.073800 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:14.073977 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:14.073897 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:14.073977 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:14.073552 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:14.074050 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:14.074006 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:14.324406 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:14.324322 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" event={"ID":"6321e88a-c2ec-43ec-b710-5f721552f43f","Type":"ContainerStarted","Data":"1b4ae6c9d81ba36f06a47ea4027c1da664ac5772577cc30c5c4341a484867997"} Jul 16 07:35:14.347670 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:14.347595 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrr8z" podStartSLOduration=11.081695833 podStartE2EDuration="26.347574895s" totalImagesPullingTime="15.265879062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:14.346726281 +0000 UTC m=+27.430151919" watchObservedRunningTime="2026-07-16 07:35:14.347574895 +0000 UTC m=+27.431000513" Jul 16 07:35:15.020630 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:15.020598 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:35:15.021373 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:15.021354 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:35:15.327206 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:15.327125 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:35:15.327839 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:15.327408 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xv44f" Jul 16 07:35:16.073304 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.073125 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:16.073446 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.073129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:16.073446 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:16.073391 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:16.073540 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:16.073448 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:16.073540 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.073161 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:16.073609 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:16.073560 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:16.331874 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.331798 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:35:16.332505 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.332181 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"10abf8b8c55e1d07ca556f1dd0fb9f838993dbffff17515c1b00471168ef8f44"} Jul 16 07:35:16.332505 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.332407 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:35:16.332674 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.332656 2570 scope.go:117] "RemoveContainer" containerID="7ad6b43a667ddf05869b0e607413dd512b33e68e951ce8e38cbfc8ea7e5f6eae" Jul 16 07:35:16.334075 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.334055 2570 generic.go:356] "Generic (PLEG): container finished" podID="58282c1f-5320-4143-816b-8960d7edea15" containerID="4308f78be82bd06498337b1ba157b6d0bd12ad462bd492e9549a6f81327fccc0" exitCode=0 Jul 16 07:35:16.334180 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.334150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerDied","Data":"4308f78be82bd06498337b1ba157b6d0bd12ad462bd492e9549a6f81327fccc0"} Jul 16 07:35:16.348907 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:16.348890 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:35:17.339948 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:17.339921 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:35:17.340507 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:17.340319 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" event={"ID":"ee02ac0c-274f-466b-9276-6d34a25ff5e8","Type":"ContainerStarted","Data":"d275e470d101bcba162743c82b56e32e283c790778bd12a34fd272e391e66f71"} Jul 16 07:35:17.340616 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:17.340505 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:35:17.340616 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:17.340580 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:35:17.354764 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:17.354744 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:35:17.392439 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:17.392389 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" podStartSLOduration=8.530441369 podStartE2EDuration="29.392375145s" totalImagesPullingTime="20.861933776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:17.367425088 +0000 UTC m=+30.450850722" watchObservedRunningTime="2026-07-16 07:35:17.392375145 +0000 UTC m=+30.475800762" Jul 16 07:35:18.073859 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:18.073793 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:18.073987 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:18.073918 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:18.073987 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:18.073926 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:18.074104 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:18.073992 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:18.074104 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:18.074011 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:18.074178 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:18.074098 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:18.343592 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:18.343516 2570 generic.go:356] "Generic (PLEG): container finished" podID="58282c1f-5320-4143-816b-8960d7edea15" containerID="a1c6f8e8192e3f1248160d2355d128070875714066c82d91f7e37f66c4dc12e0" exitCode=0 Jul 16 07:35:18.343964 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:18.343630 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerDied","Data":"a1c6f8e8192e3f1248160d2355d128070875714066c82d91f7e37f66c4dc12e0"} Jul 16 07:35:20.072907 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.072857 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:20.073362 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.072856 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:20.073362 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.072974 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:20.073362 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.072984 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:20.073362 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.073053 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:20.073362 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.073126 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:20.350440 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.350344 2570 generic.go:356] "Generic (PLEG): container finished" podID="58282c1f-5320-4143-816b-8960d7edea15" containerID="4445b01a8a0ffed0d36c6b110f3af5897da3c67d937171ef780dde0fa114c917" exitCode=0 Jul 16 07:35:20.350440 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.350395 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerDied","Data":"4445b01a8a0ffed0d36c6b110f3af5897da3c67d937171ef780dde0fa114c917"} Jul 16 07:35:20.630822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.630742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:20.630822 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.630786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:20.630970 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.630887 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 07:35:20.630970 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.630914 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:35:20.630970 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.630941 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret podName:29f81e96-432a-41e3-b159-058a80df912d nodeName:}" failed. No retries permitted until 2026-07-16 07:35:52.630928095 +0000 UTC m=+65.714353694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret") pod "global-pull-secret-syncer-n4w27" (UID: "29f81e96-432a-41e3-b159-058a80df912d") : object "kube-system"/"original-pull-secret" not registered Jul 16 07:35:20.630970 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.630962 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs podName:6b9dfde2-1341-4275-b6e9-b3040ffe0ce2 nodeName:}" failed. No retries permitted until 2026-07-16 07:35:52.630949509 +0000 UTC m=+65.714375103 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs") pod "network-metrics-daemon-l4h5h" (UID: "6b9dfde2-1341-4275-b6e9-b3040ffe0ce2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 07:35:20.832219 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:20.832187 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:20.832374 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.832319 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 07:35:20.832374 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.832332 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 07:35:20.832374 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.832341 2570 projected.go:196] Error preparing data for projected volume kube-api-access-gmcmp for pod openshift-network-diagnostics/network-check-target-ghxkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:35:20.832475 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:20.832388 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp podName:b7267e69-411d-418a-8b40-ef07a2553e61 nodeName:}" failed. No retries permitted until 2026-07-16 07:35:52.832374519 +0000 UTC m=+65.915800113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gmcmp" (UniqueName: "kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp") pod "network-check-target-ghxkm" (UID: "b7267e69-411d-418a-8b40-ef07a2553e61") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 07:35:22.072909 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:22.072860 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:22.072909 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:22.072909 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:22.073383 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:22.072880 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:22.073383 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:22.073009 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:22.073383 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:22.073080 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:22.073383 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:22.073172 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:24.073444 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:24.073408 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:24.073967 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:24.073408 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:24.073967 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:24.073517 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:24.073967 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:24.073634 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:24.073967 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:24.073408 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:24.073967 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:24.073793 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:25.364314 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:25.364279 2570 generic.go:356] "Generic (PLEG): container finished" podID="58282c1f-5320-4143-816b-8960d7edea15" containerID="c3b626bd99419ccf2fd618ce523cd45b7c57052c3f642f4f381bcb6784948e02" exitCode=0 Jul 16 07:35:25.364314 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:25.364324 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerDied","Data":"c3b626bd99419ccf2fd618ce523cd45b7c57052c3f642f4f381bcb6784948e02"} Jul 16 07:35:26.076279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:26.076087 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:26.076438 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:26.076127 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:26.076438 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:26.076366 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:26.076438 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:26.076142 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:26.076553 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:26.076423 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:26.076553 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:26.076513 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:26.369772 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:26.369698 2570 generic.go:356] "Generic (PLEG): container finished" podID="58282c1f-5320-4143-816b-8960d7edea15" containerID="e1a5443ed6c6b6367ed3d6a78da71183fe1b9f822b51227d42182872be58787f" exitCode=0 Jul 16 07:35:26.369772 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:26.369743 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerDied","Data":"e1a5443ed6c6b6367ed3d6a78da71183fe1b9f822b51227d42182872be58787f"} Jul 16 07:35:27.374803 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:27.374761 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" event={"ID":"58282c1f-5320-4143-816b-8960d7edea15","Type":"ContainerStarted","Data":"3a9a0433bb135c61afda30ce43688bc507f83b7f26165cadfe750eaad79e9fa2"} Jul 16 07:35:27.399279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:27.399235 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ckmxr" podStartSLOduration=8.11202237 podStartE2EDuration="39.399222321s" totalImagesPullingTime="31.287199951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:27.39896848 +0000 UTC m=+40.482394109" watchObservedRunningTime="2026-07-16 07:35:27.399222321 +0000 UTC m=+40.482647936" Jul 16 07:35:28.077876 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:28.077846 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:28.078042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:28.077940 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:28.078042 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:28.077953 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:28.078042 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:28.077958 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:28.078042 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:28.078010 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:28.078186 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:28.078068 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:30.072959 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.072926 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:30.072959 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.072956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:30.073466 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.072926 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:30.073466 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:30.073056 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:30.073466 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:30.073126 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:30.073466 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:30.073194 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:30.643259 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.643228 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4w27"] Jul 16 07:35:30.643408 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.643342 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:30.643457 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:30.643431 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:30.645620 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.645599 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l4h5h"] Jul 16 07:35:30.645716 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.645678 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:30.645774 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:30.645757 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:30.662133 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.662101 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ghxkm"] Jul 16 07:35:30.662272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:30.662185 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:30.662334 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:30.662271 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:32.073821 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:32.073743 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:32.074445 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:32.073857 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:32.074445 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:32.073916 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:32.074445 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:32.074023 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:33.073226 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:33.073198 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:33.073455 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:33.073286 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ghxkm" podUID="b7267e69-411d-418a-8b40-ef07a2553e61" Jul 16 07:35:34.076026 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.075992 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:34.076448 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:34.076113 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l4h5h" podUID="6b9dfde2-1341-4275-b6e9-b3040ffe0ce2" Jul 16 07:35:34.076448 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.076161 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:34.076448 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:34.076256 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4w27" podUID="29f81e96-432a-41e3-b159-058a80df912d" Jul 16 07:35:34.692946 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.692763 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeReady" Jul 16 07:35:34.693122 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.693070 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 07:35:34.735943 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.735914 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ksgcr"] Jul 16 07:35:34.768815 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.768707 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vsgjq"] Jul 16 07:35:34.768957 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.768821 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:34.771368 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.771344 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 07:35:34.771522 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.771416 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26fn5\"" Jul 16 07:35:34.771522 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.771473 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 07:35:34.782514 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.782495 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ksgcr"] Jul 16 07:35:34.782620 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.782547 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vsgjq"] Jul 16 07:35:34.782620 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.782611 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:34.784957 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.784936 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 07:35:34.785061 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.784961 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 07:35:34.785061 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.785027 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j9qth\"" Jul 16 07:35:34.785175 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.785067 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 07:35:34.785175 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.785130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 07:35:34.838398 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.838374 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-95nzz"] Jul 16 07:35:34.860665 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.860640 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-95nzz"] Jul 16 07:35:34.860795 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.860719 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:34.863103 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.863085 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 07:35:34.863745 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.863718 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 07:35:34.863849 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.863828 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bx2t8\"" Jul 16 07:35:34.863998 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.863969 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 07:35:34.930759 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930721 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47tj5\" (UniqueName: \"kubernetes.io/projected/31f6f870-d782-4465-b4c0-83096b6db5d0-kube-api-access-47tj5\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:34.930907 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f6f870-d782-4465-b4c0-83096b6db5d0-data-volume\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:34.930907 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930795 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31f6f870-d782-4465-b4c0-83096b6db5d0-crio-socket\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:34.930907 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930869 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2946c501-8b0f-4cd0-bb52-02abf840eac4-metrics-tls\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:34.931026 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930913 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31f6f870-d782-4465-b4c0-83096b6db5d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:34.931026 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnwgd\" (UniqueName: \"kubernetes.io/projected/2946c501-8b0f-4cd0-bb52-02abf840eac4-kube-api-access-tnwgd\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:34.931026 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.930977 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2946c501-8b0f-4cd0-bb52-02abf840eac4-config-volume\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:34.931026 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.931006 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2946c501-8b0f-4cd0-bb52-02abf840eac4-tmp-dir\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:34.931026 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:34.931023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31f6f870-d782-4465-b4c0-83096b6db5d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031347 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031268 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f6f870-d782-4465-b4c0-83096b6db5d0-data-volume\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031347 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031305 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31f6f870-d782-4465-b4c0-83096b6db5d0-crio-socket\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031347 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2946c501-8b0f-4cd0-bb52-02abf840eac4-metrics-tls\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.031619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031456 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31f6f870-d782-4465-b4c0-83096b6db5d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031488 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31f6f870-d782-4465-b4c0-83096b6db5d0-crio-socket\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s965\" (UniqueName: \"kubernetes.io/projected/b2b44b36-f1ef-46a5-8e01-3fbe945e9436-kube-api-access-8s965\") pod \"ingress-canary-95nzz\" (UID: \"b2b44b36-f1ef-46a5-8e01-3fbe945e9436\") " pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.031619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031558 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2b44b36-f1ef-46a5-8e01-3fbe945e9436-cert\") pod \"ingress-canary-95nzz\" (UID: \"b2b44b36-f1ef-46a5-8e01-3fbe945e9436\") " pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.031619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031617 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnwgd\" (UniqueName: \"kubernetes.io/projected/2946c501-8b0f-4cd0-bb52-02abf840eac4-kube-api-access-tnwgd\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.031848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031649 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2946c501-8b0f-4cd0-bb52-02abf840eac4-config-volume\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.031848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031660 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31f6f870-d782-4465-b4c0-83096b6db5d0-data-volume\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2946c501-8b0f-4cd0-bb52-02abf840eac4-tmp-dir\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.031848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31f6f870-d782-4465-b4c0-83096b6db5d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.031848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.031783 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47tj5\" (UniqueName: \"kubernetes.io/projected/31f6f870-d782-4465-b4c0-83096b6db5d0-kube-api-access-47tj5\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.032074 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.032001 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2946c501-8b0f-4cd0-bb52-02abf840eac4-tmp-dir\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.032074 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.032054 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31f6f870-d782-4465-b4c0-83096b6db5d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.032248 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.032231 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2946c501-8b0f-4cd0-bb52-02abf840eac4-config-volume\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.035307 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.035290 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31f6f870-d782-4465-b4c0-83096b6db5d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.035383 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.035314 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2946c501-8b0f-4cd0-bb52-02abf840eac4-metrics-tls\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.038989 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.038968 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47tj5\" (UniqueName: \"kubernetes.io/projected/31f6f870-d782-4465-b4c0-83096b6db5d0-kube-api-access-47tj5\") pod \"insights-runtime-extractor-vsgjq\" (UID: \"31f6f870-d782-4465-b4c0-83096b6db5d0\") " pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.039180 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.039155 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnwgd\" (UniqueName: \"kubernetes.io/projected/2946c501-8b0f-4cd0-bb52-02abf840eac4-kube-api-access-tnwgd\") pod \"dns-default-ksgcr\" (UID: \"2946c501-8b0f-4cd0-bb52-02abf840eac4\") " pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.073135 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.073115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:35.075698 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.075679 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 07:35:35.075798 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.075696 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 07:35:35.075798 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.075700 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xtqbp\"" Jul 16 07:35:35.078025 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.078008 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:35.090897 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.090877 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vsgjq" Jul 16 07:35:35.132703 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.132674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2b44b36-f1ef-46a5-8e01-3fbe945e9436-cert\") pod \"ingress-canary-95nzz\" (UID: \"b2b44b36-f1ef-46a5-8e01-3fbe945e9436\") " pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.132928 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.132895 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s965\" (UniqueName: \"kubernetes.io/projected/b2b44b36-f1ef-46a5-8e01-3fbe945e9436-kube-api-access-8s965\") pod \"ingress-canary-95nzz\" (UID: \"b2b44b36-f1ef-46a5-8e01-3fbe945e9436\") " pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.135272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.135251 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2b44b36-f1ef-46a5-8e01-3fbe945e9436-cert\") pod \"ingress-canary-95nzz\" (UID: \"b2b44b36-f1ef-46a5-8e01-3fbe945e9436\") " pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.140555 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.140511 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s965\" (UniqueName: \"kubernetes.io/projected/b2b44b36-f1ef-46a5-8e01-3fbe945e9436-kube-api-access-8s965\") pod \"ingress-canary-95nzz\" (UID: \"b2b44b36-f1ef-46a5-8e01-3fbe945e9436\") " pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.172326 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.172290 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-95nzz" Jul 16 07:35:35.282184 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.282125 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ksgcr"] Jul 16 07:35:35.285784 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:35.285760 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2946c501_8b0f_4cd0_bb52_02abf840eac4.slice/crio-fe5d390355333e03a3686b16fbf964d974b778caf1258602e9b89fc93f6885cc WatchSource:0}: Error finding container fe5d390355333e03a3686b16fbf964d974b778caf1258602e9b89fc93f6885cc: Status 404 returned error can't find the container with id fe5d390355333e03a3686b16fbf964d974b778caf1258602e9b89fc93f6885cc Jul 16 07:35:35.286044 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.286026 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vsgjq"] Jul 16 07:35:35.289508 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:35.289482 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f6f870_d782_4465_b4c0_83096b6db5d0.slice/crio-58c3c8c56fd73657085f04fe405dbdb34a06d0cc22f2ce63dfab71e3cfabc3ac WatchSource:0}: Error finding container 58c3c8c56fd73657085f04fe405dbdb34a06d0cc22f2ce63dfab71e3cfabc3ac: Status 404 returned error can't find the container with id 58c3c8c56fd73657085f04fe405dbdb34a06d0cc22f2ce63dfab71e3cfabc3ac Jul 16 07:35:35.333280 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.333252 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-95nzz"] Jul 16 07:35:35.336622 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:35.336602 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b44b36_f1ef_46a5_8e01_3fbe945e9436.slice/crio-8aec26c8a2f3ffd52928478d9dfc3e3ab7fca1ccfd39dac6d1e62a2a2a255ce4 WatchSource:0}: Error finding container 8aec26c8a2f3ffd52928478d9dfc3e3ab7fca1ccfd39dac6d1e62a2a2a255ce4: Status 404 returned error can't find the container with id 8aec26c8a2f3ffd52928478d9dfc3e3ab7fca1ccfd39dac6d1e62a2a2a255ce4 Jul 16 07:35:35.391568 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.391521 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-95nzz" event={"ID":"b2b44b36-f1ef-46a5-8e01-3fbe945e9436","Type":"ContainerStarted","Data":"8aec26c8a2f3ffd52928478d9dfc3e3ab7fca1ccfd39dac6d1e62a2a2a255ce4"} Jul 16 07:35:35.392581 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.392560 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsgjq" event={"ID":"31f6f870-d782-4465-b4c0-83096b6db5d0","Type":"ContainerStarted","Data":"58c3c8c56fd73657085f04fe405dbdb34a06d0cc22f2ce63dfab71e3cfabc3ac"} Jul 16 07:35:35.393561 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.393540 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ksgcr" event={"ID":"2946c501-8b0f-4cd0-bb52-02abf840eac4","Type":"ContainerStarted","Data":"fe5d390355333e03a3686b16fbf964d974b778caf1258602e9b89fc93f6885cc"} Jul 16 07:35:35.685991 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.685962 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7"] Jul 16 07:35:35.714877 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.714852 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7"] Jul 16 07:35:35.715000 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.714947 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:35.717263 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.717228 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 07:35:35.717263 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.717262 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-blxhr\"" Jul 16 07:35:35.837859 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.837828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73ee6427-c83c-4303-870a-05438d126e81-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jxsp7\" (UID: \"73ee6427-c83c-4303-870a-05438d126e81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:35.938434 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.938341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73ee6427-c83c-4303-870a-05438d126e81-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jxsp7\" (UID: \"73ee6427-c83c-4303-870a-05438d126e81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:35.942448 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:35.942420 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73ee6427-c83c-4303-870a-05438d126e81-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-jxsp7\" (UID: \"73ee6427-c83c-4303-870a-05438d126e81\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:36.024025 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.023966 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:36.073151 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.073107 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:36.073482 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.073397 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:36.076251 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.075946 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 07:35:36.076251 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.076080 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7xq8t\"" Jul 16 07:35:36.076828 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.076777 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 07:35:36.211140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.211057 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7"] Jul 16 07:35:36.217017 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:36.216986 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ee6427_c83c_4303_870a_05438d126e81.slice/crio-e3a577751f376ba7d9cdd18e9c5c35753406b73b6b12ea2301f33ac06c571c20 WatchSource:0}: Error finding container e3a577751f376ba7d9cdd18e9c5c35753406b73b6b12ea2301f33ac06c571c20: Status 404 returned error can't find the container with id e3a577751f376ba7d9cdd18e9c5c35753406b73b6b12ea2301f33ac06c571c20 Jul 16 07:35:36.399579 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:36.399320 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" event={"ID":"73ee6427-c83c-4303-870a-05438d126e81","Type":"ContainerStarted","Data":"e3a577751f376ba7d9cdd18e9c5c35753406b73b6b12ea2301f33ac06c571c20"} Jul 16 07:35:37.522186 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.522148 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-rx9x5"] Jul 16 07:35:37.533083 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.533052 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:35:37.534479 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.534449 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-rx9x5"] Jul 16 07:35:37.535948 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.535431 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bs8zz\"" Jul 16 07:35:37.535948 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.535757 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 16 07:35:37.536356 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.536198 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 16 07:35:37.652829 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.652791 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5vmx\" (UniqueName: \"kubernetes.io/projected/9afa21c7-65a9-49c3-a285-508a1249a98f-kube-api-access-p5vmx\") pod \"downloads-68c9cbb497-rx9x5\" (UID: \"9afa21c7-65a9-49c3-a285-508a1249a98f\") " pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:35:37.753685 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.753645 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5vmx\" (UniqueName: \"kubernetes.io/projected/9afa21c7-65a9-49c3-a285-508a1249a98f-kube-api-access-p5vmx\") pod \"downloads-68c9cbb497-rx9x5\" (UID: \"9afa21c7-65a9-49c3-a285-508a1249a98f\") " pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:35:37.764122 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.764056 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5vmx\" (UniqueName: \"kubernetes.io/projected/9afa21c7-65a9-49c3-a285-508a1249a98f-kube-api-access-p5vmx\") pod \"downloads-68c9cbb497-rx9x5\" (UID: \"9afa21c7-65a9-49c3-a285-508a1249a98f\") " pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:35:37.845106 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:37.845029 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:35:42.645861 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:42.645637 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-rx9x5"] Jul 16 07:35:42.662575 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:42.662521 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9afa21c7_65a9_49c3_a285_508a1249a98f.slice/crio-364f01ac7a781cac9790e88c89b386eb35848b5a1108944ff2a75d6d9b88bc2e WatchSource:0}: Error finding container 364f01ac7a781cac9790e88c89b386eb35848b5a1108944ff2a75d6d9b88bc2e: Status 404 returned error can't find the container with id 364f01ac7a781cac9790e88c89b386eb35848b5a1108944ff2a75d6d9b88bc2e Jul 16 07:35:43.424600 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.424563 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsgjq" event={"ID":"31f6f870-d782-4465-b4c0-83096b6db5d0","Type":"ContainerStarted","Data":"9c052bc8aeae79ff6b488d546d53ef68778f35c27da85b2b349162b95daf3aeb"} Jul 16 07:35:43.426820 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.426748 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-rx9x5" event={"ID":"9afa21c7-65a9-49c3-a285-508a1249a98f","Type":"ContainerStarted","Data":"364f01ac7a781cac9790e88c89b386eb35848b5a1108944ff2a75d6d9b88bc2e"} Jul 16 07:35:43.428786 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.428756 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-95nzz" event={"ID":"b2b44b36-f1ef-46a5-8e01-3fbe945e9436","Type":"ContainerStarted","Data":"7c3c80ebde28700412bf15b06bd0d253d90d07dadbf5f631b08f4a02fa35491b"} Jul 16 07:35:43.433065 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.433026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ksgcr" event={"ID":"2946c501-8b0f-4cd0-bb52-02abf840eac4","Type":"ContainerStarted","Data":"2efabf5010f1642a685a23848dacedd5c5e41d5a8f17cf87ab20b1009e2db44a"} Jul 16 07:35:43.433173 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.433078 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ksgcr" event={"ID":"2946c501-8b0f-4cd0-bb52-02abf840eac4","Type":"ContainerStarted","Data":"274ff9fb12ce75eeb54147a5f484c66249e203f84a6093ea0aedfdd8b45cd025"} Jul 16 07:35:43.433308 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.433290 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:43.435837 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.435814 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" event={"ID":"73ee6427-c83c-4303-870a-05438d126e81","Type":"ContainerStarted","Data":"bbcd82b82be3e514fa95ce28f56f05c681c57227a7815312809e6bde7f687bda"} Jul 16 07:35:43.436328 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.436283 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:43.443048 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.442785 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" Jul 16 07:35:43.445908 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.445632 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-95nzz" podStartSLOduration=2.277413357 podStartE2EDuration="9.445613913s" totalImagesPullingTime="7.168200556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:43.44517095 +0000 UTC m=+56.528596570" watchObservedRunningTime="2026-07-16 07:35:43.445613913 +0000 UTC m=+56.529039529" Jul 16 07:35:43.460743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.460689 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-jxsp7" podStartSLOduration=2.173234482 podStartE2EDuration="8.460668461s" totalImagesPullingTime="6.287433979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:43.459657717 +0000 UTC m=+56.543083338" watchObservedRunningTime="2026-07-16 07:35:43.460668461 +0000 UTC m=+56.544094081" Jul 16 07:35:43.479316 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.479136 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ksgcr" podStartSLOduration=2.60938625 podStartE2EDuration="9.479111754s" totalImagesPullingTime="6.869725504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:43.477802144 +0000 UTC m=+56.561227774" watchObservedRunningTime="2026-07-16 07:35:43.479111754 +0000 UTC m=+56.562537372" Jul 16 07:35:43.763711 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.763601 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9lbgg"] Jul 16 07:35:43.765613 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.765558 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.769005 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.768968 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 07:35:43.769559 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.768968 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 07:35:43.769559 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.769371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 07:35:43.770323 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.770106 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 07:35:43.770323 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.770153 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 07:35:43.770323 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.770106 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t7p5c\"" Jul 16 07:35:43.776248 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.776220 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9lbgg"] Jul 16 07:35:43.799642 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.799611 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.799805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.799679 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.799805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.799755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.799913 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.799836 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2pvc\" (UniqueName: \"kubernetes.io/projected/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-kube-api-access-r2pvc\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.900853 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.900811 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2pvc\" (UniqueName: \"kubernetes.io/projected/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-kube-api-access-r2pvc\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.901027 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.900880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.901027 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.900921 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.901027 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.900967 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.901191 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:43.901076 2570 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 16 07:35:43.901191 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:43.901141 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-tls podName:60ce04b1-18fd-45ed-b5eb-b9ddad7b341a nodeName:}" failed. No retries permitted until 2026-07-16 07:35:44.401122412 +0000 UTC m=+57.484548021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-tls") pod "prometheus-operator-64785b6675-9lbgg" (UID: "60ce04b1-18fd-45ed-b5eb-b9ddad7b341a") : secret "prometheus-operator-tls" not found Jul 16 07:35:43.901708 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.901683 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.905984 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.905966 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:43.912142 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:43.911978 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2pvc\" (UniqueName: \"kubernetes.io/projected/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-kube-api-access-r2pvc\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:44.405310 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.405267 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:44.409186 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.409153 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/60ce04b1-18fd-45ed-b5eb-b9ddad7b341a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-9lbgg\" (UID: \"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:44.680155 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.680105 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" Jul 16 07:35:44.846261 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.846217 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5686f56664-w8r75"] Jul 16 07:35:44.849128 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.849099 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:44.853875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.853093 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 16 07:35:44.853875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.853346 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 16 07:35:44.853875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.853618 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 16 07:35:44.853875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.853746 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 16 07:35:44.853875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.853808 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 16 07:35:44.853875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.853809 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5lv28\"" Jul 16 07:35:44.860985 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.860572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5686f56664-w8r75"] Jul 16 07:35:44.909357 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.909247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-console-config\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:44.909357 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.909287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn6c9\" (UniqueName: \"kubernetes.io/projected/684d249a-1894-4247-9aa2-ecf87d248cd2-kube-api-access-hn6c9\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:44.909357 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.909319 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-serving-cert\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:44.909705 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.909385 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-oauth-serving-cert\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:44.909705 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.909418 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-oauth-config\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:44.909705 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:44.909437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-service-ca\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.010262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.010180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-oauth-config\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.010262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.010224 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-service-ca\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.010471 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.010310 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-console-config\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.010471 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.010333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn6c9\" (UniqueName: \"kubernetes.io/projected/684d249a-1894-4247-9aa2-ecf87d248cd2-kube-api-access-hn6c9\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.010471 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.010363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-serving-cert\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.010471 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.010403 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-oauth-serving-cert\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.011187 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.011156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-oauth-serving-cert\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.011313 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.011296 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-console-config\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.011982 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.011955 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-service-ca\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.013144 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.013127 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-oauth-config\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.014158 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.014135 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-serving-cert\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.019182 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.019155 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn6c9\" (UniqueName: \"kubernetes.io/projected/684d249a-1894-4247-9aa2-ecf87d248cd2-kube-api-access-hn6c9\") pod \"console-5686f56664-w8r75\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:45.164246 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:45.164205 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:46.636319 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:46.636293 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-9lbgg"] Jul 16 07:35:46.639945 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:46.639915 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ce04b1_18fd_45ed_b5eb_b9ddad7b341a.slice/crio-84834c863a6405e0d3c7c7c78b6dfee9cdcf316ebd66e9a94dcce7abbc86dd36 WatchSource:0}: Error finding container 84834c863a6405e0d3c7c7c78b6dfee9cdcf316ebd66e9a94dcce7abbc86dd36: Status 404 returned error can't find the container with id 84834c863a6405e0d3c7c7c78b6dfee9cdcf316ebd66e9a94dcce7abbc86dd36 Jul 16 07:35:46.650256 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:46.650194 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5686f56664-w8r75"] Jul 16 07:35:46.653320 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:46.653292 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684d249a_1894_4247_9aa2_ecf87d248cd2.slice/crio-fcd53443da9e31f752e75043b6abf661203f90d0bc0d326b542f0e75565e1e74 WatchSource:0}: Error finding container fcd53443da9e31f752e75043b6abf661203f90d0bc0d326b542f0e75565e1e74: Status 404 returned error can't find the container with id fcd53443da9e31f752e75043b6abf661203f90d0bc0d326b542f0e75565e1e74 Jul 16 07:35:47.455988 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:47.455880 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" event={"ID":"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a","Type":"ContainerStarted","Data":"84834c863a6405e0d3c7c7c78b6dfee9cdcf316ebd66e9a94dcce7abbc86dd36"} Jul 16 07:35:47.458279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:47.458215 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5686f56664-w8r75" event={"ID":"684d249a-1894-4247-9aa2-ecf87d248cd2","Type":"ContainerStarted","Data":"fcd53443da9e31f752e75043b6abf661203f90d0bc0d326b542f0e75565e1e74"} Jul 16 07:35:47.461256 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:47.461178 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsgjq" event={"ID":"31f6f870-d782-4465-b4c0-83096b6db5d0","Type":"ContainerStarted","Data":"ff6470e8d96c1464aa0e64c5de2312826b96298a5b1956bea10f17c40e196270"} Jul 16 07:35:49.366607 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:49.366544 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c82rv" Jul 16 07:35:49.472560 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:49.472504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" event={"ID":"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a","Type":"ContainerStarted","Data":"7cba2c9b1b5801bd033dbc3e034f3ab96ed2054109b61aa13c80c0a1b468a260"} Jul 16 07:35:49.472745 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:49.472585 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" event={"ID":"60ce04b1-18fd-45ed-b5eb-b9ddad7b341a","Type":"ContainerStarted","Data":"1d6fc31f52f0d520a784a10c0079eb6d780df86b2c5b1e49a9fbfe0a1305a9a1"} Jul 16 07:35:49.493145 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:49.493089 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-9lbgg" podStartSLOduration=4.644931113 podStartE2EDuration="6.493067878s" totalImagesPullingTime="1.848136765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:49.492244133 +0000 UTC m=+62.575669762" watchObservedRunningTime="2026-07-16 07:35:49.493067878 +0000 UTC m=+62.576493499" Jul 16 07:35:51.113817 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.113787 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn"] Jul 16 07:35:51.124617 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.124589 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.128278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.128006 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 16 07:35:51.128278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.128049 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4hhs7\"" Jul 16 07:35:51.128278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.128077 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 16 07:35:51.139664 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.139543 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn"] Jul 16 07:35:51.158426 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.158353 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-59kgw"] Jul 16 07:35:51.161113 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.161091 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.163756 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.163568 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b4fdc\"" Jul 16 07:35:51.163756 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.163618 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 07:35:51.163756 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.163655 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 07:35:51.164021 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.163982 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 07:35:51.169989 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.169966 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2208be-d28a-4f94-9b3e-a629eb86e578-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.170099 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.170053 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c2208be-d28a-4f94-9b3e-a629eb86e578-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.170099 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.170081 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c2208be-d28a-4f94-9b3e-a629eb86e578-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.170218 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.170141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99bwt\" (UniqueName: \"kubernetes.io/projected/6c2208be-d28a-4f94-9b3e-a629eb86e578-kube-api-access-99bwt\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.173369 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.173337 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h9cld"] Jul 16 07:35:51.175819 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.175788 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.178034 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.178011 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fp9fw\"" Jul 16 07:35:51.178121 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.178058 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 16 07:35:51.178121 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.178077 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 16 07:35:51.178559 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.178505 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 16 07:35:51.187801 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.187782 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h9cld"] Jul 16 07:35:51.270650 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270590 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/715dbd73-55cb-433e-8062-ebecd98b9c1d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270722 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715dbd73-55cb-433e-8062-ebecd98b9c1d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-wtmp\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270815 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c2208be-d28a-4f94-9b3e-a629eb86e578-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e176c05-590e-479c-a354-f5a3d1ec65ef-metrics-client-ca\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.270862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c2208be-d28a-4f94-9b3e-a629eb86e578-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270890 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.270976 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-root\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-sys\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg9lg\" (UniqueName: \"kubernetes.io/projected/6e176c05-590e-479c-a354-f5a3d1ec65ef-kube-api-access-hg9lg\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99bwt\" (UniqueName: \"kubernetes.io/projected/6c2208be-d28a-4f94-9b3e-a629eb86e578-kube-api-access-99bwt\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271137 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-tls\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271162 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fc6\" (UniqueName: \"kubernetes.io/projected/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-api-access-p6fc6\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-textfile\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271214 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.271285 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2208be-d28a-4f94-9b3e-a629eb86e578-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.272028 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.271663 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c2208be-d28a-4f94-9b3e-a629eb86e578-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.273856 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.273828 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c2208be-d28a-4f94-9b3e-a629eb86e578-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.274034 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.274010 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c2208be-d28a-4f94-9b3e-a629eb86e578-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.282131 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.282100 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99bwt\" (UniqueName: \"kubernetes.io/projected/6c2208be-d28a-4f94-9b3e-a629eb86e578-kube-api-access-99bwt\") pod \"openshift-state-metrics-84bd68b896-cg4pn\" (UID: \"6c2208be-d28a-4f94-9b3e-a629eb86e578\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.372476 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.372697 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372652 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-root\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.372800 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372703 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-sys\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.372800 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372742 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg9lg\" (UniqueName: \"kubernetes.io/projected/6e176c05-590e-479c-a354-f5a3d1ec65ef-kube-api-access-hg9lg\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.372800 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.372979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-tls\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.372979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372834 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fc6\" (UniqueName: \"kubernetes.io/projected/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-api-access-p6fc6\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.372979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372864 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-textfile\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.372979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.372979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.372940 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373008 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/715dbd73-55cb-433e-8062-ebecd98b9c1d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373166 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-root\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-textfile\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373494 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715dbd73-55cb-433e-8062-ebecd98b9c1d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373562 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-wtmp\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373627 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e176c05-590e-479c-a354-f5a3d1ec65ef-metrics-client-ca\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.373896 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.374041 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-wtmp\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374169 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.374160 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e176c05-590e-479c-a354-f5a3d1ec65ef-sys\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.374687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.374282 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/715dbd73-55cb-433e-8062-ebecd98b9c1d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.374687 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.374543 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/715dbd73-55cb-433e-8062-ebecd98b9c1d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.375248 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.374813 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e176c05-590e-479c-a354-f5a3d1ec65ef-metrics-client-ca\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.375248 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.375193 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-accelerators-collector-config\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.377596 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.377554 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.377956 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.377927 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.378142 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.378122 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e176c05-590e-479c-a354-f5a3d1ec65ef-node-exporter-tls\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.378293 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.378270 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.381797 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.381774 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg9lg\" (UniqueName: \"kubernetes.io/projected/6e176c05-590e-479c-a354-f5a3d1ec65ef-kube-api-access-hg9lg\") pod \"node-exporter-59kgw\" (UID: \"6e176c05-590e-479c-a354-f5a3d1ec65ef\") " pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.382293 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.382269 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fc6\" (UniqueName: \"kubernetes.io/projected/715dbd73-55cb-433e-8062-ebecd98b9c1d-kube-api-access-p6fc6\") pod \"kube-state-metrics-785778ff74-h9cld\" (UID: \"715dbd73-55cb-433e-8062-ebecd98b9c1d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:51.437046 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.436942 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" Jul 16 07:35:51.473111 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.473078 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-59kgw" Jul 16 07:35:51.487040 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:51.486863 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" Jul 16 07:35:52.203601 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.203555 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:35:52.215379 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.215349 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.218185 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218153 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vcvjh\"" Jul 16 07:35:52.218318 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218212 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 07:35:52.218608 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218413 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 07:35:52.218608 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218484 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 07:35:52.218608 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218512 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 07:35:52.218608 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218543 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 07:35:52.218608 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218582 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 07:35:52.218903 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.218874 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 07:35:52.219219 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.219134 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 07:35:52.219467 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.219447 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 07:35:52.225313 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.225291 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:35:52.280873 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.280827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.280873 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.280869 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-web-config\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.280895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.280923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.280957 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.280984 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-config-out\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281067 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281116 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp7ml\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-kube-api-access-lp7ml\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.281365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.281213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.382785 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.382757 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.382876 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.382807 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.382876 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.382839 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.382876 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.382866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.383023 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.382930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp7ml\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-kube-api-access-lp7ml\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.383023 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.382996 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.383878 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:52.383624 2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 07:35:52.383878 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:52.383765 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle podName:a7019146-bf06-43dc-a777-89c6ed61973c nodeName:}" failed. No retries permitted until 2026-07-16 07:35:52.882989664 +0000 UTC m=+65.966415265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c") : configmap references non-existent config key: ca-bundle.crt Jul 16 07:35:52.383878 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:35:52.383802 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls podName:a7019146-bf06-43dc-a777-89c6ed61973c nodeName:}" failed. No retries permitted until 2026-07-16 07:35:52.883781448 +0000 UTC m=+65.967207051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c") : secret "alertmanager-main-tls" not found Jul 16 07:35:52.384112 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.383905 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.384112 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.384012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.384112 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.384058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-web-config\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.384112 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.384086 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.384306 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.384121 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.386551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.385663 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.386551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.386112 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.388503 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.384186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.388503 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.388165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-config-out\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.389161 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.389142 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.399548 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.398456 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.399548 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.398706 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-config-out\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.404699 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.403857 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.404699 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.404609 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-web-config\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.405479 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.405426 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.406148 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.406017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.406900 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.406846 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.410880 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.410846 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp7ml\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-kube-api-access-lp7ml\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.438303 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.438272 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn"] Jul 16 07:35:52.441145 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:52.441115 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2208be_d28a_4f94_9b3e_a629eb86e578.slice/crio-a02d0f6f008096f8eb50fa6d6b21575562699b0d3987e91b810af04def3b2bc0 WatchSource:0}: Error finding container a02d0f6f008096f8eb50fa6d6b21575562699b0d3987e91b810af04def3b2bc0: Status 404 returned error can't find the container with id a02d0f6f008096f8eb50fa6d6b21575562699b0d3987e91b810af04def3b2bc0 Jul 16 07:35:52.463667 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.463639 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-h9cld"] Jul 16 07:35:52.470699 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:52.470658 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715dbd73_55cb_433e_8062_ebecd98b9c1d.slice/crio-3357f1b5dcd1a7e50dabc894997f7de9aafa42635577c250bb3d2aa0d89a2141 WatchSource:0}: Error finding container 3357f1b5dcd1a7e50dabc894997f7de9aafa42635577c250bb3d2aa0d89a2141: Status 404 returned error can't find the container with id 3357f1b5dcd1a7e50dabc894997f7de9aafa42635577c250bb3d2aa0d89a2141 Jul 16 07:35:52.487509 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.487481 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vsgjq" event={"ID":"31f6f870-d782-4465-b4c0-83096b6db5d0","Type":"ContainerStarted","Data":"eb2d71a917914c73b77d7f470a9e3cf2390f82443efb09f18824fd757e980e40"} Jul 16 07:35:52.488992 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.488960 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" event={"ID":"6c2208be-d28a-4f94-9b3e-a629eb86e578","Type":"ContainerStarted","Data":"a02d0f6f008096f8eb50fa6d6b21575562699b0d3987e91b810af04def3b2bc0"} Jul 16 07:35:52.490569 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.490504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" event={"ID":"715dbd73-55cb-433e-8062-ebecd98b9c1d","Type":"ContainerStarted","Data":"3357f1b5dcd1a7e50dabc894997f7de9aafa42635577c250bb3d2aa0d89a2141"} Jul 16 07:35:52.493201 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.492815 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5686f56664-w8r75" event={"ID":"684d249a-1894-4247-9aa2-ecf87d248cd2","Type":"ContainerStarted","Data":"79579027e42879cb97328e94dfb7b561c9f078e7c9369281014acfa4f41ab50a"} Jul 16 07:35:52.494552 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.494507 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59kgw" event={"ID":"6e176c05-590e-479c-a354-f5a3d1ec65ef","Type":"ContainerStarted","Data":"a2350683a0893fbeac80697971a3667a963f65c6d3de9dc67f072c520bccb2cb"} Jul 16 07:35:52.510132 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.509169 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vsgjq" podStartSLOduration=1.722545142 podStartE2EDuration="18.509150013s" totalImagesPullingTime="16.786604871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:35:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:52.508914135 +0000 UTC m=+65.592339753" watchObservedRunningTime="2026-07-16 07:35:52.509150013 +0000 UTC m=+65.592575630" Jul 16 07:35:52.527159 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.527112 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5686f56664-w8r75" podStartSLOduration=2.9059756119999998 podStartE2EDuration="8.527090637s" totalImagesPullingTime="5.621115025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:52.526452364 +0000 UTC m=+65.609877982" watchObservedRunningTime="2026-07-16 07:35:52.527090637 +0000 UTC m=+65.610516254" Jul 16 07:35:52.690287 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.690253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:52.690432 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.690299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:52.692920 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.692896 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 07:35:52.693054 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.692928 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 07:35:52.703625 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.703570 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/29f81e96-432a-41e3-b159-058a80df912d-original-pull-secret\") pod \"global-pull-secret-syncer-n4w27\" (UID: \"29f81e96-432a-41e3-b159-058a80df912d\") " pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:52.703766 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.703644 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b9dfde2-1341-4275-b6e9-b3040ffe0ce2-metrics-certs\") pod \"network-metrics-daemon-l4h5h\" (UID: \"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2\") " pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:52.887988 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.887903 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4w27" Jul 16 07:35:52.892976 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.892593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:52.892976 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.892688 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.893162 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.893122 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.894176 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.894130 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.895974 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.895723 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 07:35:52.896492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.896381 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:52.896933 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.896772 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7xq8t\"" Jul 16 07:35:52.904772 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.904734 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l4h5h" Jul 16 07:35:52.906023 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.906004 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 07:35:52.917657 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:52.917601 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmcmp\" (UniqueName: \"kubernetes.io/projected/b7267e69-411d-418a-8b40-ef07a2553e61-kube-api-access-gmcmp\") pod \"network-check-target-ghxkm\" (UID: \"b7267e69-411d-418a-8b40-ef07a2553e61\") " pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:53.064115 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.061403 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4w27"] Jul 16 07:35:53.065434 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:53.065399 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f81e96_432a_41e3_b159_058a80df912d.slice/crio-ccbc2f5447370e648e79beeeb14fd7efe9e63a51f8293083633725d6cdf734c4 WatchSource:0}: Error finding container ccbc2f5447370e648e79beeeb14fd7efe9e63a51f8293083633725d6cdf734c4: Status 404 returned error can't find the container with id ccbc2f5447370e648e79beeeb14fd7efe9e63a51f8293083633725d6cdf734c4 Jul 16 07:35:53.084574 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.084331 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xtqbp\"" Jul 16 07:35:53.092793 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.092768 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:35:53.098570 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.098480 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l4h5h"] Jul 16 07:35:53.104375 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:53.104338 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9dfde2_1341_4275_b6e9_b3040ffe0ce2.slice/crio-698f144da2fa15ca530f7c0283173c911b48bcc00e3417993f58358724f1c11b WatchSource:0}: Error finding container 698f144da2fa15ca530f7c0283173c911b48bcc00e3417993f58358724f1c11b: Status 404 returned error can't find the container with id 698f144da2fa15ca530f7c0283173c911b48bcc00e3417993f58358724f1c11b Jul 16 07:35:53.130474 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.130431 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:35:53.165477 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.164346 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h"] Jul 16 07:35:53.168497 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.167764 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.170652 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.170893 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-26r1l0bs8j9mq\"" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.171202 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.171417 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rcxh6\"" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.171624 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.171937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 07:35:53.172972 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.172147 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 07:35:53.187941 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.184749 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h"] Jul 16 07:35:53.196200 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196127 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-tls\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196200 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196181 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e05908-1179-4a74-ac95-b71ac1a2cc40-metrics-client-ca\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196411 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196411 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196411 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196411 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196312 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/83e05908-1179-4a74-ac95-b71ac1a2cc40-kube-api-access-csshk\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196411 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196345 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.196411 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.196375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-grpc-tls\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.271309 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.271232 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ghxkm"] Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299325 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e05908-1179-4a74-ac95-b71ac1a2cc40-metrics-client-ca\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299375 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299416 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/83e05908-1179-4a74-ac95-b71ac1a2cc40-kube-api-access-csshk\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299557 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-grpc-tls\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.300651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.299688 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-tls\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.304369 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.304156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83e05908-1179-4a74-ac95-b71ac1a2cc40-metrics-client-ca\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.304627 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.304603 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.309040 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.308576 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.309159 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.309104 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-tls\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.311896 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.311866 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.311996 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.311907 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.312104 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.312080 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/83e05908-1179-4a74-ac95-b71ac1a2cc40-secret-grpc-tls\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.318877 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.318826 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/83e05908-1179-4a74-ac95-b71ac1a2cc40-kube-api-access-csshk\") pod \"thanos-querier-67c95ff9d8-2zl7h\" (UID: \"83e05908-1179-4a74-ac95-b71ac1a2cc40\") " pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.346654 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.346543 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:35:53.440564 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.440474 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc98cffd7-hrtzj"] Jul 16 07:35:53.443382 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.443340 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.444259 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.443668 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ksgcr" Jul 16 07:35:53.456937 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.456900 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc98cffd7-hrtzj"] Jul 16 07:35:53.461494 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.461467 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 16 07:35:53.491366 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.491325 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:35:53.501466 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-oauth-config\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.501629 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501477 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-config\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.501629 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-service-ca\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.501762 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501620 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smjb7\" (UniqueName: \"kubernetes.io/projected/f8b293c3-568d-4a70-8cf2-069fc8d7843e-kube-api-access-smjb7\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.501762 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-trusted-ca-bundle\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.501762 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-serving-cert\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.501906 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.501759 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-oauth-serving-cert\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.503864 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.503744 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" event={"ID":"6c2208be-d28a-4f94-9b3e-a629eb86e578","Type":"ContainerStarted","Data":"42e2aea81af83a4c949b6b37963727fb1604b00f49e592d8cda1cfc86f3fab3f"} Jul 16 07:35:53.503864 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.503813 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" event={"ID":"6c2208be-d28a-4f94-9b3e-a629eb86e578","Type":"ContainerStarted","Data":"b973351c300b2509f366d77df5556191711ba4fd10365ea207543d150b458e0d"} Jul 16 07:35:53.505992 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.505938 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l4h5h" event={"ID":"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2","Type":"ContainerStarted","Data":"698f144da2fa15ca530f7c0283173c911b48bcc00e3417993f58358724f1c11b"} Jul 16 07:35:53.508834 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.508350 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4w27" event={"ID":"29f81e96-432a-41e3-b159-058a80df912d","Type":"ContainerStarted","Data":"ccbc2f5447370e648e79beeeb14fd7efe9e63a51f8293083633725d6cdf734c4"} Jul 16 07:35:53.602860 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.602829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-oauth-serving-cert\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603028 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.602908 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-oauth-config\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603104 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.603036 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-config\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603104 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.603085 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-service-ca\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603632 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.603249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smjb7\" (UniqueName: \"kubernetes.io/projected/f8b293c3-568d-4a70-8cf2-069fc8d7843e-kube-api-access-smjb7\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603632 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.603299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-trusted-ca-bundle\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603632 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.603327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-serving-cert\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.603882 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.603638 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-oauth-serving-cert\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.604419 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.604397 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-trusted-ca-bundle\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.604582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.604558 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-config\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.604655 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.604602 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-service-ca\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.606402 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.606382 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-oauth-config\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.606945 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.606902 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-serving-cert\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.612987 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.612946 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smjb7\" (UniqueName: \"kubernetes.io/projected/f8b293c3-568d-4a70-8cf2-069fc8d7843e-kube-api-access-smjb7\") pod \"console-7dc98cffd7-hrtzj\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:53.616054 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:53.616009 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7019146_bf06_43dc_a777_89c6ed61973c.slice/crio-ab14c628110edcf69815821473e06ff3ddeaa8a5be055ac3f3a9db99ac8c5825 WatchSource:0}: Error finding container ab14c628110edcf69815821473e06ff3ddeaa8a5be055ac3f3a9db99ac8c5825: Status 404 returned error can't find the container with id ab14c628110edcf69815821473e06ff3ddeaa8a5be055ac3f3a9db99ac8c5825 Jul 16 07:35:53.618568 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:35:53.618510 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7267e69_411d_418a_8b40_ef07a2553e61.slice/crio-2d78730bbd575200df769c9a74bdd7164bcccbc6e2668a014f43b1d5ab7e23a6 WatchSource:0}: Error finding container 2d78730bbd575200df769c9a74bdd7164bcccbc6e2668a014f43b1d5ab7e23a6: Status 404 returned error can't find the container with id 2d78730bbd575200df769c9a74bdd7164bcccbc6e2668a014f43b1d5ab7e23a6 Jul 16 07:35:53.763205 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:53.763090 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:35:54.549048 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:54.548919 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"ab14c628110edcf69815821473e06ff3ddeaa8a5be055ac3f3a9db99ac8c5825"} Jul 16 07:35:54.553126 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:54.553094 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ghxkm" event={"ID":"b7267e69-411d-418a-8b40-ef07a2553e61","Type":"ContainerStarted","Data":"2d78730bbd575200df769c9a74bdd7164bcccbc6e2668a014f43b1d5ab7e23a6"} Jul 16 07:35:54.630803 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:54.630767 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h"] Jul 16 07:35:54.673318 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:54.673286 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc98cffd7-hrtzj"] Jul 16 07:35:55.165020 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.164324 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:55.165020 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.164589 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:35:55.166161 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.165829 2570 patch_prober.go:28] interesting pod/console-5686f56664-w8r75 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body= Jul 16 07:35:55.166161 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.165889 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5686f56664-w8r75" podUID="684d249a-1894-4247-9aa2-ecf87d248cd2" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" Jul 16 07:35:55.446997 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.446899 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-df69cb447-l5wl7"] Jul 16 07:35:55.451438 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.451416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.455452 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.455177 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 07:35:55.455452 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.455265 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 07:35:55.455452 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.455313 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 07:35:55.455452 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.455320 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8vrg6erdp2hjf\"" Jul 16 07:35:55.455452 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.455348 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tsk82\"" Jul 16 07:35:55.456133 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.455486 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 07:35:55.462295 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.462232 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-df69cb447-l5wl7"] Jul 16 07:35:55.525950 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.525808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-metrics-server-audit-profiles\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.525950 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.525892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-secret-metrics-server-client-certs\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.526264 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.525965 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-audit-log\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.526264 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.526041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-secret-metrics-server-tls\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.526264 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.526079 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxk88\" (UniqueName: \"kubernetes.io/projected/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-kube-api-access-vxk88\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.526264 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.526121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-client-ca-bundle\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.526264 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.526166 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.562393 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.561279 2570 generic.go:356] "Generic (PLEG): container finished" podID="6e176c05-590e-479c-a354-f5a3d1ec65ef" containerID="f20049b02dcc12215e939222b7da5f66bd13e87795b302dc259bb1f62cdd3cc1" exitCode=0 Jul 16 07:35:55.562393 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.561363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59kgw" event={"ID":"6e176c05-590e-479c-a354-f5a3d1ec65ef","Type":"ContainerDied","Data":"f20049b02dcc12215e939222b7da5f66bd13e87795b302dc259bb1f62cdd3cc1"} Jul 16 07:35:55.568265 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.567659 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc98cffd7-hrtzj" event={"ID":"f8b293c3-568d-4a70-8cf2-069fc8d7843e","Type":"ContainerStarted","Data":"9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1"} Jul 16 07:35:55.568265 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.567715 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc98cffd7-hrtzj" event={"ID":"f8b293c3-568d-4a70-8cf2-069fc8d7843e","Type":"ContainerStarted","Data":"afe04a72aa57b44a6f28c4e37f5a8992f73cef1c7c77ff036ed493437c5ebaa4"} Jul 16 07:35:55.572447 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.571774 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" event={"ID":"6c2208be-d28a-4f94-9b3e-a629eb86e578","Type":"ContainerStarted","Data":"49cbd1a1e2d86b25ce75020d65155dc9e8bd0d9be195961104c1a3057828d343"} Jul 16 07:35:55.576901 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.576289 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" event={"ID":"715dbd73-55cb-433e-8062-ebecd98b9c1d","Type":"ContainerStarted","Data":"1cd0aab096e92057f8759fcd8405abafb134ed3cab21b6d55998c31ccfc3e26e"} Jul 16 07:35:55.576901 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.576345 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" event={"ID":"715dbd73-55cb-433e-8062-ebecd98b9c1d","Type":"ContainerStarted","Data":"e264927d28a013f4e6835366aebbcd0b61c853dcba5eda084185e3bc526477c0"} Jul 16 07:35:55.576901 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.576383 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" event={"ID":"715dbd73-55cb-433e-8062-ebecd98b9c1d","Type":"ContainerStarted","Data":"8fe531415153341702d50fdacdabb70a6dd0594f26478502be0350bb98d0f93e"} Jul 16 07:35:55.581826 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.581742 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"50a705c14beccc943acaadfd5d1a8655fcd17aa3b69b914bb1b487e0e80e7964"} Jul 16 07:35:55.600329 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.600272 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-h9cld" podStartSLOduration=2.667065448 podStartE2EDuration="4.600237547s" totalImagesPullingTime="1.933172099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:55.599149442 +0000 UTC m=+68.682575060" watchObservedRunningTime="2026-07-16 07:35:55.600237547 +0000 UTC m=+68.683663163" Jul 16 07:35:55.617641 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.617178 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-cg4pn" podStartSLOduration=2.8068877519999997 podStartE2EDuration="4.617155897s" totalImagesPullingTime="1.810268145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:55.615395357 +0000 UTC m=+68.698820974" watchObservedRunningTime="2026-07-16 07:35:55.617155897 +0000 UTC m=+68.700581495" Jul 16 07:35:55.626889 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.626801 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-client-ca-bundle\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.627061 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.626901 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.627061 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.627044 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-metrics-server-audit-profiles\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.629585 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.627243 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-secret-metrics-server-client-certs\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.629585 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.627275 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-audit-log\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.629585 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.627444 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-secret-metrics-server-tls\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.629585 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.627472 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxk88\" (UniqueName: \"kubernetes.io/projected/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-kube-api-access-vxk88\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.629585 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.629000 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.631460 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.630556 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-metrics-server-audit-profiles\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.631460 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.630989 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-client-ca-bundle\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.631678 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.631491 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-audit-log\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.634148 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.634080 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-secret-metrics-server-client-certs\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.635894 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.635852 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-secret-metrics-server-tls\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.639406 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.638993 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc98cffd7-hrtzj" podStartSLOduration=2.638979157 podStartE2EDuration="2.638979157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:35:55.638801315 +0000 UTC m=+68.722226937" watchObservedRunningTime="2026-07-16 07:35:55.638979157 +0000 UTC m=+68.722404774" Jul 16 07:35:55.644391 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.643864 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxk88\" (UniqueName: \"kubernetes.io/projected/88fadfb5-fe4f-4148-a24f-93ae6ebc7161-kube-api-access-vxk88\") pod \"metrics-server-df69cb447-l5wl7\" (UID: \"88fadfb5-fe4f-4148-a24f-93ae6ebc7161\") " pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:55.767790 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:55.767703 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:35:57.415117 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.415082 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:35:57.419004 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.418973 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.422278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.422253 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 07:35:57.422540 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.422492 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 07:35:57.422540 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.422504 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 07:35:57.423054 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.423038 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 07:35:57.423326 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.423307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 07:35:57.423496 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.423481 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 07:35:57.424097 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.424076 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 07:35:57.424562 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.424543 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 07:35:57.424985 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.424751 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 07:35:57.424985 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.424921 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 07:35:57.425707 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.425564 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 07:35:57.425707 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.425691 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 07:35:57.426694 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.426025 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cm6c2kq61g21h\"" Jul 16 07:35:57.426694 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.426208 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 07:35:57.426694 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.426425 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rmkcr\"" Jul 16 07:35:57.433986 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.433953 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 07:35:57.439073 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.438776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:35:57.549467 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549432 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549474 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549554 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549581 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549604 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549649 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549784 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549837 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549866 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.549958 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.550286 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.549969 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.550286 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.550029 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.550286 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.550060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.550286 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.550093 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccx8\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-kube-api-access-mccx8\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.550286 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.550184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651392 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651575 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651408 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651575 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651575 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651575 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651575 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651647 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651676 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651703 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651731 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651763 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.651846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651847 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.651982 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.652014 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.652045 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.652082 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccx8\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-kube-api-access-mccx8\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.652140 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.652600 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.652444 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.653914 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.652751 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.653914 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.653542 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.653914 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.653750 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.656187 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.656157 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.656358 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.656307 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.657129 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.656796 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.657275 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.657249 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.658213 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.658185 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.660866 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.660816 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.661010 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.660986 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.661137 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.661097 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.661803 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.661739 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.661895 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.661811 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.662255 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.662233 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-web-config\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.662497 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.662476 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config-out\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.662941 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.662899 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.664788 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.664745 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.665191 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.665118 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.666517 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.666493 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccx8\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-kube-api-access-mccx8\") pod \"prometheus-k8s-0\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:35:57.737848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:35:57.737810 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:36:01.468844 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:01.468807 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5686f56664-w8r75"] Jul 16 07:36:03.763538 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:03.763486 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:36:03.764031 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:03.763565 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:36:03.770274 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:03.770250 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:36:04.625023 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:04.624990 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:36:05.448945 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:05.447023 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-df69cb447-l5wl7"] Jul 16 07:36:07.531304 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:36:07.531268 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88fadfb5_fe4f_4148_a24f_93ae6ebc7161.slice/crio-c7bcfaed2e54da38b54f6441e5a0d11c7c4ca6c2daa3fe9534510ff1980da5c0 WatchSource:0}: Error finding container c7bcfaed2e54da38b54f6441e5a0d11c7c4ca6c2daa3fe9534510ff1980da5c0: Status 404 returned error can't find the container with id c7bcfaed2e54da38b54f6441e5a0d11c7c4ca6c2daa3fe9534510ff1980da5c0 Jul 16 07:36:07.632896 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:07.632865 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" event={"ID":"88fadfb5-fe4f-4148-a24f-93ae6ebc7161","Type":"ContainerStarted","Data":"c7bcfaed2e54da38b54f6441e5a0d11c7c4ca6c2daa3fe9534510ff1980da5c0"} Jul 16 07:36:08.085719 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.085595 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:36:08.121262 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:36:08.118355 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0c87ea_2126_42bd_af07_dd7afc8d0b87.slice/crio-68b205c25676260610363c9d0010924659457ebc5115e9dcd00e02467d511d56 WatchSource:0}: Error finding container 68b205c25676260610363c9d0010924659457ebc5115e9dcd00e02467d511d56: Status 404 returned error can't find the container with id 68b205c25676260610363c9d0010924659457ebc5115e9dcd00e02467d511d56 Jul 16 07:36:08.642305 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.642065 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"4ba4e7ac0b6ea4a8b7bebd59a1562e0d9cef79f81fae513aadd40b3e1d257aca"} Jul 16 07:36:08.642305 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.642191 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"0feafaeefb0e3109ff96166c3848f136af27ad2f68a17b4f1e095b7ff74823ab"} Jul 16 07:36:08.642305 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.642235 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"dab093e1039b4c316ac24047613b8d2525e92522163d1e232714f44fe221439f"} Jul 16 07:36:08.644871 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.644826 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4w27" event={"ID":"29f81e96-432a-41e3-b159-058a80df912d","Type":"ContainerStarted","Data":"5212587760b7280288fe604cf6219ad66b00d3f7d70f2598068d90a7e6309953"} Jul 16 07:36:08.647912 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.647667 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="46f5cc416eee99a263af088b60090e15e341e908a1ae5bbddf27c5817d93410a" exitCode=0 Jul 16 07:36:08.647912 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.647828 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"46f5cc416eee99a263af088b60090e15e341e908a1ae5bbddf27c5817d93410a"} Jul 16 07:36:08.647912 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.647902 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"68b205c25676260610363c9d0010924659457ebc5115e9dcd00e02467d511d56"} Jul 16 07:36:08.652262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.652237 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l4h5h" event={"ID":"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2","Type":"ContainerStarted","Data":"31f0368de5a9aada5713e5902a4216969be2ecbfae85a589d6d91289a508d2d1"} Jul 16 07:36:08.654040 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.652281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l4h5h" event={"ID":"6b9dfde2-1341-4275-b6e9-b3040ffe0ce2","Type":"ContainerStarted","Data":"ac7b6454dccf05ea511dddf053000d3ecc232c4de75eb676deb811fb2b77eae7"} Jul 16 07:36:08.654325 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.654298 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-rx9x5" event={"ID":"9afa21c7-65a9-49c3-a285-508a1249a98f","Type":"ContainerStarted","Data":"e3bd3d5e7140db26cdcec8b8fd9521834da94fbf5732cfae5ef3801a88e4e98e"} Jul 16 07:36:08.654753 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.654731 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:36:08.657027 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.657003 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925" exitCode=0 Jul 16 07:36:08.657134 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.657084 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925"} Jul 16 07:36:08.659844 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.659793 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ghxkm" event={"ID":"b7267e69-411d-418a-8b40-ef07a2553e61","Type":"ContainerStarted","Data":"46f34a071963ee62f1620ffcaa5cbb26a9daada104fd77a4d6b6761b7e065c1d"} Jul 16 07:36:08.659953 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.659903 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:36:08.664361 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.664252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59kgw" event={"ID":"6e176c05-590e-479c-a354-f5a3d1ec65ef","Type":"ContainerStarted","Data":"8253aeda20946de1ef02bb03aa2753e3ba4739bf14f78bf960c8c89e55ffb712"} Jul 16 07:36:08.664361 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.664338 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-59kgw" event={"ID":"6e176c05-590e-479c-a354-f5a3d1ec65ef","Type":"ContainerStarted","Data":"b1c42480a80a4aaff57d1cffdfa8e4e31fe7be988cf17971df3b8a0e35c4ec82"} Jul 16 07:36:08.665960 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.665918 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-rx9x5" Jul 16 07:36:08.677577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.677513 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4w27" podStartSLOduration=65.823459678 podStartE2EDuration="1m20.677498425s" totalImagesPullingTime="14.854038747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:08.662509009 +0000 UTC m=+81.745934627" watchObservedRunningTime="2026-07-16 07:36:08.677498425 +0000 UTC m=+81.760924020" Jul 16 07:36:08.677965 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.677925 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ghxkm" podStartSLOduration=66.392037246 podStartE2EDuration="1m20.677916797s" totalImagesPullingTime="14.285879551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:08.67688667 +0000 UTC m=+81.760312309" watchObservedRunningTime="2026-07-16 07:36:08.677916797 +0000 UTC m=+81.761342393" Jul 16 07:36:08.738405 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.736324 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l4h5h" podStartSLOduration=67.760012634 podStartE2EDuration="1m20.736300202s" totalImagesPullingTime="12.976287568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:08.719907891 +0000 UTC m=+81.803333508" watchObservedRunningTime="2026-07-16 07:36:08.736300202 +0000 UTC m=+81.819725822" Jul 16 07:36:08.738405 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.738077 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-rx9x5" podStartSLOduration=6.499647446 podStartE2EDuration="31.738062995s" totalImagesPullingTime="25.238415549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:08.737251745 +0000 UTC m=+81.820677380" watchObservedRunningTime="2026-07-16 07:36:08.738062995 +0000 UTC m=+81.821488616" Jul 16 07:36:08.788575 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:08.787940 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-59kgw" podStartSLOduration=15.531653747 podStartE2EDuration="17.78791746s" totalImagesPullingTime="2.118098927s" totalInitContainerRuntime="138.164786ms" isStatefulPod=true podCreationTimestamp="2026-07-16 07:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:08.786165312 +0000 UTC m=+81.869590934" watchObservedRunningTime="2026-07-16 07:36:08.78791746 +0000 UTC m=+81.871343080" Jul 16 07:36:10.681065 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.680968 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"18459e5f7a588b0154c3da9fb779b2e2869d19bee0559a4d4ab21c009661c834"} Jul 16 07:36:10.681584 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.681096 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:36:10.681584 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.681137 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"3c2bdaf1ebecedaf16c11e0110a61a89da4ce668444ae8ce7c34bac704ebbb52"} Jul 16 07:36:10.681584 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.681181 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" event={"ID":"83e05908-1179-4a74-ac95-b71ac1a2cc40","Type":"ContainerStarted","Data":"529e36aa014ebe1ebc492b83cab012f31164e8e686e0187e01de095e010b2cef"} Jul 16 07:36:10.684163 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.683974 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" event={"ID":"88fadfb5-fe4f-4148-a24f-93ae6ebc7161","Type":"ContainerStarted","Data":"5562f084c8834f1690e97f62cb0a8d9e3671251af7715bde350377e6101635aa"} Jul 16 07:36:10.724839 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.724747 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" podStartSLOduration=13.297210644 podStartE2EDuration="15.724724193s" totalImagesPullingTime="2.427513549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:10.72349555 +0000 UTC m=+83.806921168" watchObservedRunningTime="2026-07-16 07:36:10.724724193 +0000 UTC m=+83.808149811" Jul 16 07:36:10.725353 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:10.725017 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" podStartSLOduration=2.6464591889999998 podStartE2EDuration="17.725005262s" totalImagesPullingTime="15.078546073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:10.705311639 +0000 UTC m=+83.788737257" watchObservedRunningTime="2026-07-16 07:36:10.725005262 +0000 UTC m=+83.808430880" Jul 16 07:36:12.000359 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:11.999652 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc98cffd7-hrtzj"] Jul 16 07:36:12.702607 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:12.702563 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e"} Jul 16 07:36:14.720796 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.720680 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"2cc4866019d78b4dc2eb679a9af9c9e80098bfbcefa0499d768f1de9b1401116"} Jul 16 07:36:14.720796 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.720786 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"4a7cae8e1f41cf313a17de492b1d72a477197fd401fd4ce50e613208d474e9ea"} Jul 16 07:36:14.721253 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.720832 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"40980bae99f395d7a9b0075c28523db515bcbac8466b98f4dcfe7e20ccb5cddd"} Jul 16 07:36:14.721253 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.720873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"f5865041755fe60a0fa5de0b833642c809309efcbb1473e9d50dacca20f985a7"} Jul 16 07:36:14.726271 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.725333 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6"} Jul 16 07:36:14.726271 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.725409 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673"} Jul 16 07:36:14.726271 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.725443 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9"} Jul 16 07:36:14.726271 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.725482 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd"} Jul 16 07:36:14.726271 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.725516 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerStarted","Data":"e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4"} Jul 16 07:36:14.753407 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:14.753351 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.07855799 podStartE2EDuration="22.753328544s" totalImagesPullingTime="17.646385642s" totalInitContainerRuntime="28.384912ms" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:14.75071019 +0000 UTC m=+87.834135835" watchObservedRunningTime="2026-07-16 07:36:14.753328544 +0000 UTC m=+87.836754163" Jul 16 07:36:15.734383 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:15.734343 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"b9e31c742a6703475128b72f26a8cfbcc71134c411659717af67162684e2b6b4"} Jul 16 07:36:15.734860 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:15.734442 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerStarted","Data":"9eed42020c25030cf476b91b3cf2f957b47b589270800caf2c851875854879c9"} Jul 16 07:36:15.763110 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:15.763041 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=13.287326547 podStartE2EDuration="18.763018117s" totalImagesPullingTime="5.449573989s" totalInitContainerRuntime="26.117581ms" isStatefulPod=false podCreationTimestamp="2026-07-16 07:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:36:15.761863301 +0000 UTC m=+88.845288917" watchObservedRunningTime="2026-07-16 07:36:15.763018117 +0000 UTC m=+88.846443737" Jul 16 07:36:15.768442 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:15.768415 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:36:15.768614 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:15.768474 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:36:16.482705 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:16.482672 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95nzz_b2b44b36-f1ef-46a5-8e01-3fbe945e9436/serve-healthcheck-canary/0.log" Jul 16 07:36:16.696225 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:16.696188 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-67c95ff9d8-2zl7h" Jul 16 07:36:17.738180 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:17.738140 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:36:26.491048 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.490969 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5686f56664-w8r75" podUID="684d249a-1894-4247-9aa2-ecf87d248cd2" containerName="console" containerID="cri-o://79579027e42879cb97328e94dfb7b561c9f078e7c9369281014acfa4f41ab50a" gracePeriod=15 Jul 16 07:36:26.782873 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.782841 2570 generic.go:356] "Generic (PLEG): container finished" podID="684d249a-1894-4247-9aa2-ecf87d248cd2" containerID="79579027e42879cb97328e94dfb7b561c9f078e7c9369281014acfa4f41ab50a" exitCode=0 Jul 16 07:36:26.783019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.782916 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5686f56664-w8r75" event={"ID":"684d249a-1894-4247-9aa2-ecf87d248cd2","Type":"ContainerDied","Data":"79579027e42879cb97328e94dfb7b561c9f078e7c9369281014acfa4f41ab50a"} Jul 16 07:36:26.783019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.783001 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5686f56664-w8r75" event={"ID":"684d249a-1894-4247-9aa2-ecf87d248cd2","Type":"ContainerDied","Data":"fcd53443da9e31f752e75043b6abf661203f90d0bc0d326b542f0e75565e1e74"} Jul 16 07:36:26.783019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.783016 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcd53443da9e31f752e75043b6abf661203f90d0bc0d326b542f0e75565e1e74" Jul 16 07:36:26.790450 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.790424 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:36:26.830979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.830948 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn6c9\" (UniqueName: \"kubernetes.io/projected/684d249a-1894-4247-9aa2-ecf87d248cd2-kube-api-access-hn6c9\") pod \"684d249a-1894-4247-9aa2-ecf87d248cd2\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " Jul 16 07:36:26.831133 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831022 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-oauth-serving-cert\") pod \"684d249a-1894-4247-9aa2-ecf87d248cd2\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " Jul 16 07:36:26.831133 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831069 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-console-config\") pod \"684d249a-1894-4247-9aa2-ecf87d248cd2\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " Jul 16 07:36:26.831133 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831121 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-service-ca\") pod \"684d249a-1894-4247-9aa2-ecf87d248cd2\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " Jul 16 07:36:26.831279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831153 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-oauth-config\") pod \"684d249a-1894-4247-9aa2-ecf87d248cd2\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " Jul 16 07:36:26.831279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831181 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-serving-cert\") pod \"684d249a-1894-4247-9aa2-ecf87d248cd2\" (UID: \"684d249a-1894-4247-9aa2-ecf87d248cd2\") " Jul 16 07:36:26.831435 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831403 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "684d249a-1894-4247-9aa2-ecf87d248cd2" (UID: "684d249a-1894-4247-9aa2-ecf87d248cd2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:26.831522 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831506 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-oauth-serving-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:26.831597 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831538 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-service-ca" (OuterVolumeSpecName: "service-ca") pod "684d249a-1894-4247-9aa2-ecf87d248cd2" (UID: "684d249a-1894-4247-9aa2-ecf87d248cd2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:26.831597 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.831550 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-console-config" (OuterVolumeSpecName: "console-config") pod "684d249a-1894-4247-9aa2-ecf87d248cd2" (UID: "684d249a-1894-4247-9aa2-ecf87d248cd2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:26.833629 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.833583 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "684d249a-1894-4247-9aa2-ecf87d248cd2" (UID: "684d249a-1894-4247-9aa2-ecf87d248cd2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:36:26.833745 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.833700 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/684d249a-1894-4247-9aa2-ecf87d248cd2-kube-api-access-hn6c9" (OuterVolumeSpecName: "kube-api-access-hn6c9") pod "684d249a-1894-4247-9aa2-ecf87d248cd2" (UID: "684d249a-1894-4247-9aa2-ecf87d248cd2"). InnerVolumeSpecName "kube-api-access-hn6c9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:36:26.833745 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.833707 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "684d249a-1894-4247-9aa2-ecf87d248cd2" (UID: "684d249a-1894-4247-9aa2-ecf87d248cd2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:36:26.932735 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.932701 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-console-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:26.932735 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.932731 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/684d249a-1894-4247-9aa2-ecf87d248cd2-service-ca\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:26.932735 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.932739 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-oauth-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:26.932974 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.932748 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/684d249a-1894-4247-9aa2-ecf87d248cd2-console-serving-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:26.932974 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:26.932757 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn6c9\" (UniqueName: \"kubernetes.io/projected/684d249a-1894-4247-9aa2-ecf87d248cd2-kube-api-access-hn6c9\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:27.787256 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:27.787227 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5686f56664-w8r75" Jul 16 07:36:27.809130 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:27.809097 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5686f56664-w8r75"] Jul 16 07:36:27.810688 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:27.810666 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5686f56664-w8r75"] Jul 16 07:36:28.082779 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:28.080225 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="684d249a-1894-4247-9aa2-ecf87d248cd2" path="/var/lib/kubelet/pods/684d249a-1894-4247-9aa2-ecf87d248cd2/volumes" Jul 16 07:36:35.773454 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:35.773419 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:36:35.777259 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:35.777236 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-df69cb447-l5wl7" Jul 16 07:36:37.031137 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.031092 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dc98cffd7-hrtzj" podUID="f8b293c3-568d-4a70-8cf2-069fc8d7843e" containerName="console" containerID="cri-o://9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1" gracePeriod=15 Jul 16 07:36:37.329030 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.328996 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:36:37.423677 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423646 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-config\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.423844 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423709 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-trusted-ca-bundle\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.423844 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423811 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-service-ca\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.423963 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423906 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smjb7\" (UniqueName: \"kubernetes.io/projected/f8b293c3-568d-4a70-8cf2-069fc8d7843e-kube-api-access-smjb7\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.423963 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423927 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-oauth-serving-cert\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.424064 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423973 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-oauth-config\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.424064 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.423993 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-serving-cert\") pod \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\" (UID: \"f8b293c3-568d-4a70-8cf2-069fc8d7843e\") " Jul 16 07:36:37.424064 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424052 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:37.424251 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424075 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-config" (OuterVolumeSpecName: "console-config") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:37.424251 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424210 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:37.424367 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424323 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:36:37.424414 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424361 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.424414 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424390 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-trusted-ca-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.424414 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.424407 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-service-ca\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.426138 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.426107 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:36:37.426250 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.426189 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b293c3-568d-4a70-8cf2-069fc8d7843e-kube-api-access-smjb7" (OuterVolumeSpecName: "kube-api-access-smjb7") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "kube-api-access-smjb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:36:37.426250 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.426199 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f8b293c3-568d-4a70-8cf2-069fc8d7843e" (UID: "f8b293c3-568d-4a70-8cf2-069fc8d7843e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:36:37.524893 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.524864 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smjb7\" (UniqueName: \"kubernetes.io/projected/f8b293c3-568d-4a70-8cf2-069fc8d7843e-kube-api-access-smjb7\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.524893 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.524888 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8b293c3-568d-4a70-8cf2-069fc8d7843e-oauth-serving-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.524893 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.524898 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-oauth-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.525111 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.524907 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b293c3-568d-4a70-8cf2-069fc8d7843e-console-serving-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:36:37.835577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.835521 2570 generic.go:356] "Generic (PLEG): container finished" podID="f8b293c3-568d-4a70-8cf2-069fc8d7843e" containerID="9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1" exitCode=0 Jul 16 07:36:37.835782 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.835601 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc98cffd7-hrtzj" Jul 16 07:36:37.835782 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.835619 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc98cffd7-hrtzj" event={"ID":"f8b293c3-568d-4a70-8cf2-069fc8d7843e","Type":"ContainerDied","Data":"9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1"} Jul 16 07:36:37.835782 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.835678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc98cffd7-hrtzj" event={"ID":"f8b293c3-568d-4a70-8cf2-069fc8d7843e","Type":"ContainerDied","Data":"afe04a72aa57b44a6f28c4e37f5a8992f73cef1c7c77ff036ed493437c5ebaa4"} Jul 16 07:36:37.835782 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.835703 2570 scope.go:117] "RemoveContainer" containerID="9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1" Jul 16 07:36:37.844465 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.844449 2570 scope.go:117] "RemoveContainer" containerID="9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1" Jul 16 07:36:37.844794 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:36:37.844773 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1\": container with ID starting with 9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1 not found: ID does not exist" containerID="9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1" Jul 16 07:36:37.844848 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.844803 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1"} err="failed to get container status \"9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1\": rpc error: code = NotFound desc = could not find container \"9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1\": container with ID starting with 9429465b87d1014387adc4ae3ca4d83dbe3fc034ec32b8d92a7744974a2201b1 not found: ID does not exist" Jul 16 07:36:37.855284 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.855253 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc98cffd7-hrtzj"] Jul 16 07:36:37.859163 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:37.859136 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc98cffd7-hrtzj"] Jul 16 07:36:38.079626 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:38.079587 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b293c3-568d-4a70-8cf2-069fc8d7843e" path="/var/lib/kubelet/pods/f8b293c3-568d-4a70-8cf2-069fc8d7843e/volumes" Jul 16 07:36:39.672492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:39.672462 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ghxkm" Jul 16 07:36:57.738016 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:57.737982 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:36:57.800603 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:57.800575 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:36:57.929055 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:36:57.929026 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:11.480375 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480341 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:37:11.480902 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480622 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="alertmanager" containerID="cri-o://34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e" gracePeriod=120 Jul 16 07:37:11.480902 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480695 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-metric" containerID="cri-o://23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673" gracePeriod=120 Jul 16 07:37:11.480902 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480723 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="prom-label-proxy" containerID="cri-o://29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6" gracePeriod=120 Jul 16 07:37:11.480902 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480749 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-web" containerID="cri-o://8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd" gracePeriod=120 Jul 16 07:37:11.480902 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480804 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy" containerID="cri-o://c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9" gracePeriod=120 Jul 16 07:37:11.481184 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.480892 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="config-reloader" containerID="cri-o://e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4" gracePeriod=120 Jul 16 07:37:11.969249 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969215 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6" exitCode=0 Jul 16 07:37:11.969249 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969240 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673" exitCode=0 Jul 16 07:37:11.969249 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969246 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9" exitCode=0 Jul 16 07:37:11.969249 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969252 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4" exitCode=0 Jul 16 07:37:11.969249 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969257 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e" exitCode=0 Jul 16 07:37:11.969509 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969284 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6"} Jul 16 07:37:11.969509 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969371 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673"} Jul 16 07:37:11.969509 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969397 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9"} Jul 16 07:37:11.969509 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4"} Jul 16 07:37:11.969509 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:11.969446 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e"} Jul 16 07:37:12.725279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.725255 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:12.828979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.828903 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.828979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.828939 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.828979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.828959 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-web-config\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.828979 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.828979 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-tls-assets\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829003 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-config-out\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829031 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp7ml\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-kube-api-access-lp7ml\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829056 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-metrics-client-ca\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829108 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-cluster-tls-config\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829164 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-config-volume\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829191 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-web\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829217 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829241 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-main-db\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.829291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.829281 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy\") pod \"a7019146-bf06-43dc-a777-89c6ed61973c\" (UID: \"a7019146-bf06-43dc-a777-89c6ed61973c\") " Jul 16 07:37:12.831712 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.831630 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 07:37:12.831712 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.831637 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:12.832051 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.831940 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:12.832550 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832502 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.832550 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832510 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-config-out" (OuterVolumeSpecName: "config-out") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 07:37:12.832692 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832601 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:37:12.832747 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832725 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.832855 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832834 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-config-volume" (OuterVolumeSpecName: "config-volume") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.832968 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832944 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-kube-api-access-lp7ml" (OuterVolumeSpecName: "kube-api-access-lp7ml") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "kube-api-access-lp7ml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:37:12.833035 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.832956 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.833947 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.833923 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.836796 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.836730 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.843168 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.843139 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-web-config" (OuterVolumeSpecName: "web-config") pod "a7019146-bf06-43dc-a777-89c6ed61973c" (UID: "a7019146-bf06-43dc-a777-89c6ed61973c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:12.930536 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930503 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930541 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930556 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-web-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930566 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-tls-assets\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930575 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-config-out\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930582 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp7ml\" (UniqueName: \"kubernetes.io/projected/a7019146-bf06-43dc-a777-89c6ed61973c-kube-api-access-lp7ml\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930590 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-metrics-client-ca\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930599 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-cluster-tls-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930608 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-config-volume\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930618 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930626 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930939 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930635 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7019146-bf06-43dc-a777-89c6ed61973c-alertmanager-main-db\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.930939 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.930643 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7019146-bf06-43dc-a777-89c6ed61973c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:12.976253 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.976230 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7019146-bf06-43dc-a777-89c6ed61973c" containerID="8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd" exitCode=0 Jul 16 07:37:12.976364 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.976311 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd"} Jul 16 07:37:12.976364 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.976323 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:12.976470 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.976381 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7019146-bf06-43dc-a777-89c6ed61973c","Type":"ContainerDied","Data":"ab14c628110edcf69815821473e06ff3ddeaa8a5be055ac3f3a9db99ac8c5825"} Jul 16 07:37:12.976470 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.976416 2570 scope.go:117] "RemoveContainer" containerID="29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6" Jul 16 07:37:12.984246 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.984224 2570 scope.go:117] "RemoveContainer" containerID="23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673" Jul 16 07:37:12.990841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.990827 2570 scope.go:117] "RemoveContainer" containerID="c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9" Jul 16 07:37:12.997047 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.997020 2570 scope.go:117] "RemoveContainer" containerID="8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd" Jul 16 07:37:12.999465 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:12.999442 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:37:13.003554 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.003475 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:37:13.006112 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.006081 2570 scope.go:117] "RemoveContainer" containerID="e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4" Jul 16 07:37:13.012866 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.012850 2570 scope.go:117] "RemoveContainer" containerID="34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e" Jul 16 07:37:13.019493 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.019464 2570 scope.go:117] "RemoveContainer" containerID="37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925" Jul 16 07:37:13.025903 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.025886 2570 scope.go:117] "RemoveContainer" containerID="29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6" Jul 16 07:37:13.026127 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.026110 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6\": container with ID starting with 29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6 not found: ID does not exist" containerID="29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6" Jul 16 07:37:13.026186 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026134 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6"} err="failed to get container status \"29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6\": rpc error: code = NotFound desc = could not find container \"29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6\": container with ID starting with 29145cf294e59737092755449aa0dee99c14fd7f6e7569f2c350d262242058c6 not found: ID does not exist" Jul 16 07:37:13.026186 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026154 2570 scope.go:117] "RemoveContainer" containerID="23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673" Jul 16 07:37:13.026351 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.026334 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673\": container with ID starting with 23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673 not found: ID does not exist" containerID="23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673" Jul 16 07:37:13.026427 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026360 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673"} err="failed to get container status \"23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673\": rpc error: code = NotFound desc = could not find container \"23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673\": container with ID starting with 23d5e9b4e34f956932aac21cb1d941b6891c3ba269a7e88b2f84d043d1e08673 not found: ID does not exist" Jul 16 07:37:13.026427 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026381 2570 scope.go:117] "RemoveContainer" containerID="c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9" Jul 16 07:37:13.026623 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.026607 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9\": container with ID starting with c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9 not found: ID does not exist" containerID="c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9" Jul 16 07:37:13.026681 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026627 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9"} err="failed to get container status \"c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9\": rpc error: code = NotFound desc = could not find container \"c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9\": container with ID starting with c730231bb255593c88ffb0bfc33dfb2bcb16346d52b22855ce4fec928e6d83e9 not found: ID does not exist" Jul 16 07:37:13.026681 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026640 2570 scope.go:117] "RemoveContainer" containerID="8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd" Jul 16 07:37:13.026830 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.026813 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd\": container with ID starting with 8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd not found: ID does not exist" containerID="8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd" Jul 16 07:37:13.026891 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026837 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd"} err="failed to get container status \"8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd\": rpc error: code = NotFound desc = could not find container \"8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd\": container with ID starting with 8c814724d06613ff3260d403ec6bc6abef9a68855da3beebf0ce2907527941cd not found: ID does not exist" Jul 16 07:37:13.026891 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.026855 2570 scope.go:117] "RemoveContainer" containerID="e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4" Jul 16 07:37:13.027066 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.027050 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4\": container with ID starting with e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4 not found: ID does not exist" containerID="e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4" Jul 16 07:37:13.027101 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.027069 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4"} err="failed to get container status \"e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4\": rpc error: code = NotFound desc = could not find container \"e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4\": container with ID starting with e120eb23b0d4fb1348a1f212b60c896b9ab778f4fb700b8c2c8aa93ba450bca4 not found: ID does not exist" Jul 16 07:37:13.027101 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.027080 2570 scope.go:117] "RemoveContainer" containerID="34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e" Jul 16 07:37:13.027346 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.027315 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e\": container with ID starting with 34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e not found: ID does not exist" containerID="34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e" Jul 16 07:37:13.028355 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.027352 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e"} err="failed to get container status \"34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e\": rpc error: code = NotFound desc = could not find container \"34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e\": container with ID starting with 34185fae149ae415b129b8d0c1f7bf5a20e1c30ab658c79f7bc76f704d3c827e not found: ID does not exist" Jul 16 07:37:13.028355 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.027371 2570 scope.go:117] "RemoveContainer" containerID="37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925" Jul 16 07:37:13.028355 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:37:13.027656 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925\": container with ID starting with 37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925 not found: ID does not exist" containerID="37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925" Jul 16 07:37:13.028355 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.027703 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925"} err="failed to get container status \"37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925\": rpc error: code = NotFound desc = could not find container \"37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925\": container with ID starting with 37383afdf383ccdd371a694cefd1db18912e941e17da37783814b8bb81800925 not found: ID does not exist" Jul 16 07:37:13.029297 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029280 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:37:13.029577 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029565 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029578 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029589 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="prom-label-proxy" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029595 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="prom-label-proxy" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029602 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="init-config-reloader" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029608 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="init-config-reloader" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029614 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="alertmanager" Jul 16 07:37:13.029618 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029619 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="alertmanager" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029628 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="config-reloader" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029633 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="config-reloader" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029657 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-web" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029663 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-web" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029671 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-metric" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029676 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-metric" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029685 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b293c3-568d-4a70-8cf2-069fc8d7843e" containerName="console" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029690 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b293c3-568d-4a70-8cf2-069fc8d7843e" containerName="console" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029697 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684d249a-1894-4247-9aa2-ecf87d248cd2" containerName="console" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029701 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="684d249a-1894-4247-9aa2-ecf87d248cd2" containerName="console" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029741 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="684d249a-1894-4247-9aa2-ecf87d248cd2" containerName="console" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029749 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="config-reloader" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029754 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-web" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029759 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029765 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b293c3-568d-4a70-8cf2-069fc8d7843e" containerName="console" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029769 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="kube-rbac-proxy-metric" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029775 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="prom-label-proxy" Jul 16 07:37:13.029841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.029780 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" containerName="alertmanager" Jul 16 07:37:13.034060 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.034044 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.037761 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.036484 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 07:37:13.037761 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.037052 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 07:37:13.037761 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.037230 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 07:37:13.037761 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.037439 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 07:37:13.037761 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.037740 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 07:37:13.038092 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.037973 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 07:37:13.038092 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.038031 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 07:37:13.038197 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.038119 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 07:37:13.038197 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.038018 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vcvjh\"" Jul 16 07:37:13.043346 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.043324 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 07:37:13.047184 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.047163 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:37:13.132227 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132227 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b3de360-3794-4bea-a25e-044a3296c33f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132227 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132212 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b3de360-3794-4bea-a25e-044a3296c33f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132401 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b3de360-3794-4bea-a25e-044a3296c33f-config-out\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132401 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132313 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b3de360-3794-4bea-a25e-044a3296c33f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132401 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132350 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3de360-3794-4bea-a25e-044a3296c33f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpmx\" (UniqueName: \"kubernetes.io/projected/3b3de360-3794-4bea-a25e-044a3296c33f-kube-api-access-8fpmx\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132439 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132479 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-web-config\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132640 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132495 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132640 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132514 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.132640 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.132578 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233120 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233092 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b3de360-3794-4bea-a25e-044a3296c33f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233215 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233215 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3de360-3794-4bea-a25e-044a3296c33f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpmx\" (UniqueName: \"kubernetes.io/projected/3b3de360-3794-4bea-a25e-044a3296c33f-kube-api-access-8fpmx\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233311 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233283 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233344 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233323 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-web-config\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233381 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233350 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233381 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233375 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233470 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233470 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233612 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233480 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b3de360-3794-4bea-a25e-044a3296c33f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233612 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b3de360-3794-4bea-a25e-044a3296c33f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.233612 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.233567 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b3de360-3794-4bea-a25e-044a3296c33f-config-out\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.234273 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.234122 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b3de360-3794-4bea-a25e-044a3296c33f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.234273 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.234213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b3de360-3794-4bea-a25e-044a3296c33f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.234815 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.234604 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3b3de360-3794-4bea-a25e-044a3296c33f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236155 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-web-config\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236224 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3b3de360-3794-4bea-a25e-044a3296c33f-config-out\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236278 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3b3de360-3794-4bea-a25e-044a3296c33f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236472 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236346 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236472 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236409 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-config-volume\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236891 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236870 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.236953 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.236935 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.237628 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.237608 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.237777 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.237759 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3b3de360-3794-4bea-a25e-044a3296c33f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.241894 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.241874 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpmx\" (UniqueName: \"kubernetes.io/projected/3b3de360-3794-4bea-a25e-044a3296c33f-kube-api-access-8fpmx\") pod \"alertmanager-main-0\" (UID: \"3b3de360-3794-4bea-a25e-044a3296c33f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.344812 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.344791 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 07:37:13.479180 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.479143 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 07:37:13.482563 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:37:13.482519 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3de360_3794_4bea_a25e_044a3296c33f.slice/crio-e54c44840f2b60eb7d9155fc6c146fd422b2e3d247797a9279e7b71e7b932172 WatchSource:0}: Error finding container e54c44840f2b60eb7d9155fc6c146fd422b2e3d247797a9279e7b71e7b932172: Status 404 returned error can't find the container with id e54c44840f2b60eb7d9155fc6c146fd422b2e3d247797a9279e7b71e7b932172 Jul 16 07:37:13.986841 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.986806 2570 generic.go:356] "Generic (PLEG): container finished" podID="3b3de360-3794-4bea-a25e-044a3296c33f" containerID="104a632ac4f64e322364363f4a0cc23a2c85d97535844a6ee12bad1d7faf3918" exitCode=0 Jul 16 07:37:13.987290 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.986845 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerDied","Data":"104a632ac4f64e322364363f4a0cc23a2c85d97535844a6ee12bad1d7faf3918"} Jul 16 07:37:13.987290 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:13.986943 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"e54c44840f2b60eb7d9155fc6c146fd422b2e3d247797a9279e7b71e7b932172"} Jul 16 07:37:14.078345 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.078319 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7019146-bf06-43dc-a777-89c6ed61973c" path="/var/lib/kubelet/pods/a7019146-bf06-43dc-a777-89c6ed61973c/volumes" Jul 16 07:37:14.995148 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.995116 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"cc65fa697cbb4aa2a6926622b0390223d3ce053e9fe83265c12ce56bbcec59a7"} Jul 16 07:37:14.995483 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.995178 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"9b4ed3f650c730781450bbbea7780e7ad025ddb902348d859c44190a07183992"} Jul 16 07:37:14.995483 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.995204 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"bdabad70c83e5f71a673b40b9e222b449193db34e439ed2c4ea55f290f5a638f"} Jul 16 07:37:14.995483 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.995228 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"073e297109b53d619078e47a36c44a62a5313d92eaadbfbbbe87a5ad9890e12f"} Jul 16 07:37:14.995483 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.995251 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"991bec11c3860cc65c55ff32d958dfdb9a6164af844a97ed707b94ba614b8429"} Jul 16 07:37:14.995483 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:14.995273 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3b3de360-3794-4bea-a25e-044a3296c33f","Type":"ContainerStarted","Data":"8c9625c3503b34476db8aca8bedd60f3c5e71952d666d619a9b89d1b8dc32605"} Jul 16 07:37:15.021762 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.021716 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.005994618 podStartE2EDuration="2.021699281s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.704663ms" isStatefulPod=false podCreationTimestamp="2026-07-16 07:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:37:15.020433786 +0000 UTC m=+148.103859429" watchObservedRunningTime="2026-07-16 07:37:15.021699281 +0000 UTC m=+148.105124898" Jul 16 07:37:15.479956 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.479925 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b79746f85-8f6g6"] Jul 16 07:37:15.482692 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.482673 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.484846 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.484824 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 07:37:15.485297 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.485086 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 07:37:15.485297 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.485164 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 07:37:15.485297 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.485172 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 07:37:15.485297 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.485178 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gkr2t\"" Jul 16 07:37:15.485297 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.485181 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 07:37:15.489762 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.489743 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 07:37:15.495942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.495920 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b79746f85-8f6g6"] Jul 16 07:37:15.553365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-telemeter-client-tls\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553365 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-secret-telemeter-client\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553377 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553425 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553466 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-serving-certs-ca-bundle\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553582 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553566 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-metrics-client-ca\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553797 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553588 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-federate-client-tls\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.553797 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.553603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksgf9\" (UniqueName: \"kubernetes.io/projected/6814d48a-ea3c-422d-8eb1-cf35d777d678-kube-api-access-ksgf9\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654287 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654257 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-telemeter-client-tls\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654430 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654293 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-secret-telemeter-client\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654430 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654313 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654430 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654339 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654430 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-serving-certs-ca-bundle\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654648 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-metrics-client-ca\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654648 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-federate-client-tls\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.654648 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.654517 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksgf9\" (UniqueName: \"kubernetes.io/projected/6814d48a-ea3c-422d-8eb1-cf35d777d678-kube-api-access-ksgf9\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.655267 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.655215 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-serving-certs-ca-bundle\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.655495 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.655471 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.655605 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.655482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6814d48a-ea3c-422d-8eb1-cf35d777d678-metrics-client-ca\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.657006 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.656982 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-telemeter-client-tls\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.657006 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.656998 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.657233 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.657218 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-secret-telemeter-client\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.657270 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.657239 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6814d48a-ea3c-422d-8eb1-cf35d777d678-federate-client-tls\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.662481 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.662460 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksgf9\" (UniqueName: \"kubernetes.io/projected/6814d48a-ea3c-422d-8eb1-cf35d777d678-kube-api-access-ksgf9\") pod \"telemeter-client-5b79746f85-8f6g6\" (UID: \"6814d48a-ea3c-422d-8eb1-cf35d777d678\") " pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.779931 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.779476 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:37:15.779931 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.779833 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="prometheus" containerID="cri-o://f5865041755fe60a0fa5de0b833642c809309efcbb1473e9d50dacca20f985a7" gracePeriod=600 Jul 16 07:37:15.779931 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.779897 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b9e31c742a6703475128b72f26a8cfbcc71134c411659717af67162684e2b6b4" gracePeriod=600 Jul 16 07:37:15.780191 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.780009 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy" containerID="cri-o://9eed42020c25030cf476b91b3cf2f957b47b589270800caf2c851875854879c9" gracePeriod=600 Jul 16 07:37:15.780191 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.780093 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-web" containerID="cri-o://2cc4866019d78b4dc2eb679a9af9c9e80098bfbcefa0499d768f1de9b1401116" gracePeriod=600 Jul 16 07:37:15.780191 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.780167 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="thanos-sidecar" containerID="cri-o://4a7cae8e1f41cf313a17de492b1d72a477197fd401fd4ce50e613208d474e9ea" gracePeriod=600 Jul 16 07:37:15.780324 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.780238 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="config-reloader" containerID="cri-o://40980bae99f395d7a9b0075c28523db515bcbac8466b98f4dcfe7e20ccb5cddd" gracePeriod=600 Jul 16 07:37:15.795966 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.795756 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" Jul 16 07:37:15.958125 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:15.958091 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b79746f85-8f6g6"] Jul 16 07:37:16.002170 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.002125 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" event={"ID":"6814d48a-ea3c-422d-8eb1-cf35d777d678","Type":"ContainerStarted","Data":"05fc92f7778b80654be08cfe0f189a400c0ca33356e6407df7828ac53dd8720e"} Jul 16 07:37:16.006850 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006212 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="b9e31c742a6703475128b72f26a8cfbcc71134c411659717af67162684e2b6b4" exitCode=0 Jul 16 07:37:16.006850 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006240 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="9eed42020c25030cf476b91b3cf2f957b47b589270800caf2c851875854879c9" exitCode=0 Jul 16 07:37:16.006850 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006250 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="2cc4866019d78b4dc2eb679a9af9c9e80098bfbcefa0499d768f1de9b1401116" exitCode=0 Jul 16 07:37:16.006850 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006258 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="4a7cae8e1f41cf313a17de492b1d72a477197fd401fd4ce50e613208d474e9ea" exitCode=0 Jul 16 07:37:16.006850 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006266 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="40980bae99f395d7a9b0075c28523db515bcbac8466b98f4dcfe7e20ccb5cddd" exitCode=0 Jul 16 07:37:16.006850 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006275 2570 generic.go:356] "Generic (PLEG): container finished" podID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerID="f5865041755fe60a0fa5de0b833642c809309efcbb1473e9d50dacca20f985a7" exitCode=0 Jul 16 07:37:16.007140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006875 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"b9e31c742a6703475128b72f26a8cfbcc71134c411659717af67162684e2b6b4"} Jul 16 07:37:16.007140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006956 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"9eed42020c25030cf476b91b3cf2f957b47b589270800caf2c851875854879c9"} Jul 16 07:37:16.007140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.006998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"2cc4866019d78b4dc2eb679a9af9c9e80098bfbcefa0499d768f1de9b1401116"} Jul 16 07:37:16.007140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.007037 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"4a7cae8e1f41cf313a17de492b1d72a477197fd401fd4ce50e613208d474e9ea"} Jul 16 07:37:16.007140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.007078 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"40980bae99f395d7a9b0075c28523db515bcbac8466b98f4dcfe7e20ccb5cddd"} Jul 16 07:37:16.007140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.007119 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"f5865041755fe60a0fa5de0b833642c809309efcbb1473e9d50dacca20f985a7"} Jul 16 07:37:16.057833 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.057385 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:16.158492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158460 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-0\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158492 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158495 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-metrics-client-ca\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158517 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-metrics-client-certs\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158572 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158607 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158632 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-grpc-tls\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158668 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158693 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-trusted-ca-bundle\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.158743 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158729 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-kube-rbac-proxy\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158772 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-kubelet-serving-ca-bundle\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158801 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-tls\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158826 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccx8\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-kube-api-access-mccx8\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158871 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158889 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-web-config\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158914 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-tls-assets\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158950 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config-out\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.158976 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-2\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159004 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-thanos-prometheus-http-client-file\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159033 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-serving-certs-ca-bundle\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159094 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159075 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-db\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159620 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159110 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-1\") pod \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\" (UID: \"dd0c87ea-2126-42bd-af07-dd7afc8d0b87\") " Jul 16 07:37:16.159620 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159375 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-metrics-client-ca\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.159775 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159747 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.159960 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.159927 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.160392 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.160287 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.160476 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.160430 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.160559 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.160477 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.161059 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.161036 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 07:37:16.161518 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.161491 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 07:37:16.163395 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.163357 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:37:16.163599 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.163565 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.163768 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.163742 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.163874 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.163840 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config-out" (OuterVolumeSpecName: "config-out") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 07:37:16.163874 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.163844 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config" (OuterVolumeSpecName: "config") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.163994 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.163952 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.164037 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.164009 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.164120 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.164091 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.164176 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.164156 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-kube-api-access-mccx8" (OuterVolumeSpecName: "kube-api-access-mccx8") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "kube-api-access-mccx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:37:16.164231 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.164185 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.164276 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.164249 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.174721 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.174699 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-web-config" (OuterVolumeSpecName: "web-config") pod "dd0c87ea-2126-42bd-af07-dd7afc8d0b87" (UID: "dd0c87ea-2126-42bd-af07-dd7afc8d0b87"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 07:37:16.260069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260042 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260067 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-grpc-tls\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260076 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260085 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260094 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-kube-rbac-proxy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260102 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260112 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260121 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccx8\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-kube-api-access-mccx8\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260129 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-web-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260137 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-tls-assets\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260144 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config-out\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260151 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260159 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260168 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260176 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-db\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260184 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260193 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260204 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-secret-metrics-client-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:16.260651 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:16.260212 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dd0c87ea-2126-42bd-af07-dd7afc8d0b87-config\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:37:17.013514 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.013446 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.014053 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.013447 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dd0c87ea-2126-42bd-af07-dd7afc8d0b87","Type":"ContainerDied","Data":"68b205c25676260610363c9d0010924659457ebc5115e9dcd00e02467d511d56"} Jul 16 07:37:17.014053 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.013598 2570 scope.go:117] "RemoveContainer" containerID="b9e31c742a6703475128b72f26a8cfbcc71134c411659717af67162684e2b6b4" Jul 16 07:37:17.022137 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.022116 2570 scope.go:117] "RemoveContainer" containerID="9eed42020c25030cf476b91b3cf2f957b47b589270800caf2c851875854879c9" Jul 16 07:37:17.030947 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.030926 2570 scope.go:117] "RemoveContainer" containerID="2cc4866019d78b4dc2eb679a9af9c9e80098bfbcefa0499d768f1de9b1401116" Jul 16 07:37:17.036862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.036839 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:37:17.038796 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.038771 2570 scope.go:117] "RemoveContainer" containerID="4a7cae8e1f41cf313a17de492b1d72a477197fd401fd4ce50e613208d474e9ea" Jul 16 07:37:17.041914 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.041889 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:37:17.046854 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.046837 2570 scope.go:117] "RemoveContainer" containerID="40980bae99f395d7a9b0075c28523db515bcbac8466b98f4dcfe7e20ccb5cddd" Jul 16 07:37:17.054400 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.054382 2570 scope.go:117] "RemoveContainer" containerID="f5865041755fe60a0fa5de0b833642c809309efcbb1473e9d50dacca20f985a7" Jul 16 07:37:17.061666 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.061650 2570 scope.go:117] "RemoveContainer" containerID="46f5cc416eee99a263af088b60090e15e341e908a1ae5bbddf27c5817d93410a" Jul 16 07:37:17.068488 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.068466 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:37:17.068950 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.068933 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="prometheus" Jul 16 07:37:17.068992 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.068956 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="prometheus" Jul 16 07:37:17.068992 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.068971 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-thanos" Jul 16 07:37:17.068992 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.068980 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-thanos" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069004 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="config-reloader" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069013 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="config-reloader" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069023 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069032 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069044 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="thanos-sidecar" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069052 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="thanos-sidecar" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069066 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="init-config-reloader" Jul 16 07:37:17.069078 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069075 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="init-config-reloader" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069087 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-web" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069095 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-web" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069204 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-web" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069214 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="config-reloader" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069220 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="thanos-sidecar" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069227 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069233 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="prometheus" Jul 16 07:37:17.069320 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.069243 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" containerName="kube-rbac-proxy-thanos" Jul 16 07:37:17.072722 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.072705 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.075387 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075312 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 16 07:37:17.075499 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075443 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 16 07:37:17.075619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075594 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 16 07:37:17.075703 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075633 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 16 07:37:17.075755 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075715 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 16 07:37:17.075817 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075794 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 16 07:37:17.075942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.075923 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rmkcr\"" Jul 16 07:37:17.076121 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076106 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 16 07:37:17.076198 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076181 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cm6c2kq61g21h\"" Jul 16 07:37:17.076262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076192 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 16 07:37:17.076262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076211 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 16 07:37:17.076262 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076236 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 16 07:37:17.076610 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076594 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 16 07:37:17.076753 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.076737 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 16 07:37:17.078676 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.078659 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 16 07:37:17.081708 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.081690 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 16 07:37:17.086358 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.086340 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:37:17.166903 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.166879 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.166908 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.166935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.166976 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167019 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3938d56b-78a7-4611-87fa-df11b417e076-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167048 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167140 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3938d56b-78a7-4611-87fa-df11b417e076-config-out\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167167 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167272 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167236 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167287 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-web-config\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167338 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9gcd\" (UniqueName: \"kubernetes.io/projected/3938d56b-78a7-4611-87fa-df11b417e076-kube-api-access-w9gcd\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167381 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167416 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167458 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167486 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.167572 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.168007 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.167589 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-config\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268259 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268291 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268283 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-web-config\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268308 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9gcd\" (UniqueName: \"kubernetes.io/projected/3938d56b-78a7-4611-87fa-df11b417e076-kube-api-access-w9gcd\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268429 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268467 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268493 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-config\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268551 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268669 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268710 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3938d56b-78a7-4611-87fa-df11b417e076-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268780 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268805 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268832 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3938d56b-78a7-4611-87fa-df11b417e076-config-out\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.268955 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.268860 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.269384 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.269250 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.269384 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.269315 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.269595 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.269467 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.269656 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.269629 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.270543 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.270208 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.272394 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.271552 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.272394 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.271735 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.272394 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.271956 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-config\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.272394 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.272095 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.272394 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.272303 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.273099 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.273073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.273175 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.273148 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.273489 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.273464 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.273946 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.273919 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3938d56b-78a7-4611-87fa-df11b417e076-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.274054 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.273950 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-web-config\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.274488 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.274447 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.275039 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.275013 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3938d56b-78a7-4611-87fa-df11b417e076-config-out\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.275195 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.275163 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3938d56b-78a7-4611-87fa-df11b417e076-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.275645 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.275627 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3938d56b-78a7-4611-87fa-df11b417e076-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.276556 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.276517 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9gcd\" (UniqueName: \"kubernetes.io/projected/3938d56b-78a7-4611-87fa-df11b417e076-kube-api-access-w9gcd\") pod \"prometheus-k8s-0\" (UID: \"3938d56b-78a7-4611-87fa-df11b417e076\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.382630 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.382601 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:37:17.918000 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:17.917949 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 16 07:37:17.919910 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:37:17.919877 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3938d56b_78a7_4611_87fa_df11b417e076.slice/crio-9352f90644cf5f67f10d522f6e833508614651aaa30266cbc02370f273deaaa2 WatchSource:0}: Error finding container 9352f90644cf5f67f10d522f6e833508614651aaa30266cbc02370f273deaaa2: Status 404 returned error can't find the container with id 9352f90644cf5f67f10d522f6e833508614651aaa30266cbc02370f273deaaa2 Jul 16 07:37:18.019602 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:18.019567 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" event={"ID":"6814d48a-ea3c-422d-8eb1-cf35d777d678","Type":"ContainerStarted","Data":"25994e18b6a7d845281a5990b47008c53792bcd9342b0a4a673f32c428ece9fc"} Jul 16 07:37:18.019914 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:18.019644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" event={"ID":"6814d48a-ea3c-422d-8eb1-cf35d777d678","Type":"ContainerStarted","Data":"770491cb587799b6622aa0f2dda37b73ca4b4e1d88f578d07c033df4e139bc12"} Jul 16 07:37:18.021037 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:18.021005 2570 generic.go:356] "Generic (PLEG): container finished" podID="3938d56b-78a7-4611-87fa-df11b417e076" containerID="cfd0e843f887fdb1a7dac0648ef71f222a713ec6d46bf0e310e442f66927cdd4" exitCode=0 Jul 16 07:37:18.021132 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:18.021082 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerDied","Data":"cfd0e843f887fdb1a7dac0648ef71f222a713ec6d46bf0e310e442f66927cdd4"} Jul 16 07:37:18.021187 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:18.021136 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"9352f90644cf5f67f10d522f6e833508614651aaa30266cbc02370f273deaaa2"} Jul 16 07:37:18.077628 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:18.077604 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd0c87ea-2126-42bd-af07-dd7afc8d0b87" path="/var/lib/kubelet/pods/dd0c87ea-2126-42bd-af07-dd7afc8d0b87/volumes" Jul 16 07:37:19.034236 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.034196 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"4c92895394be4c4a20ab74a5dacd20f38d13bfe6b364cfe6eb3214cb314cffdb"} Jul 16 07:37:19.034661 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.034293 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"f5aab8f671738c8677c1eec696d853bac7a5bfa4bc26fb7f718438248c31f78b"} Jul 16 07:37:19.034661 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.034322 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"a4f4951eea475c3701e91d6c9b4b1defa48abfa2921b730c0bb2243ad1bc74cc"} Jul 16 07:37:19.034661 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.034357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"be86820495371111b7d2b4dde78ac8e076ca930f426e4055ff265924f6ddb58f"} Jul 16 07:37:19.034661 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.034394 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"07593816d009f5b676380ee50a5f9a9cf829e1d8ed4e38b17b3cc4744c0d0480"} Jul 16 07:37:19.034661 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.034426 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3938d56b-78a7-4611-87fa-df11b417e076","Type":"ContainerStarted","Data":"f81f3689c7c135cd07506f7abdbee88dd59a3808e87284d592ad6b427600f32a"} Jul 16 07:37:19.036227 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.036201 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" event={"ID":"6814d48a-ea3c-422d-8eb1-cf35d777d678","Type":"ContainerStarted","Data":"1233663cfe1b5bb1d89959d953fd9ac1c2f1d0f67955820e42f8df12805ef15c"} Jul 16 07:37:19.061942 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.061890 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.037218706 podStartE2EDuration="2.061875624s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.656918ms" isStatefulPod=false podCreationTimestamp="2026-07-16 07:37:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:37:19.060659069 +0000 UTC m=+152.144084708" watchObservedRunningTime="2026-07-16 07:37:19.061875624 +0000 UTC m=+152.145301245" Jul 16 07:37:19.081439 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:19.081392 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b79746f85-8f6g6" podStartSLOduration=2.231382156 podStartE2EDuration="4.08137858s" totalImagesPullingTime="1.849996424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:37:19.07959881 +0000 UTC m=+152.163024431" watchObservedRunningTime="2026-07-16 07:37:19.08137858 +0000 UTC m=+152.164804197" Jul 16 07:37:22.383646 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:37:22.383606 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:38:17.383027 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:38:17.382993 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:38:17.397457 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:38:17.397436 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:38:18.278016 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:38:18.277989 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 16 07:39:47.885999 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:39:47.885966 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:39:47.889989 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:39:47.889966 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:39:47.891035 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:39:47.891014 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 07:40:11.566222 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.566190 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-84xsr"] Jul 16 07:40:11.569246 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.569231 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.571662 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.571640 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vss4f\"" Jul 16 07:40:11.571807 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.571680 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 07:40:11.572491 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.572475 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 07:40:11.578906 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.578881 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-84xsr"] Jul 16 07:40:11.726920 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.726884 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92396f4e-f8da-4f81-bea6-b74d5bc93179-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-84xsr\" (UID: \"92396f4e-f8da-4f81-bea6-b74d5bc93179\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.727072 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.726938 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csr7g\" (UniqueName: \"kubernetes.io/projected/92396f4e-f8da-4f81-bea6-b74d5bc93179-kube-api-access-csr7g\") pod \"cert-manager-cainjector-559cdd8c87-84xsr\" (UID: \"92396f4e-f8da-4f81-bea6-b74d5bc93179\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.828121 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.828059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92396f4e-f8da-4f81-bea6-b74d5bc93179-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-84xsr\" (UID: \"92396f4e-f8da-4f81-bea6-b74d5bc93179\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.828121 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.828090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csr7g\" (UniqueName: \"kubernetes.io/projected/92396f4e-f8da-4f81-bea6-b74d5bc93179-kube-api-access-csr7g\") pod \"cert-manager-cainjector-559cdd8c87-84xsr\" (UID: \"92396f4e-f8da-4f81-bea6-b74d5bc93179\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.835330 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.835300 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92396f4e-f8da-4f81-bea6-b74d5bc93179-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-84xsr\" (UID: \"92396f4e-f8da-4f81-bea6-b74d5bc93179\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.835425 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.835354 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csr7g\" (UniqueName: \"kubernetes.io/projected/92396f4e-f8da-4f81-bea6-b74d5bc93179-kube-api-access-csr7g\") pod \"cert-manager-cainjector-559cdd8c87-84xsr\" (UID: \"92396f4e-f8da-4f81-bea6-b74d5bc93179\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:11.883430 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:11.883410 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" Jul 16 07:40:12.008248 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:12.008206 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-84xsr"] Jul 16 07:40:12.010565 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:40:12.010537 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92396f4e_f8da_4f81_bea6_b74d5bc93179.slice/crio-8f47d53b5acf233658a77ba0550e5e6449314a8520d147056bb2e1c658dfcdab WatchSource:0}: Error finding container 8f47d53b5acf233658a77ba0550e5e6449314a8520d147056bb2e1c658dfcdab: Status 404 returned error can't find the container with id 8f47d53b5acf233658a77ba0550e5e6449314a8520d147056bb2e1c658dfcdab Jul 16 07:40:12.012552 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:12.012520 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 07:40:12.700733 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:12.700698 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" event={"ID":"92396f4e-f8da-4f81-bea6-b74d5bc93179","Type":"ContainerStarted","Data":"8f47d53b5acf233658a77ba0550e5e6449314a8520d147056bb2e1c658dfcdab"} Jul 16 07:40:15.716043 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:15.716010 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" event={"ID":"92396f4e-f8da-4f81-bea6-b74d5bc93179","Type":"ContainerStarted","Data":"6dde7921cc2b01a065d0a54eb1d4d09cf67f7d78cae59d855701c2504fda4b00"} Jul 16 07:40:15.731267 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:15.731222 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-84xsr" podStartSLOduration=1.437665001 podStartE2EDuration="4.731206345s" totalImagesPullingTime="3.293541344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:40:15.729518724 +0000 UTC m=+328.812944360" watchObservedRunningTime="2026-07-16 07:40:15.731206345 +0000 UTC m=+328.814631961" Jul 16 07:40:20.193430 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.193399 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6d4nj"] Jul 16 07:40:20.196750 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.196733 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.199741 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.199722 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-drhhn\"" Jul 16 07:40:20.200619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.200597 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsv6k\" (UniqueName: \"kubernetes.io/projected/86d6ffce-9102-45e6-8eb9-79534cbca2c0-kube-api-access-vsv6k\") pod \"cert-manager-55b4d954d5-6d4nj\" (UID: \"86d6ffce-9102-45e6-8eb9-79534cbca2c0\") " pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.200732 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.200676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86d6ffce-9102-45e6-8eb9-79534cbca2c0-bound-sa-token\") pod \"cert-manager-55b4d954d5-6d4nj\" (UID: \"86d6ffce-9102-45e6-8eb9-79534cbca2c0\") " pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.208025 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.208005 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6d4nj"] Jul 16 07:40:20.301905 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.301881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86d6ffce-9102-45e6-8eb9-79534cbca2c0-bound-sa-token\") pod \"cert-manager-55b4d954d5-6d4nj\" (UID: \"86d6ffce-9102-45e6-8eb9-79534cbca2c0\") " pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.302003 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.301930 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsv6k\" (UniqueName: \"kubernetes.io/projected/86d6ffce-9102-45e6-8eb9-79534cbca2c0-kube-api-access-vsv6k\") pod \"cert-manager-55b4d954d5-6d4nj\" (UID: \"86d6ffce-9102-45e6-8eb9-79534cbca2c0\") " pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.309891 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.309865 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86d6ffce-9102-45e6-8eb9-79534cbca2c0-bound-sa-token\") pod \"cert-manager-55b4d954d5-6d4nj\" (UID: \"86d6ffce-9102-45e6-8eb9-79534cbca2c0\") " pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.310031 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.310015 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsv6k\" (UniqueName: \"kubernetes.io/projected/86d6ffce-9102-45e6-8eb9-79534cbca2c0-kube-api-access-vsv6k\") pod \"cert-manager-55b4d954d5-6d4nj\" (UID: \"86d6ffce-9102-45e6-8eb9-79534cbca2c0\") " pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.505920 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.505853 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-6d4nj" Jul 16 07:40:20.624717 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.624691 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-6d4nj"] Jul 16 07:40:20.627306 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:40:20.627276 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86d6ffce_9102_45e6_8eb9_79534cbca2c0.slice/crio-c4b0f0bb728741dfd2ef7e620894a597755da5fc9b2e24ac2e649a90deb61110 WatchSource:0}: Error finding container c4b0f0bb728741dfd2ef7e620894a597755da5fc9b2e24ac2e649a90deb61110: Status 404 returned error can't find the container with id c4b0f0bb728741dfd2ef7e620894a597755da5fc9b2e24ac2e649a90deb61110 Jul 16 07:40:20.738592 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.738560 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6d4nj" event={"ID":"86d6ffce-9102-45e6-8eb9-79534cbca2c0","Type":"ContainerStarted","Data":"79dd49b976261229a235b1193edd331ad17a57da9c04ddb254a990b584ed09ea"} Jul 16 07:40:20.738763 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.738600 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-6d4nj" event={"ID":"86d6ffce-9102-45e6-8eb9-79534cbca2c0","Type":"ContainerStarted","Data":"c4b0f0bb728741dfd2ef7e620894a597755da5fc9b2e24ac2e649a90deb61110"} Jul 16 07:40:20.754234 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:40:20.754185 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-6d4nj" podStartSLOduration=0.754170815 podStartE2EDuration="754.170815ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:40:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:40:20.752734608 +0000 UTC m=+333.836160237" watchObservedRunningTime="2026-07-16 07:40:20.754170815 +0000 UTC m=+333.837596429" Jul 16 07:42:47.924429 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:42:47.924398 2570 scope.go:117] "RemoveContainer" containerID="79579027e42879cb97328e94dfb7b561c9f078e7c9369281014acfa4f41ab50a" Jul 16 07:43:01.164277 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.164240 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-r9c2x"] Jul 16 07:43:01.167771 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.167749 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:43:01.170126 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.170102 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 07:43:01.170126 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.170106 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 07:43:01.170941 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.170925 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6z7qk\"" Jul 16 07:43:01.176140 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.176117 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-r9c2x"] Jul 16 07:43:01.256267 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.256231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfk8w\" (UniqueName: \"kubernetes.io/projected/b51f1d31-08fb-450c-9dda-88e19bb240f6-kube-api-access-xfk8w\") pod \"test-trainjob-workflow-node-0-0-r9c2x\" (UID: \"b51f1d31-08fb-450c-9dda-88e19bb240f6\") " pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:43:01.357370 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.357335 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfk8w\" (UniqueName: \"kubernetes.io/projected/b51f1d31-08fb-450c-9dda-88e19bb240f6-kube-api-access-xfk8w\") pod \"test-trainjob-workflow-node-0-0-r9c2x\" (UID: \"b51f1d31-08fb-450c-9dda-88e19bb240f6\") " pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:43:01.365224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.365194 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfk8w\" (UniqueName: \"kubernetes.io/projected/b51f1d31-08fb-450c-9dda-88e19bb240f6-kube-api-access-xfk8w\") pod \"test-trainjob-workflow-node-0-0-r9c2x\" (UID: \"b51f1d31-08fb-450c-9dda-88e19bb240f6\") " pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:43:01.478133 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.478053 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:43:01.599563 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:01.599515 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-r9c2x"] Jul 16 07:43:01.602103 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:43:01.602076 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb51f1d31_08fb_450c_9dda_88e19bb240f6.slice/crio-9c1163c346b2e72d3cd14a2204c8ec074a2ab2b058f2f212715d64eec2e2b691 WatchSource:0}: Error finding container 9c1163c346b2e72d3cd14a2204c8ec074a2ab2b058f2f212715d64eec2e2b691: Status 404 returned error can't find the container with id 9c1163c346b2e72d3cd14a2204c8ec074a2ab2b058f2f212715d64eec2e2b691 Jul 16 07:43:02.386108 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:43:02.386068 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" event={"ID":"b51f1d31-08fb-450c-9dda-88e19bb240f6","Type":"ContainerStarted","Data":"9c1163c346b2e72d3cd14a2204c8ec074a2ab2b058f2f212715d64eec2e2b691"} Jul 16 07:44:11.720137 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:11.720100 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" event={"ID":"b51f1d31-08fb-450c-9dda-88e19bb240f6","Type":"ContainerStarted","Data":"b0e8c1cf43e7e275aee6594c102556d1c07ba42cf231e0e5ab0864ddb745a261"} Jul 16 07:44:11.735143 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:11.735095 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" podStartSLOduration=1.6990359320000001 podStartE2EDuration="1m10.735080393s" totalImagesPullingTime="1m9.036044461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:44:11.733427891 +0000 UTC m=+564.816853527" watchObservedRunningTime="2026-07-16 07:44:11.735080393 +0000 UTC m=+564.818506010" Jul 16 07:44:13.729504 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:13.729468 2570 generic.go:356] "Generic (PLEG): container finished" podID="b51f1d31-08fb-450c-9dda-88e19bb240f6" containerID="b0e8c1cf43e7e275aee6594c102556d1c07ba42cf231e0e5ab0864ddb745a261" exitCode=0 Jul 16 07:44:13.729920 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:13.729557 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" event={"ID":"b51f1d31-08fb-450c-9dda-88e19bb240f6","Type":"ContainerDied","Data":"b0e8c1cf43e7e275aee6594c102556d1c07ba42cf231e0e5ab0864ddb745a261"} Jul 16 07:44:14.915008 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:14.914974 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:44:14.932159 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:14.932128 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfk8w\" (UniqueName: \"kubernetes.io/projected/b51f1d31-08fb-450c-9dda-88e19bb240f6-kube-api-access-xfk8w\") pod \"b51f1d31-08fb-450c-9dda-88e19bb240f6\" (UID: \"b51f1d31-08fb-450c-9dda-88e19bb240f6\") " Jul 16 07:44:14.934719 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:14.934681 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51f1d31-08fb-450c-9dda-88e19bb240f6-kube-api-access-xfk8w" (OuterVolumeSpecName: "kube-api-access-xfk8w") pod "b51f1d31-08fb-450c-9dda-88e19bb240f6" (UID: "b51f1d31-08fb-450c-9dda-88e19bb240f6"). InnerVolumeSpecName "kube-api-access-xfk8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:44:15.033350 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:15.033261 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfk8w\" (UniqueName: \"kubernetes.io/projected/b51f1d31-08fb-450c-9dda-88e19bb240f6-kube-api-access-xfk8w\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:44:15.739305 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:15.739267 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" event={"ID":"b51f1d31-08fb-450c-9dda-88e19bb240f6","Type":"ContainerDied","Data":"9c1163c346b2e72d3cd14a2204c8ec074a2ab2b058f2f212715d64eec2e2b691"} Jul 16 07:44:15.739305 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:15.739290 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-r9c2x" Jul 16 07:44:15.739305 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:15.739308 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c1163c346b2e72d3cd14a2204c8ec074a2ab2b058f2f212715d64eec2e2b691" Jul 16 07:44:16.412984 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:16.412948 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-r9c2x"] Jul 16 07:44:16.415450 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:16.415426 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-r9c2x"] Jul 16 07:44:17.183215 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.183180 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2llgj/must-gather-824hr"] Jul 16 07:44:17.183704 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.183557 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51f1d31-08fb-450c-9dda-88e19bb240f6" containerName="node" Jul 16 07:44:17.183704 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.183571 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51f1d31-08fb-450c-9dda-88e19bb240f6" containerName="node" Jul 16 07:44:17.183704 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.183644 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51f1d31-08fb-450c-9dda-88e19bb240f6" containerName="node" Jul 16 07:44:17.213364 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.213317 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2llgj/must-gather-824hr"] Jul 16 07:44:17.213565 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.213454 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.215802 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.215779 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2llgj\"/\"openshift-service-ca.crt\"" Jul 16 07:44:17.215939 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.215784 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2llgj\"/\"default-dockercfg-krm8q\"" Jul 16 07:44:17.215939 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.215856 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2llgj\"/\"kube-root-ca.crt\"" Jul 16 07:44:17.248545 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.248497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4dd6c6a-80c9-4431-a09e-906af77e8e38-must-gather-output\") pod \"must-gather-824hr\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.248705 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.248583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st2dg\" (UniqueName: \"kubernetes.io/projected/b4dd6c6a-80c9-4431-a09e-906af77e8e38-kube-api-access-st2dg\") pod \"must-gather-824hr\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.349012 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.348969 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4dd6c6a-80c9-4431-a09e-906af77e8e38-must-gather-output\") pod \"must-gather-824hr\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.349274 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.349028 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st2dg\" (UniqueName: \"kubernetes.io/projected/b4dd6c6a-80c9-4431-a09e-906af77e8e38-kube-api-access-st2dg\") pod \"must-gather-824hr\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.349352 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.349322 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4dd6c6a-80c9-4431-a09e-906af77e8e38-must-gather-output\") pod \"must-gather-824hr\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.356224 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.356195 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st2dg\" (UniqueName: \"kubernetes.io/projected/b4dd6c6a-80c9-4431-a09e-906af77e8e38-kube-api-access-st2dg\") pod \"must-gather-824hr\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.523413 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.523336 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:44:17.670624 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.670573 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2llgj/must-gather-824hr"] Jul 16 07:44:17.672764 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:44:17.672740 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4dd6c6a_80c9_4431_a09e_906af77e8e38.slice/crio-072eb74ac29b9251bb973f9ae48be35fe57208d90316d9c51601dd9f8e29808b WatchSource:0}: Error finding container 072eb74ac29b9251bb973f9ae48be35fe57208d90316d9c51601dd9f8e29808b: Status 404 returned error can't find the container with id 072eb74ac29b9251bb973f9ae48be35fe57208d90316d9c51601dd9f8e29808b Jul 16 07:44:17.748583 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:17.748546 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2llgj/must-gather-824hr" event={"ID":"b4dd6c6a-80c9-4431-a09e-906af77e8e38","Type":"ContainerStarted","Data":"072eb74ac29b9251bb973f9ae48be35fe57208d90316d9c51601dd9f8e29808b"} Jul 16 07:44:18.078639 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:18.078605 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51f1d31-08fb-450c-9dda-88e19bb240f6" path="/var/lib/kubelet/pods/b51f1d31-08fb-450c-9dda-88e19bb240f6/volumes" Jul 16 07:44:25.797263 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:25.797210 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2llgj/must-gather-824hr" event={"ID":"b4dd6c6a-80c9-4431-a09e-906af77e8e38","Type":"ContainerStarted","Data":"658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da"} Jul 16 07:44:25.797263 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:25.797265 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2llgj/must-gather-824hr" event={"ID":"b4dd6c6a-80c9-4431-a09e-906af77e8e38","Type":"ContainerStarted","Data":"20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e"} Jul 16 07:44:25.811345 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:25.811298 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2llgj/must-gather-824hr" podStartSLOduration=1.663709317 podStartE2EDuration="8.811284932s" totalImagesPullingTime="7.147575615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 07:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:44:25.810059877 +0000 UTC m=+578.893485493" watchObservedRunningTime="2026-07-16 07:44:25.811284932 +0000 UTC m=+578.894710547" Jul 16 07:44:47.917505 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:47.917475 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:44:47.918387 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:44:47.918368 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:45:11.013115 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:11.013079 2570 generic.go:356] "Generic (PLEG): container finished" podID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerID="20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e" exitCode=0 Jul 16 07:45:11.013504 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:11.013129 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2llgj/must-gather-824hr" event={"ID":"b4dd6c6a-80c9-4431-a09e-906af77e8e38","Type":"ContainerDied","Data":"20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e"} Jul 16 07:45:11.013504 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:11.013443 2570 scope.go:117] "RemoveContainer" containerID="20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e" Jul 16 07:45:11.322463 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:11.322389 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2llgj_must-gather-824hr_b4dd6c6a-80c9-4431-a09e-906af77e8e38/gather/0.log" Jul 16 07:45:14.505114 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:14.505089 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4w27_29f81e96-432a-41e3-b159-058a80df912d/global-pull-secret-syncer/0.log" Jul 16 07:45:14.657030 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:14.657005 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xv44f_1f9d1de6-7708-4052-bf74-69942a00060e/konnectivity-agent/0.log" Jul 16 07:45:14.755405 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:14.755322 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-197.ec2.internal_c6527244e4faae6846389be1f06153b7/haproxy/0.log" Jul 16 07:45:16.670612 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.670570 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-2llgj/must-gather-824hr"] Jul 16 07:45:16.671069 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.670831 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-2llgj/must-gather-824hr" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="copy" containerID="cri-o://658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da" gracePeriod=2 Jul 16 07:45:16.675948 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.675921 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-2llgj/must-gather-824hr"] Jul 16 07:45:16.908266 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.908245 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2llgj_must-gather-824hr_b4dd6c6a-80c9-4431-a09e-906af77e8e38/copy/0.log" Jul 16 07:45:16.909712 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.909696 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:45:16.911561 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:45:16.911504 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-824hr\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2llgj\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:45:16.987351 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.987282 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st2dg\" (UniqueName: \"kubernetes.io/projected/b4dd6c6a-80c9-4431-a09e-906af77e8e38-kube-api-access-st2dg\") pod \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " Jul 16 07:45:16.987481 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.987360 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4dd6c6a-80c9-4431-a09e-906af77e8e38-must-gather-output\") pod \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\" (UID: \"b4dd6c6a-80c9-4431-a09e-906af77e8e38\") " Jul 16 07:45:16.988656 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.988632 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4dd6c6a-80c9-4431-a09e-906af77e8e38-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b4dd6c6a-80c9-4431-a09e-906af77e8e38" (UID: "b4dd6c6a-80c9-4431-a09e-906af77e8e38"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 07:45:16.989409 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:16.989381 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4dd6c6a-80c9-4431-a09e-906af77e8e38-kube-api-access-st2dg" (OuterVolumeSpecName: "kube-api-access-st2dg") pod "b4dd6c6a-80c9-4431-a09e-906af77e8e38" (UID: "b4dd6c6a-80c9-4431-a09e-906af77e8e38"). InnerVolumeSpecName "kube-api-access-st2dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 07:45:17.041708 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.041678 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-2llgj_must-gather-824hr_b4dd6c6a-80c9-4431-a09e-906af77e8e38/copy/0.log" Jul 16 07:45:17.042022 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.042000 2570 generic.go:356] "Generic (PLEG): container finished" podID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerID="658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da" exitCode=143 Jul 16 07:45:17.042124 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.042047 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:45:17.042124 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.042095 2570 scope.go:117] "RemoveContainer" containerID="658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da" Jul 16 07:45:17.044487 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:45:17.044456 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-824hr\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2llgj\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:45:17.050437 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.050421 2570 scope.go:117] "RemoveContainer" containerID="20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e" Jul 16 07:45:17.051873 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:45:17.051850 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-824hr\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2llgj\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:45:17.060905 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.060890 2570 scope.go:117] "RemoveContainer" containerID="658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da" Jul 16 07:45:17.061222 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:45:17.061199 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da\": container with ID starting with 658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da not found: ID does not exist" containerID="658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da" Jul 16 07:45:17.061292 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.061236 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da"} err="failed to get container status \"658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da\": rpc error: code = NotFound desc = could not find container \"658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da\": container with ID starting with 658c51bd8a2359ddc1e01a08c19aaeaccb76711c89f3e1f185d2ff9711bb91da not found: ID does not exist" Jul 16 07:45:17.061292 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.061255 2570 scope.go:117] "RemoveContainer" containerID="20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e" Jul 16 07:45:17.061555 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:45:17.061510 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e\": container with ID starting with 20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e not found: ID does not exist" containerID="20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e" Jul 16 07:45:17.061623 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.061566 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e"} err="failed to get container status \"20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e\": rpc error: code = NotFound desc = could not find container \"20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e\": container with ID starting with 20efe7fd31502c6e80bf51fd68cd9420f8447a4a6b8884485fc9ad7e7d62799e not found: ID does not exist" Jul 16 07:45:17.088359 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.088335 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st2dg\" (UniqueName: \"kubernetes.io/projected/b4dd6c6a-80c9-4431-a09e-906af77e8e38-kube-api-access-st2dg\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:45:17.088359 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:17.088360 2570 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b4dd6c6a-80c9-4431-a09e-906af77e8e38-must-gather-output\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 16 07:45:18.077849 ip-10-0-141-197 kubenswrapper[2570]: E0716 07:45:18.077806 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-824hr\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-2llgj\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" pod="openshift-must-gather-2llgj/must-gather-824hr" Jul 16 07:45:18.077849 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.077852 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/alertmanager/0.log" Jul 16 07:45:18.079045 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.079025 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" path="/var/lib/kubelet/pods/b4dd6c6a-80c9-4431-a09e-906af77e8e38/volumes" Jul 16 07:45:18.106375 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.106342 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/config-reloader/0.log" Jul 16 07:45:18.138675 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.138649 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/kube-rbac-proxy-web/0.log" Jul 16 07:45:18.167117 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.167098 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/kube-rbac-proxy/0.log" Jul 16 07:45:18.199034 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.199012 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/kube-rbac-proxy-metric/0.log" Jul 16 07:45:18.227737 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.227718 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/prom-label-proxy/0.log" Jul 16 07:45:18.250659 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.250636 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3b3de360-3794-4bea-a25e-044a3296c33f/init-config-reloader/0.log" Jul 16 07:45:18.328627 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.328555 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h9cld_715dbd73-55cb-433e-8062-ebecd98b9c1d/kube-state-metrics/0.log" Jul 16 07:45:18.353765 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.353743 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h9cld_715dbd73-55cb-433e-8062-ebecd98b9c1d/kube-rbac-proxy-main/0.log" Jul 16 07:45:18.382566 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.382546 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-h9cld_715dbd73-55cb-433e-8062-ebecd98b9c1d/kube-rbac-proxy-self/0.log" Jul 16 07:45:18.415001 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.414977 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-df69cb447-l5wl7_88fadfb5-fe4f-4148-a24f-93ae6ebc7161/metrics-server/0.log" Jul 16 07:45:18.546230 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.546202 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59kgw_6e176c05-590e-479c-a354-f5a3d1ec65ef/node-exporter/0.log" Jul 16 07:45:18.568294 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.568270 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59kgw_6e176c05-590e-479c-a354-f5a3d1ec65ef/kube-rbac-proxy/0.log" Jul 16 07:45:18.595875 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.595807 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-59kgw_6e176c05-590e-479c-a354-f5a3d1ec65ef/init-textfile/0.log" Jul 16 07:45:18.700637 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.700611 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-cg4pn_6c2208be-d28a-4f94-9b3e-a629eb86e578/kube-rbac-proxy-main/0.log" Jul 16 07:45:18.724375 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.724347 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-cg4pn_6c2208be-d28a-4f94-9b3e-a629eb86e578/kube-rbac-proxy-self/0.log" Jul 16 07:45:18.744335 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.744312 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-cg4pn_6c2208be-d28a-4f94-9b3e-a629eb86e578/openshift-state-metrics/0.log" Jul 16 07:45:18.784159 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.784137 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/prometheus/0.log" Jul 16 07:45:18.806659 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.806638 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/config-reloader/0.log" Jul 16 07:45:18.828148 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.828131 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/thanos-sidecar/0.log" Jul 16 07:45:18.852151 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.852095 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/kube-rbac-proxy-web/0.log" Jul 16 07:45:18.875515 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.875493 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/kube-rbac-proxy/0.log" Jul 16 07:45:18.897072 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.897043 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/kube-rbac-proxy-thanos/0.log" Jul 16 07:45:18.917228 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.917211 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3938d56b-78a7-4611-87fa-df11b417e076/init-config-reloader/0.log" Jul 16 07:45:18.945834 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.945814 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-9lbgg_60ce04b1-18fd-45ed-b5eb-b9ddad7b341a/prometheus-operator/0.log" Jul 16 07:45:18.963756 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.963734 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-9lbgg_60ce04b1-18fd-45ed-b5eb-b9ddad7b341a/kube-rbac-proxy/0.log" Jul 16 07:45:18.992984 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:18.992963 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-jxsp7_73ee6427-c83c-4303-870a-05438d126e81/prometheus-operator-admission-webhook/0.log" Jul 16 07:45:19.026839 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.026808 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b79746f85-8f6g6_6814d48a-ea3c-422d-8eb1-cf35d777d678/telemeter-client/0.log" Jul 16 07:45:19.050289 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.050268 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b79746f85-8f6g6_6814d48a-ea3c-422d-8eb1-cf35d777d678/reload/0.log" Jul 16 07:45:19.069674 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.069656 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b79746f85-8f6g6_6814d48a-ea3c-422d-8eb1-cf35d777d678/kube-rbac-proxy/0.log" Jul 16 07:45:19.109279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.109228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c95ff9d8-2zl7h_83e05908-1179-4a74-ac95-b71ac1a2cc40/thanos-query/0.log" Jul 16 07:45:19.144671 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.144649 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c95ff9d8-2zl7h_83e05908-1179-4a74-ac95-b71ac1a2cc40/kube-rbac-proxy-web/0.log" Jul 16 07:45:19.164400 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.164380 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c95ff9d8-2zl7h_83e05908-1179-4a74-ac95-b71ac1a2cc40/kube-rbac-proxy/0.log" Jul 16 07:45:19.182935 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.182915 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c95ff9d8-2zl7h_83e05908-1179-4a74-ac95-b71ac1a2cc40/prom-label-proxy/0.log" Jul 16 07:45:19.202482 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.202464 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c95ff9d8-2zl7h_83e05908-1179-4a74-ac95-b71ac1a2cc40/kube-rbac-proxy-rules/0.log" Jul 16 07:45:19.224173 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:19.224156 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-67c95ff9d8-2zl7h_83e05908-1179-4a74-ac95-b71ac1a2cc40/kube-rbac-proxy-metrics/0.log" Jul 16 07:45:21.378058 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:21.377985 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-rx9x5_9afa21c7-65a9-49c3-a285-508a1249a98f/download-server/0.log" Jul 16 07:45:22.626461 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.626429 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8"] Jul 16 07:45:22.626974 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.626956 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="gather" Jul 16 07:45:22.627050 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.626977 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="gather" Jul 16 07:45:22.627050 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.626996 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="copy" Jul 16 07:45:22.627050 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.627004 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="copy" Jul 16 07:45:22.627192 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.627096 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="gather" Jul 16 07:45:22.627192 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.627109 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4dd6c6a-80c9-4431-a09e-906af77e8e38" containerName="copy" Jul 16 07:45:22.631154 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.631134 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.633383 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.633357 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g6zhg\"/\"openshift-service-ca.crt\"" Jul 16 07:45:22.633463 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.633436 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g6zhg\"/\"default-dockercfg-xtxq7\"" Jul 16 07:45:22.634373 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.634353 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g6zhg\"/\"kube-root-ca.crt\"" Jul 16 07:45:22.638579 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.638559 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8"] Jul 16 07:45:22.732984 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.732950 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-proc\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.732984 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.732983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5489t\" (UniqueName: \"kubernetes.io/projected/d4d55481-78b5-468e-aee8-96c20044d839-kube-api-access-5489t\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.733220 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.733011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-sys\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.733220 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.733066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-podres\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.733220 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.733126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-lib-modules\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.743866 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.743842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ksgcr_2946c501-8b0f-4cd0-bb52-02abf840eac4/dns/0.log" Jul 16 07:45:22.761502 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.761479 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ksgcr_2946c501-8b0f-4cd0-bb52-02abf840eac4/kube-rbac-proxy/0.log" Jul 16 07:45:22.781491 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.781472 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ftm7n_4b9d8c73-9b6b-4c12-8cef-f7b0c43d68f2/dns-node-resolver/0.log" Jul 16 07:45:22.834554 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-proc\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834554 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5489t\" (UniqueName: \"kubernetes.io/projected/d4d55481-78b5-468e-aee8-96c20044d839-kube-api-access-5489t\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834582 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-sys\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-podres\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834643 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-lib-modules\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834649 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-proc\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834726 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-sys\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834779 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-lib-modules\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.834805 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.834778 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d4d55481-78b5-468e-aee8-96c20044d839-podres\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.841359 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.841331 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5489t\" (UniqueName: \"kubernetes.io/projected/d4d55481-78b5-468e-aee8-96c20044d839-kube-api-access-5489t\") pod \"perf-node-gather-daemonset-dfld8\" (UID: \"d4d55481-78b5-468e-aee8-96c20044d839\") " pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:22.941339 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:22.941298 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:23.064361 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:23.064342 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8"] Jul 16 07:45:23.067338 ip-10-0-141-197 kubenswrapper[2570]: W0716 07:45:23.067312 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd4d55481_78b5_468e_aee8_96c20044d839.slice/crio-d209daed7950cdf0be3ea3e11e92fe49f18aff2d93f22e02e1d41a43f7960e84 WatchSource:0}: Error finding container d209daed7950cdf0be3ea3e11e92fe49f18aff2d93f22e02e1d41a43f7960e84: Status 404 returned error can't find the container with id d209daed7950cdf0be3ea3e11e92fe49f18aff2d93f22e02e1d41a43f7960e84 Jul 16 07:45:23.272195 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:23.272120 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-swllx_1794a42d-89f3-4427-b522-b332f8372121/node-ca/0.log" Jul 16 07:45:24.077253 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.077223 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" event={"ID":"d4d55481-78b5-468e-aee8-96c20044d839","Type":"ContainerStarted","Data":"4debb0446fa691e25efc7ce25ddd3c3bf4a0b81deaf9db2c93b160d6a7be2a90"} Jul 16 07:45:24.077633 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.077271 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:24.077633 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.077287 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" event={"ID":"d4d55481-78b5-468e-aee8-96c20044d839","Type":"ContainerStarted","Data":"d209daed7950cdf0be3ea3e11e92fe49f18aff2d93f22e02e1d41a43f7960e84"} Jul 16 07:45:24.087225 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.087177 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" podStartSLOduration=2.087161595 podStartE2EDuration="2.087161595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 07:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 07:45:24.086601523 +0000 UTC m=+637.170027141" watchObservedRunningTime="2026-07-16 07:45:24.087161595 +0000 UTC m=+637.170587212" Jul 16 07:45:24.212765 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.212738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-95nzz_b2b44b36-f1ef-46a5-8e01-3fbe945e9436/serve-healthcheck-canary/0.log" Jul 16 07:45:24.681402 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.681357 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsgjq_31f6f870-d782-4465-b4c0-83096b6db5d0/kube-rbac-proxy/0.log" Jul 16 07:45:24.698703 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.698683 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsgjq_31f6f870-d782-4465-b4c0-83096b6db5d0/exporter/0.log" Jul 16 07:45:24.716766 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:24.716744 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vsgjq_31f6f870-d782-4465-b4c0-83096b6db5d0/extractor/0.log" Jul 16 07:45:30.086467 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.086439 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g6zhg/perf-node-gather-daemonset-dfld8" Jul 16 07:45:30.176312 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.176288 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/kube-multus-additional-cni-plugins/0.log" Jul 16 07:45:30.194869 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.194849 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/egress-router-binary-copy/0.log" Jul 16 07:45:30.212796 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.212773 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/cni-plugins/0.log" Jul 16 07:45:30.231301 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.231285 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/bond-cni-plugin/0.log" Jul 16 07:45:30.250862 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.250837 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/routeoverride-cni/0.log" Jul 16 07:45:30.269940 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.269910 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/whereabouts-cni-bincopy/0.log" Jul 16 07:45:30.288596 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.288572 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ckmxr_58282c1f-5320-4143-816b-8960d7edea15/whereabouts-cni/0.log" Jul 16 07:45:30.503613 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.503588 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-x57fx_5f2283c1-1781-4426-861a-57b756592e32/kube-multus/0.log" Jul 16 07:45:30.602953 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.602930 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l4h5h_6b9dfde2-1341-4275-b6e9-b3040ffe0ce2/network-metrics-daemon/0.log" Jul 16 07:45:30.621831 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:30.621806 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l4h5h_6b9dfde2-1341-4275-b6e9-b3040ffe0ce2/kube-rbac-proxy/0.log" Jul 16 07:45:31.422352 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.422312 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-controller/0.log" Jul 16 07:45:31.440824 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.440807 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/0.log" Jul 16 07:45:31.440959 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.440864 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovn-acl-logging/1.log" Jul 16 07:45:31.462254 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.462196 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/kube-rbac-proxy-node/0.log" Jul 16 07:45:31.482199 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.482180 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 07:45:31.502033 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.502008 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/northd/0.log" Jul 16 07:45:31.521168 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.521143 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/nbdb/0.log" Jul 16 07:45:31.540978 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.540956 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/sbdb/0.log" Jul 16 07:45:31.578128 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:31.578100 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c82rv_ee02ac0c-274f-466b-9276-6d34a25ff5e8/ovnkube-controller/0.log" Jul 16 07:45:32.871050 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:32.871026 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ghxkm_b7267e69-411d-418a-8b40-ef07a2553e61/network-check-target-container/0.log" Jul 16 07:45:33.754921 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:33.754894 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7d7dp_071d312d-e91b-4fd5-8f37-75542d91e02e/iptables-alerter/0.log" Jul 16 07:45:34.355279 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:34.355250 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-fndf5_25464234-ad7d-4a8b-83a8-10622b2dadf9/tuned/0.log" Jul 16 07:45:37.466713 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:37.466687 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-zrr8z_6321e88a-c2ec-43ec-b710-5f721552f43f/csi-driver/0.log" Jul 16 07:45:37.485619 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:37.485594 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-zrr8z_6321e88a-c2ec-43ec-b710-5f721552f43f/csi-node-driver-registrar/0.log" Jul 16 07:45:37.504564 ip-10-0-141-197 kubenswrapper[2570]: I0716 07:45:37.504536 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-zrr8z_6321e88a-c2ec-43ec-b710-5f721552f43f/csi-liveness-probe/0.log"