Jul 21 08:52:06.599777 ip-10-0-133-119 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 08:52:06.599789 ip-10-0-133-119 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 08:52:06.599796 ip-10-0-133-119 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 08:52:06.600034 ip-10-0-133-119 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 08:52:16.701417 ip-10-0-133-119 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 08:52:16.701438 ip-10-0-133-119 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 661d9da328d14ca58edcde59dbc6df9e -- Jul 21 08:54:07.330844 ip-10-0-133-119 systemd[1]: Starting Kubernetes Kubelet... Jul 21 08:54:07.697601 ip-10-0-133-119 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 08:54:07.697601 ip-10-0-133-119 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 08:54:07.697601 ip-10-0-133-119 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 08:54:07.697601 ip-10-0-133-119 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 08:54:07.697601 ip-10-0-133-119 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 08:54:07.698433 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.698349 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702775 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702792 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702796 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702799 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702802 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702805 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:07.702797 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702808 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702811 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702814 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702817 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702820 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702822 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702826 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702829 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702831 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702834 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702836 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702839 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702842 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702845 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702847 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702850 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702852 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702855 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702858 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702860 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:07.703049 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702863 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702865 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702868 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702870 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702873 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702882 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702885 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702887 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702890 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702892 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702895 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702899 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702903 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702906 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702911 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702913 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702916 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702919 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702921 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:07.703509 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702924 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702928 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702930 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702933 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702935 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702939 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702941 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702944 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702946 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702949 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702951 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702954 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702957 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702959 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702962 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702966 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702969 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702972 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702975 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702978 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:07.703972 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702980 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702983 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702986 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702989 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702992 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702995 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.702998 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703002 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703005 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703008 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703010 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703013 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703025 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703028 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703031 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703033 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703036 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703038 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703042 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:07.704446 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703044 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703047 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703050 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703052 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703055 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703057 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703060 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703063 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703065 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703068 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703070 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703072 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703075 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703078 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703081 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703794 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703801 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703804 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703807 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703809 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:07.704904 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703812 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703816 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703819 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703821 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703824 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703826 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703829 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703831 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703834 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703837 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703839 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703842 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703845 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703847 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703850 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703852 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703855 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703857 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703859 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703864 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:07.705365 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703867 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703871 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703874 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703876 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703879 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703882 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703885 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703887 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703890 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703893 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703895 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703898 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703900 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703903 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703905 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703908 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703911 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703913 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703915 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703918 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:07.705873 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703920 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703923 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703925 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703928 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703930 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703933 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703936 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703939 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703942 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703944 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703947 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703949 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703952 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703954 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703956 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703962 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703965 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703967 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703971 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:07.706357 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703974 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703978 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703982 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703984 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703987 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703990 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703992 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703995 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.703998 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704001 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704003 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704006 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704009 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704012 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704014 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704017 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704019 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704023 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704027 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:07.706827 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704030 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704033 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704036 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704039 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704043 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704046 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704049 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704052 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704054 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704058 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704060 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704063 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704066 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704068 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704071 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704073 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704456 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704461 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704463 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704466 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:07.707349 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704469 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704471 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704474 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704477 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704479 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704482 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704484 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704487 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704489 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704492 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704497 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704500 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704504 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704507 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704510 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704513 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704517 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704520 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704522 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:07.707846 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704525 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704543 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704547 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704550 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704553 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704556 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704558 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704561 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704563 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704566 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704569 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704571 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704574 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704577 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704580 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704582 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704584 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704587 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704589 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704592 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:07.708322 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704594 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704597 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704600 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704602 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704605 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704607 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704610 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704613 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704615 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704619 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704622 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704624 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704627 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704630 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704634 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704637 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704639 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704642 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704644 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704647 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:07.708830 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704649 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704652 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704654 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704657 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704659 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704662 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704664 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704666 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704669 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704671 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704674 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704676 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704679 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704681 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704684 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704686 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704689 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704693 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704696 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704700 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:07.709319 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704703 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704708 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704711 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704714 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704716 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704720 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704725 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704727 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704730 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704733 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704735 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704738 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704741 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704745 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704748 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.704750 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704818 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704826 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704833 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704838 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 08:54:07.709808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704842 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704845 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704849 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704853 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704857 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704859 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704863 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704866 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704869 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704872 2564 flags.go:64] FLAG: --cgroup-root="" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704875 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704878 2564 flags.go:64] FLAG: --client-ca-file="" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704881 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704887 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704891 2564 flags.go:64] FLAG: --cluster-domain="" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704894 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704897 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704900 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704904 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704908 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704911 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704914 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704918 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704921 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 21 08:54:07.710290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704924 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704927 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704930 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704933 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704937 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704940 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704943 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704945 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704948 2564 flags.go:64] FLAG: --enable-server="true" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704951 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704956 2564 flags.go:64] FLAG: --event-burst="100" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704959 2564 flags.go:64] FLAG: --event-qps="50" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704961 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704964 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704967 2564 flags.go:64] FLAG: --eviction-hard="" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704971 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704974 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704976 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704980 2564 flags.go:64] FLAG: --eviction-soft="" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704982 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704985 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704990 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704993 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704996 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.704999 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 08:54:07.710919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705002 2564 flags.go:64] FLAG: --feature-gates="" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705006 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705009 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705012 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705015 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705018 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705021 2564 flags.go:64] FLAG: --help="false" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705024 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-133-119.ec2.internal" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705027 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705029 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705032 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705036 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705039 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705041 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705044 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705047 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705050 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705052 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705055 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705058 2564 flags.go:64] FLAG: --kube-reserved="" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705061 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705065 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705068 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705071 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 08:54:07.711584 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705074 2564 flags.go:64] FLAG: --lock-file="" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705076 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705079 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705082 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705087 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705091 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705093 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705096 2564 flags.go:64] FLAG: --logging-format="text" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705099 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705102 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705105 2564 flags.go:64] FLAG: --manifest-url="" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705108 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705112 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705115 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705119 2564 flags.go:64] FLAG: --max-pods="110" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705122 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705125 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705128 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705131 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705134 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705136 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705139 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705146 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705149 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705152 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 08:54:07.712168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705156 2564 flags.go:64] FLAG: --pod-cidr="" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705159 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705164 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705167 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705170 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705173 2564 flags.go:64] FLAG: --port="10250" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705176 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705179 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0acbb6bb4f11bc574" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705182 2564 flags.go:64] FLAG: --qos-reserved="" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705185 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705188 2564 flags.go:64] FLAG: --register-node="true" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705191 2564 flags.go:64] FLAG: --register-with-taints="" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705194 2564 flags.go:64] FLAG: --registry-burst="10" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705198 2564 flags.go:64] FLAG: --registry-qps="5" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705201 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705204 2564 flags.go:64] FLAG: --reserved-memory="" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705207 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705210 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705213 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705216 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705219 2564 flags.go:64] FLAG: --runonce="false" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705221 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705224 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705227 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705230 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 08:54:07.712780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705232 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705235 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705238 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705241 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705244 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705247 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705249 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705252 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705255 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705258 2564 flags.go:64] FLAG: --system-cgroups="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705260 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705265 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705268 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705271 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705275 2564 flags.go:64] FLAG: --tls-min-version="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705277 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705280 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705283 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705286 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705289 2564 flags.go:64] FLAG: --v="2" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705293 2564 flags.go:64] FLAG: --version="false" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705298 2564 flags.go:64] FLAG: --vmodule="" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705301 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.705304 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705418 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:07.713360 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705422 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705425 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705428 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705430 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705433 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705436 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705438 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705441 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705444 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705446 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705449 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705451 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705454 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705456 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705459 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705462 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705466 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705469 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705472 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705476 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:07.713980 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705479 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705481 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705484 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705488 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705490 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705493 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705495 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705498 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705501 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705504 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705506 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705509 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705511 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705514 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705516 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705519 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705522 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705524 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705527 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705544 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:07.714492 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705548 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705552 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705556 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705560 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705562 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705565 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705567 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705570 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705575 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705578 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705581 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705585 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705588 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705591 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705593 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705597 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705600 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705603 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705605 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:07.714978 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705608 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705611 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705613 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705617 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705620 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705622 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705625 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705627 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705630 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705632 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705635 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705638 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705640 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705643 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705646 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705648 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705651 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705653 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705656 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705659 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:07.715449 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705661 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705665 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705668 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705671 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705673 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705676 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705679 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705682 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705685 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705688 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705691 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705694 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705698 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705701 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705703 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705706 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705709 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705712 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:07.715999 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.705714 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.706202 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.713101 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.713116 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.713883 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.713891 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713952 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713958 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713961 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713964 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713967 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713969 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713973 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713975 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713978 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:07.716427 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713981 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713984 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713987 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713989 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713992 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713995 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.713997 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714000 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714002 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714005 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714008 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714012 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714016 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714019 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714022 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714025 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714028 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714031 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714034 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714037 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:07.716809 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714041 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714044 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714046 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714049 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714052 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714055 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714057 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714060 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714063 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714066 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714068 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714071 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714074 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714076 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714079 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714082 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714084 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714087 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714090 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:07.717289 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714092 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714095 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714097 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714100 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714102 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714104 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714107 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714109 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714112 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714115 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714117 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714120 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714122 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714125 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714128 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714131 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714134 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714136 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714139 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714141 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:07.717755 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714144 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714146 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714149 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714152 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714154 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714156 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714159 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714162 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714164 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714166 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714169 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714172 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714174 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714178 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714181 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714184 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714187 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714189 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714192 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:07.718234 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714194 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714197 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714199 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714203 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714206 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714208 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714212 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714215 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714219 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714223 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714225 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714229 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.714234 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714335 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 08:54:07.718707 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714340 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714343 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714346 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714349 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714352 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714355 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714357 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714361 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714364 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714367 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714369 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714372 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714375 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714378 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714381 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714384 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714386 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714389 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714391 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714394 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714396 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 08:54:07.719058 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714399 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714402 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714404 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714407 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714410 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714413 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714415 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714417 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714420 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714423 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714425 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714427 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714430 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714433 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714437 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714440 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714442 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714445 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714447 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 08:54:07.719630 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714450 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714453 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714457 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714460 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714463 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714465 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714468 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714471 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714473 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714476 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714479 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714481 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714484 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714487 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714490 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714493 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714496 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714499 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714503 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 08:54:07.720097 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714507 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714510 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714512 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714515 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714518 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714521 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714524 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714527 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714543 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714548 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714552 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714554 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714557 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714560 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714562 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714564 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714567 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714569 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714572 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714574 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 08:54:07.720559 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714577 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714579 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714582 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714584 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714587 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714589 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714592 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714594 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714597 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714601 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714604 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714607 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714609 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714611 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714614 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714617 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714619 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714622 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 08:54:07.721053 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:07.714624 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.714629 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.714731 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.717398 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.718611 2564 server.go:1019] "Starting client certificate rotation" Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.718715 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.719589 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 08:54:07.721490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.720727 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 08:54:07.726583 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.726558 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 08:54:07.735793 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.735777 2564 log.go:25] "Validated CRI v1 runtime API" Jul 21 08:54:07.738361 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.738347 2564 log.go:25] "Validated CRI v1 image API" Jul 21 08:54:07.739149 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.739131 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 08:54:07.742071 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.742049 2564 fs.go:135] Filesystem UUIDs: map[216708bf-3dce-4ec8-8673-d20b3c42e126:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9c8e4ded-e08e-443a-b940-53dc3b43c971:/dev/nvme0n1p4] Jul 21 08:54:07.742146 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.742069 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 08:54:07.747356 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.747241 2564 manager.go:216] Machine: {Timestamp:2026-07-21 08:54:07.745879775 +0000 UTC m=+0.305412324 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3118646 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28eac3938499f537f7b4c8a2bff16f SystemUUID:ec28eac3-9384-99f5-37f7-b4c8a2bff16f BootID:661d9da3-28d1-4ca5-8edc-de59dbc6df9e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:81:77:43:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:81:77:43:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:40:b6:c6:94:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 08:54:07.747356 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.747348 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 08:54:07.747544 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.747505 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 08:54:07.748820 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.748803 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 08:54:07.750329 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.750301 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 08:54:07.750465 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.750333 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-119.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 08:54:07.751050 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.751039 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 08:54:07.751050 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.751052 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 08:54:07.751123 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.751059 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 08:54:07.751685 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.751674 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 08:54:07.752727 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.752716 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 08:54:07.756377 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756366 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 21 08:54:07.756490 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756480 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 08:54:07.756542 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756508 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 21 08:54:07.756542 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756518 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 08:54:07.756595 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756551 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 08:54:07.756595 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756563 2564 kubelet.go:398] "Adding apiserver pod source" Jul 21 08:54:07.756595 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756572 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 08:54:07.756906 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756895 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 08:54:07.756950 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.756914 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 08:54:07.758767 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.758753 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 08:54:07.759977 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.759961 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 08:54:07.760019 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.759995 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 08:54:07.760519 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760505 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 08:54:07.760519 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760520 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 08:54:07.760651 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760527 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 08:54:07.760651 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760555 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 08:54:07.760651 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760565 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 08:54:07.760651 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760571 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 08:54:07.760754 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760739 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 08:54:07.760754 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760746 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 08:54:07.760754 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760752 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 08:54:07.760841 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760757 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 08:54:07.760841 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760766 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 08:54:07.760841 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.760773 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 08:54:07.761491 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.761480 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 08:54:07.761491 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.761489 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 08:54:07.764740 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.764722 2564 server.go:1268] "Started kubelet" Jul 21 08:54:07.764833 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.764792 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 08:54:07.764882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.764803 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 08:54:07.764946 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.764880 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 08:54:07.768681 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.768659 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 08:54:07.769019 ip-10-0-133-119 systemd[1]: Started Kubernetes Kubelet. Jul 21 08:54:07.770118 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.770097 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlwrc" Jul 21 08:54:07.771968 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.771948 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 21 08:54:07.772245 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.772195 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 08:54:07.772463 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.772446 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-119.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 08:54:07.773046 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.773012 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 08:54:07.773361 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.773339 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 08:54:07.776626 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.775693 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-119.ec2.internal.18c4421db8a270c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-119.ec2.internal,UID:ip-10-0-133-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-119.ec2.internal,},FirstTimestamp:2026-07-21 08:54:07.764697284 +0000 UTC m=+0.324229832,LastTimestamp:2026-07-21 08:54:07.764697284 +0000 UTC m=+0.324229832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-119.ec2.internal,}" Jul 21 08:54:07.777101 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.777087 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vlwrc" Jul 21 08:54:07.777487 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.777476 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 08:54:07.777551 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.777488 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 08:54:07.777605 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.777590 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:07.778068 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778051 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 08:54:07.778174 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778163 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 08:54:07.778323 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778051 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 08:54:07.778389 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778324 2564 factory.go:55] Registering systemd factory Jul 21 08:54:07.778389 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778351 2564 factory.go:223] Registration of the systemd container factory successfully Jul 21 08:54:07.778389 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778380 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 21 08:54:07.778389 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778387 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 21 08:54:07.778622 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778607 2564 factory.go:153] Registering CRI-O factory Jul 21 08:54:07.778654 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778625 2564 factory.go:223] Registration of the crio container factory successfully Jul 21 08:54:07.778686 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778673 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 08:54:07.778715 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778699 2564 factory.go:103] Registering Raw factory Jul 21 08:54:07.778744 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.778715 2564 manager.go:1196] Started watching for new ooms in manager Jul 21 08:54:07.779605 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.779588 2564 manager.go:349] Starting recovery of all containers Jul 21 08:54:07.781444 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.781424 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 08:54:07.781567 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:07.781516 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 08:54:07.789291 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.789274 2564 manager.go:354] Recovery completed Jul 21 08:54:07.793627 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.793614 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:07.795962 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.795943 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:07.796029 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.795973 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:07.796029 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.795982 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:07.796984 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.796776 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 08:54:07.796984 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.796789 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 08:54:07.796984 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.796807 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 21 08:54:07.797773 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.797758 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:07.798824 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.798794 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:07.798898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.798829 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:07.798898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.798843 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:07.798960 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.798841 2564 policy_none.go:49] "None policy: Start" Jul 21 08:54:07.798960 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.798928 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 08:54:07.798960 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.798942 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 08:54:07.800879 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:07.800867 2564 policy_none.go:47] "Start" Jul 21 08:54:08.898675 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.898483 2564 manager.go:337] "Starting Device Plugin manager" Jul 21 08:54:08.898792 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:08.898708 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 08:54:08.898792 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.898722 2564 server.go:87] "Starting device plugin registration server" Jul 21 08:54:08.899023 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.899002 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 08:54:08.899102 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.899018 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 08:54:08.899212 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.899126 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 08:54:08.899269 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.899213 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 08:54:08.899269 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.899223 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 08:54:08.899729 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:08.899709 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 08:54:08.899803 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:08.899763 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:08.999428 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:08.999393 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:09.001607 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.000429 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:09.001607 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.000470 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:09.001607 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.000484 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:09.001607 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.000513 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.006701 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.006685 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.006763 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.006709 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-119.ec2.internal\": node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.012470 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.012445 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 08:54:09.013656 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.013640 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 08:54:09.013728 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.013684 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 08:54:09.013728 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.013714 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 08:54:09.013822 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.013754 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 08:54:09.017669 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.017651 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:09.023644 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.023629 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.114128 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.114088 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal"] Jul 21 08:54:09.114266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.114187 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:09.115739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.115723 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:09.115834 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.115755 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:09.115834 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.115769 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:09.118101 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.118084 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:09.118213 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.118197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.118266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.118231 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:09.120372 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.120358 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:09.120463 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.120382 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:09.120463 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.120359 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:09.120463 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.120391 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:09.120463 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.120409 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:09.120463 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.120422 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:09.122637 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.122621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.122717 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.122650 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 08:54:09.123321 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.123305 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientMemory" Jul 21 08:54:09.123382 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.123341 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 08:54:09.123382 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.123356 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeHasSufficientPID" Jul 21 08:54:09.124628 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.124614 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.133619 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.133593 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd466fb0c68344ab9b50ddd1aa85785-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal\" (UID: \"2cd466fb0c68344ab9b50ddd1aa85785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.133698 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.133626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6ae4102a8a8f6bbe6a8e1b8ed09059a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-119.ec2.internal\" (UID: \"a6ae4102a8a8f6bbe6a8e1b8ed09059a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.133698 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.133643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd466fb0c68344ab9b50ddd1aa85785-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal\" (UID: \"2cd466fb0c68344ab9b50ddd1aa85785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.147553 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.147531 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-119.ec2.internal\" not found" node="ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.151963 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.151936 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-119.ec2.internal\" not found" node="ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.225655 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.225612 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.234532 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.234505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd466fb0c68344ab9b50ddd1aa85785-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal\" (UID: \"2cd466fb0c68344ab9b50ddd1aa85785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.234532 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.234533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd466fb0c68344ab9b50ddd1aa85785-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal\" (UID: \"2cd466fb0c68344ab9b50ddd1aa85785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.234738 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.234549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6ae4102a8a8f6bbe6a8e1b8ed09059a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-119.ec2.internal\" (UID: \"a6ae4102a8a8f6bbe6a8e1b8ed09059a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.234738 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.234591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a6ae4102a8a8f6bbe6a8e1b8ed09059a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-119.ec2.internal\" (UID: \"a6ae4102a8a8f6bbe6a8e1b8ed09059a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.234738 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.234616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cd466fb0c68344ab9b50ddd1aa85785-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal\" (UID: \"2cd466fb0c68344ab9b50ddd1aa85785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.234738 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.234615 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cd466fb0c68344ab9b50ddd1aa85785-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal\" (UID: \"2cd466fb0c68344ab9b50ddd1aa85785\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.326051 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.325946 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.426479 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.426436 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.449000 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.448980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.455175 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.455116 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" Jul 21 08:54:09.527600 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.527563 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.628146 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.628079 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.728658 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.728630 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.772094 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.772072 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 08:54:09.772477 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.772207 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 08:54:09.815298 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.815271 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:09.828855 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.828827 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:09.835621 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.835591 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 08:49:08 +0000 UTC" deadline="2028-03-29 09:31:21.658176424 +0000 UTC" Jul 21 08:54:09.835621 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:09.835621 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14808h37m11.822559943s" Jul 21 08:54:09.929103 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:09.929076 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:10.004405 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:10.004373 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd466fb0c68344ab9b50ddd1aa85785.slice/crio-08a3cf4491a2d753079b5de5116c8fc998967a1d497716553c9c0ef1413cc5fa WatchSource:0}: Error finding container 08a3cf4491a2d753079b5de5116c8fc998967a1d497716553c9c0ef1413cc5fa: Status 404 returned error can't find the container with id 08a3cf4491a2d753079b5de5116c8fc998967a1d497716553c9c0ef1413cc5fa Jul 21 08:54:10.004719 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:10.004696 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ae4102a8a8f6bbe6a8e1b8ed09059a.slice/crio-025a9c778b6f8305bad55e70b18f58a372e3883faf68948db7ca49d9bfb74aea WatchSource:0}: Error finding container 025a9c778b6f8305bad55e70b18f58a372e3883faf68948db7ca49d9bfb74aea: Status 404 returned error can't find the container with id 025a9c778b6f8305bad55e70b18f58a372e3883faf68948db7ca49d9bfb74aea Jul 21 08:54:10.009692 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.009677 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 08:54:10.017682 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.017647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" event={"ID":"a6ae4102a8a8f6bbe6a8e1b8ed09059a","Type":"ContainerStarted","Data":"025a9c778b6f8305bad55e70b18f58a372e3883faf68948db7ca49d9bfb74aea"} Jul 21 08:54:10.018768 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.018746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" event={"ID":"2cd466fb0c68344ab9b50ddd1aa85785","Type":"ContainerStarted","Data":"08a3cf4491a2d753079b5de5116c8fc998967a1d497716553c9c0ef1413cc5fa"} Jul 21 08:54:10.029447 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:10.029427 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-119.ec2.internal\" not found" Jul 21 08:54:10.128657 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.128627 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:10.131856 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.131838 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" Jul 21 08:54:10.142364 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.142319 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 08:54:10.144004 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.143993 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" Jul 21 08:54:10.154373 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.154357 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 08:54:10.347991 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.347962 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:10.811356 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.811314 2564 apiserver.go:52] "Watching apiserver" Jul 21 08:54:10.819752 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.819727 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 08:54:10.820181 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.820158 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal","openshift-multus/multus-additional-cni-plugins-khzlq","openshift-multus/network-metrics-daemon-zgdhz","openshift-network-operator/iptables-alerter-8xzpv","openshift-ovn-kubernetes/ovnkube-node-th279","kube-system/global-pull-secret-syncer-brfrx","kube-system/konnectivity-agent-846ck","kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal","openshift-dns/node-resolver-kxh4b","openshift-multus/multus-j9lzw","openshift-network-diagnostics/network-check-target-ndszr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s","openshift-cluster-node-tuning-operator/tuned-27kpr","openshift-image-registry/node-ca-hmpbk"] Jul 21 08:54:10.822745 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.822709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.825337 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.825316 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 08:54:10.825439 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.825408 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ppmd7\"" Jul 21 08:54:10.825609 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.825590 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 08:54:10.825713 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.825634 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.827631 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.827610 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:10.827720 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:10.827697 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:10.828378 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.828358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grjnq\"" Jul 21 08:54:10.828554 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.828538 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.828614 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.828580 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.830456 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.830436 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.832048 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.832023 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 08:54:10.832972 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.832939 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.832972 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.832965 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r8nzf\"" Jul 21 08:54:10.833366 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.833345 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 08:54:10.833484 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.833464 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.833543 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.833482 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.835523 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.835266 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 08:54:10.835664 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.835648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 08:54:10.835798 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.835776 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vrnjl\"" Jul 21 08:54:10.836358 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.836338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:10.839573 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:10.836430 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:10.839573 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.837074 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.839573 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.837229 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 08:54:10.839573 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.837750 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.839844 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.839624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:10.841144 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.841122 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 08:54:10.842443 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.842421 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.842629 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.842606 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.842629 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.842626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dzr2v\"" Jul 21 08:54:10.842762 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.842671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovnkube-script-lib\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysconfig\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-var-lib-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovnkube-config\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-host\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpjvg\" (UniqueName: \"kubernetes.io/projected/b8a0eab6-967d-4fc5-9259-587495db7f54-kube-api-access-hpjvg\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xzd4\" (UniqueName: \"kubernetes.io/projected/82170038-0c50-4b51-a029-0a131d44d9f2-kube-api-access-7xzd4\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843278 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-ovn\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843301 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-env-overrides\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-modprobe-d\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-kubernetes\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysctl-conf\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-lib-modules\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-run-ovn-kubernetes\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.843659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d-agent-certs\") pod \"konnectivity-agent-846ck\" (UID: \"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d\") " pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysctl-d\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843494 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-systemd\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-tuned\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-log-socket\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-cni-netd\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-sys\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7hkz\" (UniqueName: \"kubernetes.io/projected/e08b2d0e-e440-4a23-9f99-13227f98a428-kube-api-access-j7hkz\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82170038-0c50-4b51-a029-0a131d44d9f2-host-slash\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-etc-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843771 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d-konnectivity-ca\") pod \"konnectivity-agent-846ck\" (UID: \"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d\") " pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-var-lib-kubelet\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843841 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-slash\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843863 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-node-log\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-run\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.843933 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82170038-0c50-4b51-a029-0a131d44d9f2-iptables-alerter-script\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.844478 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-systemd-units\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-run-netns\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-systemd\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-cni-bin\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844114 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovn-node-metrics-cert\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xdhb\" (UniqueName: \"kubernetes.io/projected/1156f322-ce2d-4daf-9dd0-51ee525f042b-kube-api-access-7xdhb\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8a0eab6-967d-4fc5-9259-587495db7f54-tmp\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-kubelet\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.844939 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.845322 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.845287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.845909 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.845887 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.846022 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.846006 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 08:54:10.846092 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.846015 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 08:54:10.846154 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.846120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bthfq\"" Jul 21 08:54:10.847807 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.847790 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.848517 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.848497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.848626 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.848526 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l56ls\"" Jul 21 08:54:10.848911 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.848755 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 08:54:10.848911 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.848811 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 08:54:10.848911 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.848821 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.849251 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.849232 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 08:54:10.850669 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.850652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:10.850749 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:10.850724 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:10.851186 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.851164 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n26j2\"" Jul 21 08:54:10.851278 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.851164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 08:54:10.852750 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.852729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.855310 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.855290 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 08:54:10.855425 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.855404 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 08:54:10.855531 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.855512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vqdgp\"" Jul 21 08:54:10.855718 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.855700 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 08:54:10.867298 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.867276 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqz5h" Jul 21 08:54:10.876180 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.876159 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nqz5h" Jul 21 08:54:10.932774 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.932753 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 08:54:10.944426 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944399 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d-konnectivity-ca\") pod \"konnectivity-agent-846ck\" (UID: \"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d\") " pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.944579 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-var-lib-kubelet\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.944647 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944599 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-var-lib-kubelet\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.944647 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-slash\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.944743 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk22v\" (UniqueName: \"kubernetes.io/projected/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-kube-api-access-gk22v\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:10.944743 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d386336a-956d-49bb-b5de-b454b9273c07-host\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:10.944743 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:10.944743 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82170038-0c50-4b51-a029-0a131d44d9f2-iptables-alerter-script\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-systemd-units\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-cni-bin\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944770 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-slash\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-netns\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-cni-bin\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-etc-kubernetes\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944870 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-systemd-units\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-system-cni-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8a0eab6-967d-4fc5-9259-587495db7f54-tmp\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-hosts-file\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:10.945003 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.944975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-multus-certs\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945024 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d-konnectivity-ca\") pod \"konnectivity-agent-846ck\" (UID: \"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d\") " pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23ce847a-6a34-4f52-a0c6-cda4d74e720c-dbus\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-var-lib-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-registration-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-host\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945223 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:10.945423 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945435 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/82170038-0c50-4b51-a029-0a131d44d9f2-iptables-alerter-script\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:10.945470 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:11.44545561 +0000 UTC m=+2.951568831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945496 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-var-lib-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.945594 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-host\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-env-overrides\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-env-overrides\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-daemon-config\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgchk\" (UniqueName: \"kubernetes.io/projected/d386336a-956d-49bb-b5de-b454b9273c07-kube-api-access-wgchk\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23ce847a-6a34-4f52-a0c6-cda4d74e720c-kubelet-config\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-modprobe-d\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-kubernetes\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-kubernetes\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysctl-conf\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945940 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-modprobe-d\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-lib-modules\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.945992 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-system-cni-dir\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-cni-multus\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb6ws\" (UniqueName: \"kubernetes.io/projected/655a93a7-f1ce-430c-88fb-83dbc8978c6c-kube-api-access-vb6ws\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysctl-d\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysctl-conf\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-systemd\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-systemd\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-log-socket\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946188 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysctl-d\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-cni-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-lib-modules\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-k8s-cni-cncf-io\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946244 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-log-socket\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-device-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-sys\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-cni-binary-copy\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946324 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-sys\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946323 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-hostroot\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-socket-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-node-log\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-os-release\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.946971 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-run\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946460 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-run-netns\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-node-log\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-systemd\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovn-node-metrics-cert\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xdhb\" (UniqueName: \"kubernetes.io/projected/1156f322-ce2d-4daf-9dd0-51ee525f042b-kube-api-access-7xdhb\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8275p\" (UniqueName: \"kubernetes.io/projected/59c57551-9bff-4969-9b78-36ec3e3ec13c-kube-api-access-8275p\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-kubelet\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-run\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovnkube-script-lib\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-tuning-conf-dir\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-cni-bin\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-conf-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysconfig\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovnkube-config\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.947772 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpjvg\" (UniqueName: \"kubernetes.io/projected/b8a0eab6-967d-4fc5-9259-587495db7f54-kube-api-access-hpjvg\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xzd4\" (UniqueName: \"kubernetes.io/projected/82170038-0c50-4b51-a029-0a131d44d9f2-kube-api-access-7xzd4\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-ovn\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbdpf\" (UniqueName: \"kubernetes.io/projected/7d981685-8ff8-467f-a909-24bfb7879462-kube-api-access-mbdpf\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-run-ovn-kubernetes\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-tmp-dir\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-run-netns\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946916 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-cnibin\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.946976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-cnibin\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d-agent-certs\") pod \"konnectivity-agent-846ck\" (UID: \"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d\") " pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947033 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-sysconfig\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947069 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-systemd\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947111 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-kubelet\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947154 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947213 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-run-ovn\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.948593 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-tuned\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-cni-netd\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/655a93a7-f1ce-430c-88fb-83dbc8978c6c-cni-binary-copy\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947321 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-run-ovn-kubernetes\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947355 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-host-cni-netd\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-sys-fs\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947477 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d386336a-956d-49bb-b5de-b454b9273c07-serviceca\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovnkube-script-lib\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7hkz\" (UniqueName: \"kubernetes.io/projected/e08b2d0e-e440-4a23-9f99-13227f98a428-kube-api-access-j7hkz\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82170038-0c50-4b51-a029-0a131d44d9f2-host-slash\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947606 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-etc-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947631 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-os-release\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-socket-dir-parent\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947667 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82170038-0c50-4b51-a029-0a131d44d9f2-host-slash\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-kubelet\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:10.949403 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovnkube-config\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.950255 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.947763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1156f322-ce2d-4daf-9dd0-51ee525f042b-etc-openvswitch\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.950255 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.949369 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8a0eab6-967d-4fc5-9259-587495db7f54-tmp\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.950255 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.949548 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b8a0eab6-967d-4fc5-9259-587495db7f54-etc-tuned\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:10.950255 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.949732 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1156f322-ce2d-4daf-9dd0-51ee525f042b-ovn-node-metrics-cert\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.950255 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.949798 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d-agent-certs\") pod \"konnectivity-agent-846ck\" (UID: \"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d\") " pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:10.959600 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.959521 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7hkz\" (UniqueName: \"kubernetes.io/projected/e08b2d0e-e440-4a23-9f99-13227f98a428-kube-api-access-j7hkz\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:10.959600 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.959588 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xzd4\" (UniqueName: \"kubernetes.io/projected/82170038-0c50-4b51-a029-0a131d44d9f2-kube-api-access-7xzd4\") pod \"iptables-alerter-8xzpv\" (UID: \"82170038-0c50-4b51-a029-0a131d44d9f2\") " pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:10.959765 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.959611 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xdhb\" (UniqueName: \"kubernetes.io/projected/1156f322-ce2d-4daf-9dd0-51ee525f042b-kube-api-access-7xdhb\") pod \"ovnkube-node-th279\" (UID: \"1156f322-ce2d-4daf-9dd0-51ee525f042b\") " pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:10.960841 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:10.960822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpjvg\" (UniqueName: \"kubernetes.io/projected/b8a0eab6-967d-4fc5-9259-587495db7f54-kube-api-access-hpjvg\") pod \"tuned-27kpr\" (UID: \"b8a0eab6-967d-4fc5-9259-587495db7f54\") " pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:11.048180 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-cni-binary-copy\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.048180 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-hostroot\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-socket-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-os-release\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-hostroot\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8275p\" (UniqueName: \"kubernetes.io/projected/59c57551-9bff-4969-9b78-36ec3e3ec13c-kube-api-access-8275p\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-tuning-conf-dir\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-cni-bin\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048338 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-os-release\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-conf-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048387 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-conf-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048391 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-socket-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-etc-selinux\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.048423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbdpf\" (UniqueName: \"kubernetes.io/projected/7d981685-8ff8-467f-a909-24bfb7879462-kube-api-access-mbdpf\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-tmp-dir\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-cni-bin\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-cnibin\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-tuning-conf-dir\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-cnibin\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-cnibin\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-cnibin\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/655a93a7-f1ce-430c-88fb-83dbc8978c6c-cni-binary-copy\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-sys-fs\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d386336a-956d-49bb-b5de-b454b9273c07-serviceca\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-os-release\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048847 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-tmp-dir\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-socket-dir-parent\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048973 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-sys-fs\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049019 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-kubelet\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049106 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-kubelet\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk22v\" (UniqueName: \"kubernetes.io/projected/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-kube-api-access-gk22v\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d386336a-956d-49bb-b5de-b454b9273c07-host\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d386336a-956d-49bb-b5de-b454b9273c07-host\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049268 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-os-release\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049353 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/655a93a7-f1ce-430c-88fb-83dbc8978c6c-cni-binary-copy\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.048781 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d386336a-956d-49bb-b5de-b454b9273c07-serviceca\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-netns\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049392 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-cni-binary-copy\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-etc-kubernetes\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-system-cni-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.049859 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-hosts-file\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.049807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-netns\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.050023 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050091 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-etc-kubernetes\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-hosts-file\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.050147 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:54:11.550126173 +0000 UTC m=+3.056239395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-multus-certs\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-socket-dir-parent\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23ce847a-6a34-4f52-a0c6-cda4d74e720c-dbus\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-registration-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-system-cni-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-daemon-config\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050375 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-multus-certs\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23ce847a-6a34-4f52-a0c6-cda4d74e720c-dbus\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:11.050474 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050410 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7d981685-8ff8-467f-a909-24bfb7879462-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-registration-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgchk\" (UniqueName: \"kubernetes.io/projected/d386336a-956d-49bb-b5de-b454b9273c07-kube-api-access-wgchk\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23ce847a-6a34-4f52-a0c6-cda4d74e720c-kubelet-config\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-system-cni-dir\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-cni-multus\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb6ws\" (UniqueName: \"kubernetes.io/projected/655a93a7-f1ce-430c-88fb-83dbc8978c6c-kube-api-access-vb6ws\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-cni-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050778 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-var-lib-cni-multus\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050796 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-k8s-cni-cncf-io\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-device-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050862 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d981685-8ff8-467f-a909-24bfb7879462-system-cni-dir\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.050734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23ce847a-6a34-4f52-a0c6-cda4d74e720c-kubelet-config\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.051017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-cni-dir\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.051113 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/655a93a7-f1ce-430c-88fb-83dbc8978c6c-host-run-k8s-cni-cncf-io\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.051189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.051114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59c57551-9bff-4969-9b78-36ec3e3ec13c-device-dir\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.051818 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.051595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/655a93a7-f1ce-430c-88fb-83dbc8978c6c-multus-daemon-config\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.054830 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.054807 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:11.054830 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.054831 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:11.054986 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.054844 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:11.054986 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.054916 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:11.554899577 +0000 UTC m=+3.061012814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:11.057385 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.057362 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8275p\" (UniqueName: \"kubernetes.io/projected/59c57551-9bff-4969-9b78-36ec3e3ec13c-kube-api-access-8275p\") pod \"aws-ebs-csi-driver-node-gtd5s\" (UID: \"59c57551-9bff-4969-9b78-36ec3e3ec13c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.057917 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.057897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbdpf\" (UniqueName: \"kubernetes.io/projected/7d981685-8ff8-467f-a909-24bfb7879462-kube-api-access-mbdpf\") pod \"multus-additional-cni-plugins-khzlq\" (UID: \"7d981685-8ff8-467f-a909-24bfb7879462\") " pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.058102 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.058074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk22v\" (UniqueName: \"kubernetes.io/projected/b98ae77d-01f1-4ccb-9e78-0c22b54f56ab-kube-api-access-gk22v\") pod \"node-resolver-kxh4b\" (UID: \"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab\") " pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.060108 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.060086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgchk\" (UniqueName: \"kubernetes.io/projected/d386336a-956d-49bb-b5de-b454b9273c07-kube-api-access-wgchk\") pod \"node-ca-hmpbk\" (UID: \"d386336a-956d-49bb-b5de-b454b9273c07\") " pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.060899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.060875 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb6ws\" (UniqueName: \"kubernetes.io/projected/655a93a7-f1ce-430c-88fb-83dbc8978c6c-kube-api-access-vb6ws\") pod \"multus-j9lzw\" (UID: \"655a93a7-f1ce-430c-88fb-83dbc8978c6c\") " pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.136262 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.136180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:11.144925 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.144902 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-27kpr" Jul 21 08:54:11.156163 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.156135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8xzpv" Jul 21 08:54:11.169994 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.169964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:11.178915 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.178882 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxh4b" Jul 21 08:54:11.179574 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.179557 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 08:54:11.185812 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.185788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hmpbk" Jul 21 08:54:11.194524 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.194497 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-khzlq" Jul 21 08:54:11.202303 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.202278 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9lzw" Jul 21 08:54:11.206943 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.206922 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" Jul 21 08:54:11.454019 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.453989 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:11.454218 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.454118 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:11.454218 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.454184 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:12.45416597 +0000 UTC m=+3.960279205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:11.554380 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.554350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:11.554544 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.554512 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:11.554582 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.554577 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:54:12.554557606 +0000 UTC m=+4.060670828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:11.654682 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.654646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:11.654858 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.654837 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:11.654918 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.654863 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:11.654918 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.654873 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:11.655031 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:11.654922 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:12.654907528 +0000 UTC m=+4.161020754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:11.877621 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.877592 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82170038_0c50_4b51_a029_0a131d44d9f2.slice/crio-bdd664fa93e23620a770de057d6af8a8f0f1e4d278a23c1c72fc720559de9910 WatchSource:0}: Error finding container bdd664fa93e23620a770de057d6af8a8f0f1e4d278a23c1c72fc720559de9910: Status 404 returned error can't find the container with id bdd664fa93e23620a770de057d6af8a8f0f1e4d278a23c1c72fc720559de9910 Jul 21 08:54:11.879039 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.878924 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 08:49:10 +0000 UTC" deadline="2028-01-15 05:11:29.516112161 +0000 UTC" Jul 21 08:54:11.879142 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:11.879041 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13028h17m17.637076081s" Jul 21 08:54:11.882539 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.882518 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d981685_8ff8_467f_a909_24bfb7879462.slice/crio-99e564b9d55a9df6a3cab4163ea303752290d61ec12504c25140c2df342e1375 WatchSource:0}: Error finding container 99e564b9d55a9df6a3cab4163ea303752290d61ec12504c25140c2df342e1375: Status 404 returned error can't find the container with id 99e564b9d55a9df6a3cab4163ea303752290d61ec12504c25140c2df342e1375 Jul 21 08:54:11.883186 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.883166 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655a93a7_f1ce_430c_88fb_83dbc8978c6c.slice/crio-a6c2c4275dc2265c4d27b6e14215a710e92423f4a99de34321ba6be95fd302db WatchSource:0}: Error finding container a6c2c4275dc2265c4d27b6e14215a710e92423f4a99de34321ba6be95fd302db: Status 404 returned error can't find the container with id a6c2c4275dc2265c4d27b6e14215a710e92423f4a99de34321ba6be95fd302db Jul 21 08:54:11.884426 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.884326 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fdae8f_fd1f_45f7_8948_2a11b86cfe9d.slice/crio-36607b2417ac4a89aa1beafab9372ee4073c4ae1630d5f69eb23d346ba2ebe51 WatchSource:0}: Error finding container 36607b2417ac4a89aa1beafab9372ee4073c4ae1630d5f69eb23d346ba2ebe51: Status 404 returned error can't find the container with id 36607b2417ac4a89aa1beafab9372ee4073c4ae1630d5f69eb23d346ba2ebe51 Jul 21 08:54:11.886539 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.886471 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c57551_9bff_4969_9b78_36ec3e3ec13c.slice/crio-27f969c2bb849efe41c60a8518846631e3edf164ed7b61ec7136d1684f43955b WatchSource:0}: Error finding container 27f969c2bb849efe41c60a8518846631e3edf164ed7b61ec7136d1684f43955b: Status 404 returned error can't find the container with id 27f969c2bb849efe41c60a8518846631e3edf164ed7b61ec7136d1684f43955b Jul 21 08:54:11.887601 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.887581 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1156f322_ce2d_4daf_9dd0_51ee525f042b.slice/crio-faf3a545020558f0c5e8725a8b857004fb4e42b7e5d131d68c65ea572c7b6735 WatchSource:0}: Error finding container faf3a545020558f0c5e8725a8b857004fb4e42b7e5d131d68c65ea572c7b6735: Status 404 returned error can't find the container with id faf3a545020558f0c5e8725a8b857004fb4e42b7e5d131d68c65ea572c7b6735 Jul 21 08:54:11.887968 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.887928 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a0eab6_967d_4fc5_9259_587495db7f54.slice/crio-b67ba791f5f8b45bc8e19127b16321909ce94e4bc8eaa29bc4ba68bde0bcdeb9 WatchSource:0}: Error finding container b67ba791f5f8b45bc8e19127b16321909ce94e4bc8eaa29bc4ba68bde0bcdeb9: Status 404 returned error can't find the container with id b67ba791f5f8b45bc8e19127b16321909ce94e4bc8eaa29bc4ba68bde0bcdeb9 Jul 21 08:54:11.889838 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.889816 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98ae77d_01f1_4ccb_9e78_0c22b54f56ab.slice/crio-0ceccf7f8421f2752b1acadbb9ec245f1ad713924ad321bc0053b4717557582e WatchSource:0}: Error finding container 0ceccf7f8421f2752b1acadbb9ec245f1ad713924ad321bc0053b4717557582e: Status 404 returned error can't find the container with id 0ceccf7f8421f2752b1acadbb9ec245f1ad713924ad321bc0053b4717557582e Jul 21 08:54:11.910871 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:54:11.910843 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd386336a_956d_49bb_b5de_b454b9273c07.slice/crio-e3f954cfb0e5e3c39d9c8dfe98feccd92a680c01c4001edc64054d2c85456cbd WatchSource:0}: Error finding container e3f954cfb0e5e3c39d9c8dfe98feccd92a680c01c4001edc64054d2c85456cbd: Status 404 returned error can't find the container with id e3f954cfb0e5e3c39d9c8dfe98feccd92a680c01c4001edc64054d2c85456cbd Jul 21 08:54:12.023601 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.023568 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" event={"ID":"a6ae4102a8a8f6bbe6a8e1b8ed09059a","Type":"ContainerStarted","Data":"ba68fd2224289a881bd179af2db800462b14a24f7b27785f43107c50c65c84b2"} Jul 21 08:54:12.024725 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.024697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hmpbk" event={"ID":"d386336a-956d-49bb-b5de-b454b9273c07","Type":"ContainerStarted","Data":"e3f954cfb0e5e3c39d9c8dfe98feccd92a680c01c4001edc64054d2c85456cbd"} Jul 21 08:54:12.025853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.025831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxh4b" event={"ID":"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab","Type":"ContainerStarted","Data":"0ceccf7f8421f2752b1acadbb9ec245f1ad713924ad321bc0053b4717557582e"} Jul 21 08:54:12.027075 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.027043 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-27kpr" event={"ID":"b8a0eab6-967d-4fc5-9259-587495db7f54","Type":"ContainerStarted","Data":"b67ba791f5f8b45bc8e19127b16321909ce94e4bc8eaa29bc4ba68bde0bcdeb9"} Jul 21 08:54:12.028370 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.028350 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"faf3a545020558f0c5e8725a8b857004fb4e42b7e5d131d68c65ea572c7b6735"} Jul 21 08:54:12.029707 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.029675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-846ck" event={"ID":"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d","Type":"ContainerStarted","Data":"36607b2417ac4a89aa1beafab9372ee4073c4ae1630d5f69eb23d346ba2ebe51"} Jul 21 08:54:12.030746 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.030725 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9lzw" event={"ID":"655a93a7-f1ce-430c-88fb-83dbc8978c6c","Type":"ContainerStarted","Data":"a6c2c4275dc2265c4d27b6e14215a710e92423f4a99de34321ba6be95fd302db"} Jul 21 08:54:12.031850 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.031831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xzpv" event={"ID":"82170038-0c50-4b51-a029-0a131d44d9f2","Type":"ContainerStarted","Data":"bdd664fa93e23620a770de057d6af8a8f0f1e4d278a23c1c72fc720559de9910"} Jul 21 08:54:12.032961 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.032923 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" event={"ID":"59c57551-9bff-4969-9b78-36ec3e3ec13c","Type":"ContainerStarted","Data":"27f969c2bb849efe41c60a8518846631e3edf164ed7b61ec7136d1684f43955b"} Jul 21 08:54:12.034261 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.034243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerStarted","Data":"99e564b9d55a9df6a3cab4163ea303752290d61ec12504c25140c2df342e1375"} Jul 21 08:54:12.041068 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.041016 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-119.ec2.internal" podStartSLOduration=2.041004552 podStartE2EDuration="2.041004552s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:12.040732449 +0000 UTC m=+3.546845822" watchObservedRunningTime="2026-07-21 08:54:12.041004552 +0000 UTC m=+3.547117794" Jul 21 08:54:12.463350 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.462700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:12.463350 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.462926 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:12.463350 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.463005 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:14.462986916 +0000 UTC m=+5.969100140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:12.564754 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.564174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:12.564754 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.564353 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:12.564754 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.564416 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:54:14.564398465 +0000 UTC m=+6.070511689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:12.664988 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.664934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:12.665177 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.665148 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:12.665177 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.665171 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:12.665284 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.665184 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:12.665284 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:12.665242 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:14.66522484 +0000 UTC m=+6.171338065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:12.882614 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.879877 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 08:49:10 +0000 UTC" deadline="2028-04-24 08:54:37.983285748 +0000 UTC" Jul 21 08:54:12.882614 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:12.879916 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15432h0m25.103375349s" Jul 21 08:54:13.014429 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:13.014397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:13.014590 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:13.014550 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:13.015013 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:13.014986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:13.015140 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:13.015111 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:13.015220 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:13.015205 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:13.015298 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:13.015279 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:13.050079 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:13.049866 2564 generic.go:356] "Generic (PLEG): container finished" podID="2cd466fb0c68344ab9b50ddd1aa85785" containerID="423604b8e8fc59866d9a394964c978a6398954680fd4fb987bbb1f2418c7c7b9" exitCode=0 Jul 21 08:54:13.050079 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:13.049996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" event={"ID":"2cd466fb0c68344ab9b50ddd1aa85785","Type":"ContainerDied","Data":"423604b8e8fc59866d9a394964c978a6398954680fd4fb987bbb1f2418c7c7b9"} Jul 21 08:54:14.073391 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:14.073355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" event={"ID":"2cd466fb0c68344ab9b50ddd1aa85785","Type":"ContainerStarted","Data":"2a1f9d00a4b028956a328003b1487e63e175e0a8de3272c3a87e50f0392e8581"} Jul 21 08:54:14.481554 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:14.481517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:14.481741 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.481683 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:14.481808 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.481751 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:18.481731472 +0000 UTC m=+9.987844737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:14.582385 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:14.582345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:14.582559 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.582513 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:14.582615 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.582580 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:54:18.582561223 +0000 UTC m=+10.088674466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:14.682731 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:14.682690 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:14.682974 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.682942 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:14.683049 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.682986 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:14.683049 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.682999 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:14.683154 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:14.683058 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:18.683038418 +0000 UTC m=+10.189151663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:15.015307 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:15.014226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:15.015307 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:15.014356 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:15.015307 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:15.014465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:15.015307 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:15.014584 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:15.015307 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:15.014639 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:15.015307 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:15.014710 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:17.014886 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:17.014371 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:17.014886 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:17.014389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:17.014886 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:17.014407 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:17.014886 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:17.014501 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:17.014886 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:17.014662 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:17.014886 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:17.014746 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:18.515547 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:18.515504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:18.516028 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.515667 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:18.516028 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.515731 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:26.5157117 +0000 UTC m=+18.021824928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:18.616808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:18.616768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:18.617003 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.616925 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:18.617064 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.617012 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:54:26.616993381 +0000 UTC m=+18.123106624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:18.718094 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:18.718053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:18.718280 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.718207 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:18.718280 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.718230 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:18.718280 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.718243 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:18.718445 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:18.718311 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:26.718290873 +0000 UTC m=+18.224404096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:19.015481 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:19.015362 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:19.015662 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:19.015486 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:19.015962 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:19.015794 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:19.015962 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:19.015829 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:19.015962 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:19.015907 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:19.016191 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:19.016010 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:21.015055 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:21.014983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:21.015055 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:21.015000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:21.015592 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:21.014983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:21.015592 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:21.015104 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:21.015592 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:21.015205 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:21.015592 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:21.015364 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:23.014365 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:23.014324 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:23.014365 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:23.014361 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:23.014849 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:23.014330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:23.014849 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:23.014468 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:23.014849 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:23.014522 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:23.014849 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:23.014599 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:25.014187 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:25.014144 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:25.014187 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:25.014155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:25.014673 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:25.014155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:25.014673 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:25.014278 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:25.014673 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:25.014374 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:25.014673 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:25.014457 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:26.581701 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:26.581615 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:26.582209 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.581763 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:26.582209 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.581839 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:42.581817057 +0000 UTC m=+34.087930295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:26.682597 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:26.682556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:26.682791 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.682684 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:26.682791 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.682738 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:54:42.68272414 +0000 UTC m=+34.188837361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:26.783365 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:26.783332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:26.783537 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.783496 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:26.783537 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.783523 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:26.783537 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.783536 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:26.783689 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:26.783593 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:54:42.783577249 +0000 UTC m=+34.289690514 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:27.014607 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:27.014572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:27.014782 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:27.014620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:27.014782 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:27.014572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:27.014782 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:27.014714 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:27.014782 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:27.014756 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:27.014995 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:27.014824 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:29.015288 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:29.015247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:29.015744 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:29.015351 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:29.015744 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:29.015376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:29.015744 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:29.015394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:29.015744 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:29.015476 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:29.015744 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:29.015548 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:31.014214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.014041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:31.014643 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.014041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:31.014643 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:31.014294 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:31.014643 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.014098 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:31.014643 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:31.014377 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:31.014643 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:31.014431 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:31.108607 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.108531 2564 generic.go:356] "Generic (PLEG): container finished" podID="7d981685-8ff8-467f-a909-24bfb7879462" containerID="d82f9859347be6d8c146ad95572e08e67c1c788c31e365cdf1b80f8d507ca13a" exitCode=0 Jul 21 08:54:31.108743 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.108606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerDied","Data":"d82f9859347be6d8c146ad95572e08e67c1c788c31e365cdf1b80f8d507ca13a"} Jul 21 08:54:31.110060 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.110035 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hmpbk" event={"ID":"d386336a-956d-49bb-b5de-b454b9273c07","Type":"ContainerStarted","Data":"edf7d116464703ca5bd8b4b24b0d7f7156c0dc8508e9c218b6976c015ebce4e6"} Jul 21 08:54:31.114006 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.113982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxh4b" event={"ID":"b98ae77d-01f1-4ccb-9e78-0c22b54f56ab","Type":"ContainerStarted","Data":"3251496f7dd8e654b1a9e1ddceaa74e736d914fc182674d77ed3b952d00ba27c"} Jul 21 08:54:31.115656 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.115633 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-27kpr" event={"ID":"b8a0eab6-967d-4fc5-9259-587495db7f54","Type":"ContainerStarted","Data":"49ebee4d545484689dec00ae2b245a176dbebd29901e3d3f99eeb299d1e897ba"} Jul 21 08:54:31.117215 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.117185 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-846ck" event={"ID":"a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d","Type":"ContainerStarted","Data":"691d2316c48bd622f0523b6c061df9befed6d503560f4857482ce0990f741b13"} Jul 21 08:54:31.118863 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.118845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9lzw" event={"ID":"655a93a7-f1ce-430c-88fb-83dbc8978c6c","Type":"ContainerStarted","Data":"b8e627a8f3ce6590ec364d709f9d114b8d90d75af93f6a5beb023866deab0d40"} Jul 21 08:54:31.120344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.120325 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" event={"ID":"59c57551-9bff-4969-9b78-36ec3e3ec13c","Type":"ContainerStarted","Data":"53e55feaee82726a86e2a9446953c49446bb5d05e5e4d33c8600c491c931e693"} Jul 21 08:54:31.133168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.133126 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-119.ec2.internal" podStartSLOduration=21.133114525 podStartE2EDuration="21.133114525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:14.089275479 +0000 UTC m=+5.595388723" watchObservedRunningTime="2026-07-21 08:54:31.133114525 +0000 UTC m=+22.639227767" Jul 21 08:54:31.147117 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.147058 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hmpbk" podStartSLOduration=3.415694992 podStartE2EDuration="22.147041111s" totalImagesPullingTime="18.731346119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:31.146293179 +0000 UTC m=+22.652406425" watchObservedRunningTime="2026-07-21 08:54:31.147041111 +0000 UTC m=+22.653154355" Jul 21 08:54:31.161837 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.161794 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kxh4b" podStartSLOduration=3.423427117 podStartE2EDuration="22.161781293s" totalImagesPullingTime="18.738354176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:31.161287205 +0000 UTC m=+22.667400449" watchObservedRunningTime="2026-07-21 08:54:31.161781293 +0000 UTC m=+22.667894535" Jul 21 08:54:31.184972 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.184905 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j9lzw" podStartSLOduration=3.416303421 podStartE2EDuration="22.1848945s" totalImagesPullingTime="18.768591079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:31.184737166 +0000 UTC m=+22.690850408" watchObservedRunningTime="2026-07-21 08:54:31.1848945 +0000 UTC m=+22.691007743" Jul 21 08:54:31.200780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.200743 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-846ck" podStartSLOduration=3.455585934 podStartE2EDuration="22.200730054s" totalImagesPullingTime="18.74514412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:31.200253204 +0000 UTC m=+22.706366446" watchObservedRunningTime="2026-07-21 08:54:31.200730054 +0000 UTC m=+22.706843296" Jul 21 08:54:31.217176 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.217144 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-27kpr" podStartSLOduration=3.484788275 podStartE2EDuration="22.217131449s" totalImagesPullingTime="18.732343174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:31.217059228 +0000 UTC m=+22.723172471" watchObservedRunningTime="2026-07-21 08:54:31.217131449 +0000 UTC m=+22.723244692" Jul 21 08:54:31.845058 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.844794 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:31.845658 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:31.845634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:32.128640 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.128605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"7b707d7b63e668d20929fd4b2bfe3ea5c7d2ac2582616fb6dd5717d024fdf24f"} Jul 21 08:54:32.129344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.128701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"4aac69c563a9bca346f8f36b3056ee63fdca00becb22beb77037e2fb6d381243"} Jul 21 08:54:32.129344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.128751 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"98600f8fb09f7ec769c054c17e6c5b74d278ebba768abf906488144f9a612431"} Jul 21 08:54:32.129344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.128782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"caf2236adf347a0c817d7e7dd42c77969e074524012592b0d9983e94e5573a26"} Jul 21 08:54:32.129344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.128817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"8b2f4dfbd14b336a99cce98f36d59e69d01b95b53f85c2020deccbce582f08cb"} Jul 21 08:54:32.129344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.128864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"97316c27ae2b8ff4fe3ba73f5de03276ea5e7a820ab07836b070a90c52ef0a98"} Jul 21 08:54:32.130782 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.130754 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8xzpv" event={"ID":"82170038-0c50-4b51-a029-0a131d44d9f2","Type":"ContainerStarted","Data":"7a4370aab6028487bdd927562ed2f18e193bfd5e9bb049740016f47374c9bd91"} Jul 21 08:54:32.131626 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.131605 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:32.132137 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.132121 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-846ck" Jul 21 08:54:32.146702 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.146659 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8xzpv" podStartSLOduration=4.381687169 podStartE2EDuration="23.146643884s" totalImagesPullingTime="18.764956715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:32.14637238 +0000 UTC m=+23.652485624" watchObservedRunningTime="2026-07-21 08:54:32.146643884 +0000 UTC m=+23.652757127" Jul 21 08:54:32.327671 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.327634 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 08:54:32.915698 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.915569 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T08:54:32.327652345Z","UUID":"6d69581f-6ec1-4313-8906-4b16114de86a","Handler":null,"Name":"","Endpoint":""} Jul 21 08:54:32.917223 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.917191 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 08:54:32.917343 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:32.917236 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 08:54:33.014325 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:33.014292 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:33.014612 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:33.014303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:33.014612 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:33.014440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:33.014612 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:33.014441 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:33.014612 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:33.014536 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:33.014827 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:33.014612 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:33.135020 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:33.134982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" event={"ID":"59c57551-9bff-4969-9b78-36ec3e3ec13c","Type":"ContainerStarted","Data":"b0e9fa1ba04fdb3e80f40b5ab4e8c11a0e0c023004f3ad6aeaf7800fe2a0ecae"} Jul 21 08:54:34.139793 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:34.139764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" event={"ID":"59c57551-9bff-4969-9b78-36ec3e3ec13c","Type":"ContainerStarted","Data":"5101ec0483dbee6b9a0080cc3a56f787f569138dd0a9aab47fd04f3c09a39a42"} Jul 21 08:54:34.159916 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:34.159860 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gtd5s" podStartSLOduration=4.266552582 podStartE2EDuration="25.159838669s" totalImagesPullingTime="20.893286087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:34.159263802 +0000 UTC m=+25.665377065" watchObservedRunningTime="2026-07-21 08:54:34.159838669 +0000 UTC m=+25.665951916" Jul 21 08:54:35.014632 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:35.014594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:35.014836 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:35.014594 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:35.014836 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:35.014723 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:35.014836 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:35.014753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:35.015031 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:35.014875 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:35.015031 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:35.014981 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:36.147612 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:36.147423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"45486557571a4b47e01ea74b7b1e0c7afaae0be3d204309ab67d0c6555f2bc56"} Jul 21 08:54:36.149043 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:36.149009 2564 generic.go:356] "Generic (PLEG): container finished" podID="7d981685-8ff8-467f-a909-24bfb7879462" containerID="264e278df3721ef8ae73e0e8e7f3dc94e8f0e2e9cbf7ce1cd5efa66233af9e29" exitCode=0 Jul 21 08:54:36.149105 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:36.149056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerDied","Data":"264e278df3721ef8ae73e0e8e7f3dc94e8f0e2e9cbf7ce1cd5efa66233af9e29"} Jul 21 08:54:37.014844 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:37.014807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:37.015107 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:37.014807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:37.015107 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:37.014921 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:37.015107 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:37.014966 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:37.015107 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:37.015037 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:37.015107 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:37.015098 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:37.594025 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:37.593786 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxh4b_b98ae77d-01f1-4ccb-9e78-0c22b54f56ab/dns-node-resolver/0.log" Jul 21 08:54:38.156617 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.156573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-th279" event={"ID":"1156f322-ce2d-4daf-9dd0-51ee525f042b","Type":"ContainerStarted","Data":"6518d454050bbc9aa91f702a4a4b80789ca409e6bce2d38e2cf9d2355032f89b"} Jul 21 08:54:38.156888 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.156787 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:38.156888 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.156848 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:38.158840 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.158819 2564 generic.go:356] "Generic (PLEG): container finished" podID="7d981685-8ff8-467f-a909-24bfb7879462" containerID="ae745719b4da29729cc9243c90615a43509a9374887c3dfdb34a220ed6398f2d" exitCode=0 Jul 21 08:54:38.158933 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.158856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerDied","Data":"ae745719b4da29729cc9243c90615a43509a9374887c3dfdb34a220ed6398f2d"} Jul 21 08:54:38.174155 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.174125 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:38.186169 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.186125 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-th279" podStartSLOduration=9.883341652 podStartE2EDuration="29.186108427s" totalImagesPullingTime="19.302766775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:38.186067751 +0000 UTC m=+29.692180994" watchObservedRunningTime="2026-07-21 08:54:38.186108427 +0000 UTC m=+29.692221711" Jul 21 08:54:38.773208 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:38.773180 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hmpbk_d386336a-956d-49bb-b5de-b454b9273c07/node-ca/0.log" Jul 21 08:54:39.015661 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.015623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:39.015844 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:39.015713 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:39.015844 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.015787 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:39.015978 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:39.015912 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:39.016038 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.015987 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:39.016144 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:39.016108 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:39.165163 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.165131 2564 generic.go:356] "Generic (PLEG): container finished" podID="7d981685-8ff8-467f-a909-24bfb7879462" containerID="a086a05b9c0e0ea4a545d02dc0e86cad31841f452ee702e3477632ebd16f6870" exitCode=0 Jul 21 08:54:39.165375 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.165276 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerDied","Data":"a086a05b9c0e0ea4a545d02dc0e86cad31841f452ee702e3477632ebd16f6870"} Jul 21 08:54:39.165454 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.165436 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:39.184842 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.184816 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:54:39.435099 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.435066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-brfrx"] Jul 21 08:54:39.435263 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.435204 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:39.435321 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:39.435284 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:39.441592 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.441558 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ndszr"] Jul 21 08:54:39.441747 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.441658 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:39.441747 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:39.441730 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:39.448426 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.448367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zgdhz"] Jul 21 08:54:39.448820 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:39.448513 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:39.448820 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:39.448733 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:41.015160 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:41.014947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:41.015619 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:41.014963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:41.015619 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:41.015278 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:41.015619 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:41.014982 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:41.015619 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:41.015341 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:41.015619 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:41.015416 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:42.601826 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:42.601785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:42.602444 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.601976 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:42.602444 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.602060 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs podName:e08b2d0e-e440-4a23-9f99-13227f98a428 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:14.602038584 +0000 UTC m=+66.108151810 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs") pod "network-metrics-daemon-zgdhz" (UID: "e08b2d0e-e440-4a23-9f99-13227f98a428") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 08:54:42.703128 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:42.703090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:42.703302 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.703255 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:42.703354 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.703331 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret podName:23ce847a-6a34-4f52-a0c6-cda4d74e720c nodeName:}" failed. No retries permitted until 2026-07-21 08:55:14.703311262 +0000 UTC m=+66.209424485 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret") pod "global-pull-secret-syncer-brfrx" (UID: "23ce847a-6a34-4f52-a0c6-cda4d74e720c") : object "kube-system"/"original-pull-secret" not registered Jul 21 08:54:42.803457 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:42.803416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:42.803641 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.803605 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 08:54:42.803641 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.803632 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 08:54:42.803641 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.803642 2564 projected.go:196] Error preparing data for projected volume kube-api-access-lwtgd for pod openshift-network-diagnostics/network-check-target-ndszr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:42.803801 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:42.803693 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd podName:bf70dccc-a8b1-4129-b544-2243003907d0 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:14.8036787 +0000 UTC m=+66.309791924 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lwtgd" (UniqueName: "kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd") pod "network-check-target-ndszr" (UID: "bf70dccc-a8b1-4129-b544-2243003907d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 08:54:43.014148 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:43.014111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:43.014148 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:43.014147 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:43.014392 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:43.014111 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:43.014392 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:43.014247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:43.014513 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:43.014384 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:43.014513 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:43.014464 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:44.180552 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:44.180517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerStarted","Data":"bdd27df4edbabc1b0540b901931ef95f283ffce269c5e6803e740318c8994907"} Jul 21 08:54:45.014207 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:45.014176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:45.014419 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:45.014176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:45.014419 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:45.014276 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:45.014419 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:45.014372 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:45.014419 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:45.014175 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:45.014628 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:45.014448 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:45.185902 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:45.185873 2564 generic.go:356] "Generic (PLEG): container finished" podID="7d981685-8ff8-467f-a909-24bfb7879462" containerID="bdd27df4edbabc1b0540b901931ef95f283ffce269c5e6803e740318c8994907" exitCode=0 Jul 21 08:54:45.185902 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:45.185908 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerDied","Data":"bdd27df4edbabc1b0540b901931ef95f283ffce269c5e6803e740318c8994907"} Jul 21 08:54:46.190753 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:46.190720 2564 generic.go:356] "Generic (PLEG): container finished" podID="7d981685-8ff8-467f-a909-24bfb7879462" containerID="5be5aed1e60c9a0507657d433e66d2213ef50f606eb3a082e3dcbb236689a847" exitCode=0 Jul 21 08:54:46.191124 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:46.190773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerDied","Data":"5be5aed1e60c9a0507657d433e66d2213ef50f606eb3a082e3dcbb236689a847"} Jul 21 08:54:47.014770 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:47.014742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:47.014770 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:47.014744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:47.014969 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:47.014864 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:47.014969 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:47.014916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:47.015085 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:47.015011 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:47.015085 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:47.015047 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:47.196118 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:47.196084 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-khzlq" event={"ID":"7d981685-8ff8-467f-a909-24bfb7879462","Type":"ContainerStarted","Data":"5201a539b9d3125f4636e092dd2d752cdd2a7151eb7d6f55fabb72fd6d77e0d9"} Jul 21 08:54:47.219998 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:47.219934 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-khzlq" podStartSLOduration=8.231320496 podStartE2EDuration="38.219918951s" totalImagesPullingTime="29.988598455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:54:47.219608488 +0000 UTC m=+38.725721731" watchObservedRunningTime="2026-07-21 08:54:47.219918951 +0000 UTC m=+38.726032194" Jul 21 08:54:49.017177 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:49.017146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:49.017591 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:49.017231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:49.017591 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:49.017242 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:49.017591 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:49.017256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:49.017591 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:49.017317 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:49.017591 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:49.017382 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:51.014664 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:51.014628 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:51.015141 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:51.014730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:51.015141 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:51.014744 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:51.015141 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:51.014870 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:51.015141 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:51.014894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:51.015141 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:51.014975 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:53.014902 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:53.014872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:53.014902 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:53.014872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:53.015404 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:53.015233 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:53.015404 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:53.015384 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:53.015534 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:53.015513 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:53.016405 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:53.016367 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:55.014089 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:55.014055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:55.014089 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:55.014093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:55.014600 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:55.014069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:55.014600 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:55.014159 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:55.014600 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:55.014263 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:55.014600 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:55.014324 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:57.014744 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:57.014704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:57.015257 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:57.014713 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:57.015257 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:57.014809 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:54:57.015257 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:57.014878 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:57.015257 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:57.014920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:57.015257 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:57.015017 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:59.014848 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:59.014807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:54:59.015339 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:59.014908 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:54:59.015339 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:59.015004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:54:59.015339 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:59.015095 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:54:59.015339 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:54:59.015161 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:54:59.015339 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:54:59.015216 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:55:01.014189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:01.014149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:55:01.014589 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:01.014153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:55:01.014589 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:01.014289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:55:01.014589 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:01.014348 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ndszr" podUID="bf70dccc-a8b1-4129-b544-2243003907d0" Jul 21 08:55:01.014589 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:01.014260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgdhz" podUID="e08b2d0e-e440-4a23-9f99-13227f98a428" Jul 21 08:55:01.014589 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:01.014410 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-brfrx" podUID="23ce847a-6a34-4f52-a0c6-cda4d74e720c" Jul 21 08:55:02.341362 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.341335 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-119.ec2.internal" event="NodeReady" Jul 21 08:55:02.341775 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.341452 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 08:55:02.391111 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.391075 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-22pbh"] Jul 21 08:55:02.405284 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.405254 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r49xt"] Jul 21 08:55:02.405431 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.405383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.408329 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.408306 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 08:55:02.408483 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.408353 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vn5xz\"" Jul 21 08:55:02.408483 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.408454 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 08:55:02.425344 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.425316 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22pbh"] Jul 21 08:55:02.425459 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.425352 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r49xt"] Jul 21 08:55:02.425459 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.425369 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-drmz5"] Jul 21 08:55:02.425525 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.425494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.428386 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.428367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 08:55:02.428774 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.428733 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 08:55:02.429473 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.429379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k4ck8\"" Jul 21 08:55:02.429565 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.429482 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 08:55:02.451608 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2ns\" (UniqueName: \"kubernetes.io/projected/48787522-730b-4277-88a4-ae42927ef428-kube-api-access-4r2ns\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.451608 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451603 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-drmz5"] Jul 21 08:55:02.451789 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bd544cc-2a52-4258-b662-d6399ef2c8b2-cert\") pod \"ingress-canary-r49xt\" (UID: \"6bd544cc-2a52-4258-b662-d6399ef2c8b2\") " pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.451789 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqccg\" (UniqueName: \"kubernetes.io/projected/6bd544cc-2a52-4258-b662-d6399ef2c8b2-kube-api-access-tqccg\") pod \"ingress-canary-r49xt\" (UID: \"6bd544cc-2a52-4258-b662-d6399ef2c8b2\") " pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.451789 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.451789 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48787522-730b-4277-88a4-ae42927ef428-config-volume\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.451789 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48787522-730b-4277-88a4-ae42927ef428-tmp-dir\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.451789 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.451774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48787522-730b-4277-88a4-ae42927ef428-metrics-tls\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.454519 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.454495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 08:55:02.454649 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.454532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 08:55:02.454649 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.454532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 08:55:02.454649 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.454593 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 08:55:02.454829 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.454746 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bmsm\"" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.552907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqccg\" (UniqueName: \"kubernetes.io/projected/6bd544cc-2a52-4258-b662-d6399ef2c8b2-kube-api-access-tqccg\") pod \"ingress-canary-r49xt\" (UID: \"6bd544cc-2a52-4258-b662-d6399ef2c8b2\") " pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48787522-730b-4277-88a4-ae42927ef428-config-volume\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48787522-730b-4277-88a4-ae42927ef428-tmp-dir\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48787522-730b-4277-88a4-ae42927ef428-metrics-tls\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0e87473-0e46-45d9-9fa9-3cb4a3179459-crio-socket\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2ns\" (UniqueName: \"kubernetes.io/projected/48787522-730b-4277-88a4-ae42927ef428-kube-api-access-4r2ns\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0e87473-0e46-45d9-9fa9-3cb4a3179459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553646 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz7pg\" (UniqueName: \"kubernetes.io/projected/c0e87473-0e46-45d9-9fa9-3cb4a3179459-kube-api-access-nz7pg\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48787522-730b-4277-88a4-ae42927ef428-config-volume\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e87473-0e46-45d9-9fa9-3cb4a3179459-data-volume\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0e87473-0e46-45d9-9fa9-3cb4a3179459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bd544cc-2a52-4258-b662-d6399ef2c8b2-cert\") pod \"ingress-canary-r49xt\" (UID: \"6bd544cc-2a52-4258-b662-d6399ef2c8b2\") " pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.554472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.553986 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48787522-730b-4277-88a4-ae42927ef428-tmp-dir\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.558750 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.558725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48787522-730b-4277-88a4-ae42927ef428-metrics-tls\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.558880 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.558864 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6bd544cc-2a52-4258-b662-d6399ef2c8b2-cert\") pod \"ingress-canary-r49xt\" (UID: \"6bd544cc-2a52-4258-b662-d6399ef2c8b2\") " pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.561347 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.561329 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqccg\" (UniqueName: \"kubernetes.io/projected/6bd544cc-2a52-4258-b662-d6399ef2c8b2-kube-api-access-tqccg\") pod \"ingress-canary-r49xt\" (UID: \"6bd544cc-2a52-4258-b662-d6399ef2c8b2\") " pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.564012 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.563990 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2ns\" (UniqueName: \"kubernetes.io/projected/48787522-730b-4277-88a4-ae42927ef428-kube-api-access-4r2ns\") pod \"dns-default-22pbh\" (UID: \"48787522-730b-4277-88a4-ae42927ef428\") " pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.654251 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0e87473-0e46-45d9-9fa9-3cb4a3179459-crio-socket\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654251 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0e87473-0e46-45d9-9fa9-3cb4a3179459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654492 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz7pg\" (UniqueName: \"kubernetes.io/projected/c0e87473-0e46-45d9-9fa9-3cb4a3179459-kube-api-access-nz7pg\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654492 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e87473-0e46-45d9-9fa9-3cb4a3179459-data-volume\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654492 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0e87473-0e46-45d9-9fa9-3cb4a3179459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654492 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654432 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0e87473-0e46-45d9-9fa9-3cb4a3179459-crio-socket\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654802 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654782 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e87473-0e46-45d9-9fa9-3cb4a3179459-data-volume\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.654934 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.654920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0e87473-0e46-45d9-9fa9-3cb4a3179459-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.656758 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.656727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0e87473-0e46-45d9-9fa9-3cb4a3179459-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.662313 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.662293 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz7pg\" (UniqueName: \"kubernetes.io/projected/c0e87473-0e46-45d9-9fa9-3cb4a3179459-kube-api-access-nz7pg\") pod \"insights-runtime-extractor-drmz5\" (UID: \"c0e87473-0e46-45d9-9fa9-3cb4a3179459\") " pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.715987 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.715931 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:02.735209 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.735184 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r49xt" Jul 21 08:55:02.759706 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.759677 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-drmz5" Jul 21 08:55:02.939070 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:02.938981 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r49xt"] Jul 21 08:55:02.941636 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:02.941607 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd544cc_2a52_4258_b662_d6399ef2c8b2.slice/crio-198b8cb52285edd52e9e5a2c2d483765314f9d9b82c272d1322704005a5f8c9c WatchSource:0}: Error finding container 198b8cb52285edd52e9e5a2c2d483765314f9d9b82c272d1322704005a5f8c9c: Status 404 returned error can't find the container with id 198b8cb52285edd52e9e5a2c2d483765314f9d9b82c272d1322704005a5f8c9c Jul 21 08:55:03.014000 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.013971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:55:03.014000 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.013994 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:55:03.014204 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.013972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:55:03.017103 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.017082 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 08:55:03.017103 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.017083 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 08:55:03.017307 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.017110 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 08:55:03.018169 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.018151 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrkgn\"" Jul 21 08:55:03.018274 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.018251 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 08:55:03.018274 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.018263 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zc7l9\"" Jul 21 08:55:03.150204 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.150123 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-22pbh"] Jul 21 08:55:03.152323 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.152300 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-drmz5"] Jul 21 08:55:03.153739 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:03.153718 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48787522_730b_4277_88a4_ae42927ef428.slice/crio-86032f6f30e67685601cd808665cf7108bd7fcc3bc065460b23cbb59e2a17263 WatchSource:0}: Error finding container 86032f6f30e67685601cd808665cf7108bd7fcc3bc065460b23cbb59e2a17263: Status 404 returned error can't find the container with id 86032f6f30e67685601cd808665cf7108bd7fcc3bc065460b23cbb59e2a17263 Jul 21 08:55:03.155366 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:03.155347 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e87473_0e46_45d9_9fa9_3cb4a3179459.slice/crio-de8ff8e53e6e785aaec2ad4d0a994145f776a069beffa6e96bffaf41ed0581ee WatchSource:0}: Error finding container de8ff8e53e6e785aaec2ad4d0a994145f776a069beffa6e96bffaf41ed0581ee: Status 404 returned error can't find the container with id de8ff8e53e6e785aaec2ad4d0a994145f776a069beffa6e96bffaf41ed0581ee Jul 21 08:55:03.234440 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.234407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drmz5" event={"ID":"c0e87473-0e46-45d9-9fa9-3cb4a3179459","Type":"ContainerStarted","Data":"de8ff8e53e6e785aaec2ad4d0a994145f776a069beffa6e96bffaf41ed0581ee"} Jul 21 08:55:03.235448 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.235426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r49xt" event={"ID":"6bd544cc-2a52-4258-b662-d6399ef2c8b2","Type":"ContainerStarted","Data":"198b8cb52285edd52e9e5a2c2d483765314f9d9b82c272d1322704005a5f8c9c"} Jul 21 08:55:03.236357 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:03.236332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22pbh" event={"ID":"48787522-730b-4277-88a4-ae42927ef428","Type":"ContainerStarted","Data":"86032f6f30e67685601cd808665cf7108bd7fcc3bc065460b23cbb59e2a17263"} Jul 21 08:55:05.837585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:05.837554 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5"] Jul 21 08:55:05.852858 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:05.852793 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5"] Jul 21 08:55:05.853060 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:05.852906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:05.856060 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:05.856035 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 08:55:05.856371 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:05.856039 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-j88s2\"" Jul 21 08:55:05.983577 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:05.983540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aa81938d-52a3-42f3-9ea8-957551f8e09f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hhkn5\" (UID: \"aa81938d-52a3-42f3-9ea8-957551f8e09f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:06.084038 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:06.084002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aa81938d-52a3-42f3-9ea8-957551f8e09f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hhkn5\" (UID: \"aa81938d-52a3-42f3-9ea8-957551f8e09f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:06.084215 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:06.084191 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 21 08:55:06.084293 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:06.084279 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa81938d-52a3-42f3-9ea8-957551f8e09f-tls-certificates podName:aa81938d-52a3-42f3-9ea8-957551f8e09f nodeName:}" failed. No retries permitted until 2026-07-21 08:55:06.584256906 +0000 UTC m=+58.090370133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/aa81938d-52a3-42f3-9ea8-957551f8e09f-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-hhkn5" (UID: "aa81938d-52a3-42f3-9ea8-957551f8e09f") : secret "prometheus-operator-admission-webhook-tls" not found Jul 21 08:55:06.588278 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:06.588235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aa81938d-52a3-42f3-9ea8-957551f8e09f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hhkn5\" (UID: \"aa81938d-52a3-42f3-9ea8-957551f8e09f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:06.590840 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:06.590811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aa81938d-52a3-42f3-9ea8-957551f8e09f-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-hhkn5\" (UID: \"aa81938d-52a3-42f3-9ea8-957551f8e09f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:06.763970 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:06.763920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:09.333642 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:09.333596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5"] Jul 21 08:55:09.338589 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:09.338550 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa81938d_52a3_42f3_9ea8_957551f8e09f.slice/crio-0ffb14d6e1e8fd0b2169bd090f18e02a4324b302fa82a398032ad5ff5ce7b6ac WatchSource:0}: Error finding container 0ffb14d6e1e8fd0b2169bd090f18e02a4324b302fa82a398032ad5ff5ce7b6ac: Status 404 returned error can't find the container with id 0ffb14d6e1e8fd0b2169bd090f18e02a4324b302fa82a398032ad5ff5ce7b6ac Jul 21 08:55:10.260152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.260120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" event={"ID":"aa81938d-52a3-42f3-9ea8-957551f8e09f","Type":"ContainerStarted","Data":"0ffb14d6e1e8fd0b2169bd090f18e02a4324b302fa82a398032ad5ff5ce7b6ac"} Jul 21 08:55:10.262543 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.262421 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drmz5" event={"ID":"c0e87473-0e46-45d9-9fa9-3cb4a3179459","Type":"ContainerStarted","Data":"c0633a8590718bf6236353eac215377ed468e617a30bd28d30e4c772a46c2027"} Jul 21 08:55:10.265464 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.265435 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r49xt" event={"ID":"6bd544cc-2a52-4258-b662-d6399ef2c8b2","Type":"ContainerStarted","Data":"ee4e20fd3f457a0c98bbc0a90257faab568040eef80154c2615389831c4a448c"} Jul 21 08:55:10.268206 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.268177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22pbh" event={"ID":"48787522-730b-4277-88a4-ae42927ef428","Type":"ContainerStarted","Data":"1e5237e9707926b787d8fe11753676018b130dde2ec989b007563d1ae42ad3b6"} Jul 21 08:55:10.268325 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.268231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-22pbh" event={"ID":"48787522-730b-4277-88a4-ae42927ef428","Type":"ContainerStarted","Data":"1ff9ee72d5d6e98e6c04eed8edd775f21c136c9bab3360153fee7c4971be0774"} Jul 21 08:55:10.269689 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.268816 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:10.303028 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:10.302805 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r49xt" podStartSLOduration=2.077634931 podStartE2EDuration="8.302787498s" totalImagesPullingTime="6.225152567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:10.282848033 +0000 UTC m=+61.788961277" watchObservedRunningTime="2026-07-21 08:55:10.302787498 +0000 UTC m=+61.808900719" Jul 21 08:55:11.181708 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.181674 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-th279" Jul 21 08:55:11.212878 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.212801 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-22pbh" podStartSLOduration=3.52781498 podStartE2EDuration="9.212781759s" totalImagesPullingTime="5.684966779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:10.302160862 +0000 UTC m=+61.808274106" watchObservedRunningTime="2026-07-21 08:55:11.212781759 +0000 UTC m=+62.718894980" Jul 21 08:55:11.273334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.273299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" event={"ID":"aa81938d-52a3-42f3-9ea8-957551f8e09f","Type":"ContainerStarted","Data":"aae5dce5e6309b20a5bd0f22e20af55c71a3f9d6d3e223caf63fe34aec2b765e"} Jul 21 08:55:11.273777 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.273757 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:11.278837 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.278810 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" Jul 21 08:55:11.296139 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.294120 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-hhkn5" podStartSLOduration=5.055503331 podStartE2EDuration="6.294092193s" totalImagesPullingTime="1.238588862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:11.293377941 +0000 UTC m=+62.799491185" watchObservedRunningTime="2026-07-21 08:55:11.294092193 +0000 UTC m=+62.800205437" Jul 21 08:55:11.771543 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.771508 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-6hnhf"] Jul 21 08:55:11.781918 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.781886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:11.786896 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.786870 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 08:55:11.789828 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.789808 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 08:55:11.791088 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.791061 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xqvlc\"" Jul 21 08:55:11.798821 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.798794 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6hnhf"] Jul 21 08:55:11.833033 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.832996 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nft2m\" (UniqueName: \"kubernetes.io/projected/befb277e-be4c-4cfc-bac4-0dfb02a69cc5-kube-api-access-nft2m\") pod \"downloads-5bc67dcd46-6hnhf\" (UID: \"befb277e-be4c-4cfc-bac4-0dfb02a69cc5\") " pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:11.919271 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.919238 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b"] Jul 21 08:55:11.923733 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.923707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:11.927002 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.926945 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 08:55:11.927152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.927012 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 08:55:11.927152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.927027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 08:55:11.927152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.927080 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 08:55:11.927152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.926968 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-k7pkn\"" Jul 21 08:55:11.927152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.926945 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 08:55:11.934011 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.933934 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nft2m\" (UniqueName: \"kubernetes.io/projected/befb277e-be4c-4cfc-bac4-0dfb02a69cc5-kube-api-access-nft2m\") pod \"downloads-5bc67dcd46-6hnhf\" (UID: \"befb277e-be4c-4cfc-bac4-0dfb02a69cc5\") " pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:11.935579 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.935556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b"] Jul 21 08:55:11.949173 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:11.949142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nft2m\" (UniqueName: \"kubernetes.io/projected/befb277e-be4c-4cfc-bac4-0dfb02a69cc5-kube-api-access-nft2m\") pod \"downloads-5bc67dcd46-6hnhf\" (UID: \"befb277e-be4c-4cfc-bac4-0dfb02a69cc5\") " pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:12.034500 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.034406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxqs\" (UniqueName: \"kubernetes.io/projected/d4c66ef4-f6e4-421c-b013-f630e9f18989-kube-api-access-rtxqs\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.034663 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.034566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.034663 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.034616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c66ef4-f6e4-421c-b013-f630e9f18989-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.034663 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.034652 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.092587 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.092551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:12.135468 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.135427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.135650 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.135479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c66ef4-f6e4-421c-b013-f630e9f18989-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.135650 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.135503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.135650 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.135532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxqs\" (UniqueName: \"kubernetes.io/projected/d4c66ef4-f6e4-421c-b013-f630e9f18989-kube-api-access-rtxqs\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.135904 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:12.135729 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 21 08:55:12.135904 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:12.135801 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-tls podName:d4c66ef4-f6e4-421c-b013-f630e9f18989 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:12.635780598 +0000 UTC m=+64.141893832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-8gv4b" (UID: "d4c66ef4-f6e4-421c-b013-f630e9f18989") : secret "prometheus-operator-tls" not found Jul 21 08:55:12.136308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.136282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4c66ef4-f6e4-421c-b013-f630e9f18989-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.138415 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.138386 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.149071 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.149038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxqs\" (UniqueName: \"kubernetes.io/projected/d4c66ef4-f6e4-421c-b013-f630e9f18989-kube-api-access-rtxqs\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.640759 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.640714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.643423 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.643396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d4c66ef4-f6e4-421c-b013-f630e9f18989-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-8gv4b\" (UID: \"d4c66ef4-f6e4-421c-b013-f630e9f18989\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:12.835259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:12.835213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" Jul 21 08:55:13.061814 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:13.061732 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6hnhf"] Jul 21 08:55:13.064185 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:13.064161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefb277e_be4c_4cfc_bac4_0dfb02a69cc5.slice/crio-2a1de8a1ec8dea50b9aee945c7cf6ab141c371408033e5ebacf3c1f4fee5a6c7 WatchSource:0}: Error finding container 2a1de8a1ec8dea50b9aee945c7cf6ab141c371408033e5ebacf3c1f4fee5a6c7: Status 404 returned error can't find the container with id 2a1de8a1ec8dea50b9aee945c7cf6ab141c371408033e5ebacf3c1f4fee5a6c7 Jul 21 08:55:13.080094 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:13.080042 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b"] Jul 21 08:55:13.083176 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:13.083151 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c66ef4_f6e4_421c_b013_f630e9f18989.slice/crio-988d475cb3ba4438ca570d0dce0b5a88f71d6856e45fc82aa06c73298ac62546 WatchSource:0}: Error finding container 988d475cb3ba4438ca570d0dce0b5a88f71d6856e45fc82aa06c73298ac62546: Status 404 returned error can't find the container with id 988d475cb3ba4438ca570d0dce0b5a88f71d6856e45fc82aa06c73298ac62546 Jul 21 08:55:13.280846 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:13.280762 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" event={"ID":"d4c66ef4-f6e4-421c-b013-f630e9f18989","Type":"ContainerStarted","Data":"988d475cb3ba4438ca570d0dce0b5a88f71d6856e45fc82aa06c73298ac62546"} Jul 21 08:55:13.281795 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:13.281766 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6hnhf" event={"ID":"befb277e-be4c-4cfc-bac4-0dfb02a69cc5","Type":"ContainerStarted","Data":"2a1de8a1ec8dea50b9aee945c7cf6ab141c371408033e5ebacf3c1f4fee5a6c7"} Jul 21 08:55:13.283473 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:13.283452 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drmz5" event={"ID":"c0e87473-0e46-45d9-9fa9-3cb4a3179459","Type":"ContainerStarted","Data":"c400bce05efab8f5c54d3f73c7438fc15f36be2048388730ec76ae16924b2eda"} Jul 21 08:55:14.659104 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.659068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:55:14.662283 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.662258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 08:55:14.672563 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.672542 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e08b2d0e-e440-4a23-9f99-13227f98a428-metrics-certs\") pod \"network-metrics-daemon-zgdhz\" (UID: \"e08b2d0e-e440-4a23-9f99-13227f98a428\") " pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:55:14.732991 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.732797 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zc7l9\"" Jul 21 08:55:14.740028 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.740007 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgdhz" Jul 21 08:55:14.760284 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.760253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:55:14.763406 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.763375 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 08:55:14.774420 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.774391 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23ce847a-6a34-4f52-a0c6-cda4d74e720c-original-pull-secret\") pod \"global-pull-secret-syncer-brfrx\" (UID: \"23ce847a-6a34-4f52-a0c6-cda4d74e720c\") " pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:55:14.862012 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.861563 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:55:14.864665 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.864635 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 08:55:14.874833 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.874805 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 08:55:14.886374 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.886339 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwtgd\" (UniqueName: \"kubernetes.io/projected/bf70dccc-a8b1-4129-b544-2243003907d0-kube-api-access-lwtgd\") pod \"network-check-target-ndszr\" (UID: \"bf70dccc-a8b1-4129-b544-2243003907d0\") " pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:55:14.898725 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:14.898690 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zgdhz"] Jul 21 08:55:14.904098 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:14.904068 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08b2d0e_e440_4a23_9f99_13227f98a428.slice/crio-821fd2b05486c30a82bed2bc4363f3249c8a597185e300592dcc34cf4f946188 WatchSource:0}: Error finding container 821fd2b05486c30a82bed2bc4363f3249c8a597185e300592dcc34cf4f946188: Status 404 returned error can't find the container with id 821fd2b05486c30a82bed2bc4363f3249c8a597185e300592dcc34cf4f946188 Jul 21 08:55:15.027986 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.027938 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrkgn\"" Jul 21 08:55:15.034486 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.034464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-brfrx" Jul 21 08:55:15.035651 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.035589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:55:15.296760 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.296723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zgdhz" event={"ID":"e08b2d0e-e440-4a23-9f99-13227f98a428","Type":"ContainerStarted","Data":"821fd2b05486c30a82bed2bc4363f3249c8a597185e300592dcc34cf4f946188"} Jul 21 08:55:15.298970 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.298868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" event={"ID":"d4c66ef4-f6e4-421c-b013-f630e9f18989","Type":"ContainerStarted","Data":"ee53bd51755745daef937f757527514fb2134b98530059e62e19119648e98a25"} Jul 21 08:55:15.298970 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.298920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" event={"ID":"d4c66ef4-f6e4-421c-b013-f630e9f18989","Type":"ContainerStarted","Data":"d33ca4bf0f8871aa0db65d0751b3fbebd036b363fb863d6719dc7d090d94bc85"} Jul 21 08:55:15.319107 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:15.318963 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-8gv4b" podStartSLOduration=2.738534914 podStartE2EDuration="4.318928236s" totalImagesPullingTime="1.580393322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:15.317779092 +0000 UTC m=+66.823892335" watchObservedRunningTime="2026-07-21 08:55:15.318928236 +0000 UTC m=+66.825041487" Jul 21 08:55:17.094282 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.094214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-brfrx"] Jul 21 08:55:17.099294 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:17.098610 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ce847a_6a34_4f52_a0c6_cda4d74e720c.slice/crio-63b46e2123d5e84e3c10f36ab0c34d00f23521eb2ba3b4d3e7424a466fa3b640 WatchSource:0}: Error finding container 63b46e2123d5e84e3c10f36ab0c34d00f23521eb2ba3b4d3e7424a466fa3b640: Status 404 returned error can't find the container with id 63b46e2123d5e84e3c10f36ab0c34d00f23521eb2ba3b4d3e7424a466fa3b640 Jul 21 08:55:17.121171 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.121079 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ndszr"] Jul 21 08:55:17.124833 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:17.124805 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf70dccc_a8b1_4129_b544_2243003907d0.slice/crio-6b6fd42d7eabb31dde5f0b3b21159ae9f598628b795a96d86eea0f52e2bdae85 WatchSource:0}: Error finding container 6b6fd42d7eabb31dde5f0b3b21159ae9f598628b795a96d86eea0f52e2bdae85: Status 404 returned error can't find the container with id 6b6fd42d7eabb31dde5f0b3b21159ae9f598628b795a96d86eea0f52e2bdae85 Jul 21 08:55:17.310224 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.310069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-drmz5" event={"ID":"c0e87473-0e46-45d9-9fa9-3cb4a3179459","Type":"ContainerStarted","Data":"df084af4a7e7334074c47c382216eb751448d2c9443b92589f608ffc2dac989d"} Jul 21 08:55:17.312105 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.312068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-brfrx" event={"ID":"23ce847a-6a34-4f52-a0c6-cda4d74e720c","Type":"ContainerStarted","Data":"63b46e2123d5e84e3c10f36ab0c34d00f23521eb2ba3b4d3e7424a466fa3b640"} Jul 21 08:55:17.313267 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.313243 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ndszr" event={"ID":"bf70dccc-a8b1-4129-b544-2243003907d0","Type":"ContainerStarted","Data":"6b6fd42d7eabb31dde5f0b3b21159ae9f598628b795a96d86eea0f52e2bdae85"} Jul 21 08:55:17.327497 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.327441 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-fxvxp"] Jul 21 08:55:17.330835 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.330812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.335114 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.335078 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-578rm\"" Jul 21 08:55:17.335980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.335924 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 08:55:17.335980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.335921 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 08:55:17.336266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.336005 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 08:55:17.336332 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.336296 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq"] Jul 21 08:55:17.341050 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.339656 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.343105 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.343081 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 21 08:55:17.343105 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.343098 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ndqjk\"" Jul 21 08:55:17.343941 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.343924 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 21 08:55:17.348233 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.348214 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-fxvxp"] Jul 21 08:55:17.348572 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.348508 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-drmz5" podStartSLOduration=1.712483342 podStartE2EDuration="15.34849271s" totalImagesPullingTime="13.636009368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:55:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:17.346827996 +0000 UTC m=+68.852941296" watchObservedRunningTime="2026-07-21 08:55:17.34849271 +0000 UTC m=+68.854605954" Jul 21 08:55:17.353445 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.353422 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vxz4j"] Jul 21 08:55:17.357116 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.357095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.357300 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.357279 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq"] Jul 21 08:55:17.360176 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.359987 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 08:55:17.360176 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.360023 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z2t6l\"" Jul 21 08:55:17.360176 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.360065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 08:55:17.360479 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.360466 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2fwh\" (UniqueName: \"kubernetes.io/projected/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-kube-api-access-h2fwh\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-root\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-wtmp\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482580 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be7ff7af-2d10-4f06-ae50-831fca30922f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be7ff7af-2d10-4f06-ae50-831fca30922f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-tls\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.482697 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482683 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b129e55-c41e-4258-9ac5-a251a730380e-metrics-client-ca\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482715 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-textfile\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cshrd\" (UniqueName: \"kubernetes.io/projected/1b129e55-c41e-4258-9ac5-a251a730380e-kube-api-access-cshrd\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-sys\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482913 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-accelerators-collector-config\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.482972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.483023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.483083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.483109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zhfz\" (UniqueName: \"kubernetes.io/projected/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-api-access-9zhfz\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.483226 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.483139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.584493 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-wtmp\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584493 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be7ff7af-2d10-4f06-ae50-831fca30922f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.584493 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be7ff7af-2d10-4f06-ae50-831fca30922f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-tls\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b129e55-c41e-4258-9ac5-a251a730380e-metrics-client-ca\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-textfile\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584598 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-wtmp\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cshrd\" (UniqueName: \"kubernetes.io/projected/1b129e55-c41e-4258-9ac5-a251a730380e-kube-api-access-cshrd\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584648 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-sys\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-accelerators-collector-config\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584704 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.584739 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584730 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584800 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zhfz\" (UniqueName: \"kubernetes.io/projected/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-api-access-9zhfz\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584831 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2fwh\" (UniqueName: \"kubernetes.io/projected/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-kube-api-access-h2fwh\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584914 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/be7ff7af-2d10-4f06-ae50-831fca30922f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-root\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.584916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-root\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.585032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.585146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b129e55-c41e-4258-9ac5-a251a730380e-metrics-client-ca\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.585189 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.585178 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-textfile\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.585701 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:17.585223 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 08:55:17.585701 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:17.585278 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-tls podName:1b129e55-c41e-4258-9ac5-a251a730380e nodeName:}" failed. No retries permitted until 2026-07-21 08:55:18.085262847 +0000 UTC m=+69.591376068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-tls") pod "node-exporter-vxz4j" (UID: "1b129e55-c41e-4258-9ac5-a251a730380e") : secret "node-exporter-tls" not found Jul 21 08:55:17.585701 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.585461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b129e55-c41e-4258-9ac5-a251a730380e-sys\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.587615 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.586389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-accelerators-collector-config\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.587615 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.586488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be7ff7af-2d10-4f06-ae50-831fca30922f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.587615 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.586827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.587615 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.587529 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.588083 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.588030 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.588196 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.588177 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.588259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.588238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.588672 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.588640 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.589028 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.589006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.594056 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.594032 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zhfz\" (UniqueName: \"kubernetes.io/projected/be7ff7af-2d10-4f06-ae50-831fca30922f-kube-api-access-9zhfz\") pod \"kube-state-metrics-56c5594674-fxvxp\" (UID: \"be7ff7af-2d10-4f06-ae50-831fca30922f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.594546 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.594526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cshrd\" (UniqueName: \"kubernetes.io/projected/1b129e55-c41e-4258-9ac5-a251a730380e-kube-api-access-cshrd\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:17.595224 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.595208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2fwh\" (UniqueName: \"kubernetes.io/projected/5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838-kube-api-access-h2fwh\") pod \"openshift-state-metrics-79f6958cdf-95qtq\" (UID: \"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.647360 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.647333 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" Jul 21 08:55:17.655900 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.655878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" Jul 21 08:55:17.835231 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.835161 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-fxvxp"] Jul 21 08:55:17.842657 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:17.842619 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7ff7af_2d10_4f06_ae50_831fca30922f.slice/crio-c2482fc30e90a7d6d00d89bfa1bec8d16c78a0290bbe6bb1ac63dda69015ac0c WatchSource:0}: Error finding container c2482fc30e90a7d6d00d89bfa1bec8d16c78a0290bbe6bb1ac63dda69015ac0c: Status 404 returned error can't find the container with id c2482fc30e90a7d6d00d89bfa1bec8d16c78a0290bbe6bb1ac63dda69015ac0c Jul 21 08:55:17.861074 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:17.860996 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq"] Jul 21 08:55:17.864160 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:17.864124 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aac5c8c_f3fc_43c5_bc5c_a6cef1fb7838.slice/crio-c37e6721e1c5b92dca62f13c0d1692a58b1045cfbc787ff33e2cf9b996774847 WatchSource:0}: Error finding container c37e6721e1c5b92dca62f13c0d1692a58b1045cfbc787ff33e2cf9b996774847: Status 404 returned error can't find the container with id c37e6721e1c5b92dca62f13c0d1692a58b1045cfbc787ff33e2cf9b996774847 Jul 21 08:55:18.089004 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.088915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-tls\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:18.092838 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.092808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b129e55-c41e-4258-9ac5-a251a730380e-node-exporter-tls\") pod \"node-exporter-vxz4j\" (UID: \"1b129e55-c41e-4258-9ac5-a251a730380e\") " pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:18.268909 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.268644 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vxz4j" Jul 21 08:55:18.283895 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:18.283862 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b129e55_c41e_4258_9ac5_a251a730380e.slice/crio-7debae82cece3b0a65bb3aad7728944be3b01c1ba66cebd56b48fbf5fe16ff03 WatchSource:0}: Error finding container 7debae82cece3b0a65bb3aad7728944be3b01c1ba66cebd56b48fbf5fe16ff03: Status 404 returned error can't find the container with id 7debae82cece3b0a65bb3aad7728944be3b01c1ba66cebd56b48fbf5fe16ff03 Jul 21 08:55:18.320617 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.320577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" event={"ID":"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838","Type":"ContainerStarted","Data":"c6ec0334661d109a0a63df015e0e54df07b25477e04628ef443b291b60085c11"} Jul 21 08:55:18.320779 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.320655 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" event={"ID":"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838","Type":"ContainerStarted","Data":"fcc9da79e48c3416b282a9e9c814c937dcb76139c08c58acc4fd44ae061dd4f8"} Jul 21 08:55:18.320779 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.320691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" event={"ID":"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838","Type":"ContainerStarted","Data":"c37e6721e1c5b92dca62f13c0d1692a58b1045cfbc787ff33e2cf9b996774847"} Jul 21 08:55:18.322962 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.322925 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zgdhz" event={"ID":"e08b2d0e-e440-4a23-9f99-13227f98a428","Type":"ContainerStarted","Data":"875c8b43e2e69dc5fcceffc1e6a65e69cf898339f56f30a7d41fa030ca8570cd"} Jul 21 08:55:18.323109 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.322996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zgdhz" event={"ID":"e08b2d0e-e440-4a23-9f99-13227f98a428","Type":"ContainerStarted","Data":"b7e4d03ae89de6dfe50d2109727578ef6db8eaa6191abc951483e39822d98dc0"} Jul 21 08:55:18.324898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.324870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxz4j" event={"ID":"1b129e55-c41e-4258-9ac5-a251a730380e","Type":"ContainerStarted","Data":"7debae82cece3b0a65bb3aad7728944be3b01c1ba66cebd56b48fbf5fe16ff03"} Jul 21 08:55:18.326891 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.326817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" event={"ID":"be7ff7af-2d10-4f06-ae50-831fca30922f","Type":"ContainerStarted","Data":"c2482fc30e90a7d6d00d89bfa1bec8d16c78a0290bbe6bb1ac63dda69015ac0c"} Jul 21 08:55:18.348769 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.348664 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zgdhz" podStartSLOduration=66.621619232 podStartE2EDuration="1m9.348642782s" totalImagesPullingTime="2.72702355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:18.345471134 +0000 UTC m=+69.851584378" watchObservedRunningTime="2026-07-21 08:55:18.348642782 +0000 UTC m=+69.854756029" Jul 21 08:55:18.420476 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.420163 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:55:18.463413 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.463318 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:55:18.463571 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.463473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.467585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.467563 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 08:55:18.467888 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.467863 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 08:55:18.468018 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.467912 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 08:55:18.468472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.468428 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 08:55:18.468776 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.468760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 08:55:18.469017 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.468997 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 08:55:18.469258 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.469235 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p75bd\"" Jul 21 08:55:18.469964 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.469445 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 08:55:18.469964 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.469642 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 08:55:18.469964 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.469820 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-web-config\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600600 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqngr\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-kube-api-access-nqngr\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600739 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-config-out\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.601047 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.600832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-config-volume\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.701808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-web-config\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.701864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.701897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.701933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.701976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqngr\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-kube-api-access-nqngr\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702114 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-config-out\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-config-volume\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.702227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.703408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.703037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.704767 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:18.703731 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 21 08:55:18.704767 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:55:18.703798 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls podName:656c3fad-698c-4bd0-9c86-55096d05afa6 nodeName:}" failed. No retries permitted until 2026-07-21 08:55:19.203777422 +0000 UTC m=+70.709890658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6") : secret "alertmanager-main-tls" not found Jul 21 08:55:18.704767 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.704549 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.706253 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.706086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.710833 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.710802 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-config-volume\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.711292 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.711267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-config-out\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.711844 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.711763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.711844 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.711816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-web-config\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.712729 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.712648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.713586 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.713550 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.714448 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.714401 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.714732 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.714689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:18.715780 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:18.715762 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqngr\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-kube-api-access-nqngr\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:19.206967 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.206466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:19.212661 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.212607 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:19.301668 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.299803 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7858c7496-9t8f6"] Jul 21 08:55:19.302991 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.302919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.306778 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.306753 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 08:55:19.307162 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.307143 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 08:55:19.307454 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.307433 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8jpoemqofmoph\"" Jul 21 08:55:19.308410 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.307626 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 08:55:19.308410 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.307813 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 08:55:19.308410 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.308013 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 08:55:19.308410 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.308177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hlzcg\"" Jul 21 08:55:19.317675 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.317540 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7858c7496-9t8f6"] Jul 21 08:55:19.379191 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.379154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:55:19.409659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kcw5\" (UniqueName: \"kubernetes.io/projected/d2a5116b-c42a-4f12-b08c-12e30f925f75-kube-api-access-2kcw5\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-grpc-tls\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-tls\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2a5116b-c42a-4f12-b08c-12e30f925f75-metrics-client-ca\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.409980 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.409876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511373 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511282 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2a5116b-c42a-4f12-b08c-12e30f925f75-metrics-client-ca\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511373 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kcw5\" (UniqueName: \"kubernetes.io/projected/d2a5116b-c42a-4f12-b08c-12e30f925f75-kube-api-access-2kcw5\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-grpc-tls\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-tls\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511585 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.511823 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.511586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.514309 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.514279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2a5116b-c42a-4f12-b08c-12e30f925f75-metrics-client-ca\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.518301 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.518217 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.521105 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.521061 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.522167 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.522143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-grpc-tls\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.525079 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.525049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.525472 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.525451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.526032 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.525991 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kcw5\" (UniqueName: \"kubernetes.io/projected/d2a5116b-c42a-4f12-b08c-12e30f925f75-kube-api-access-2kcw5\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.526215 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.526194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d2a5116b-c42a-4f12-b08c-12e30f925f75-secret-thanos-querier-tls\") pod \"thanos-querier-7858c7496-9t8f6\" (UID: \"d2a5116b-c42a-4f12-b08c-12e30f925f75\") " pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:19.620576 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:19.620520 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:21.279000 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.278684 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-22pbh" Jul 21 08:55:21.631580 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.631554 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6976c556c7-r8nhd"] Jul 21 08:55:21.635220 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.634944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.638156 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.638135 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fd4h90l5pndsj\"" Jul 21 08:55:21.638380 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.638364 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x4xhn\"" Jul 21 08:55:21.640168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.639996 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 08:55:21.640168 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.640089 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 08:55:21.640351 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.640230 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 08:55:21.640492 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.640470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 08:55:21.644775 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.644733 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6976c556c7-r8nhd"] Jul 21 08:55:21.732559 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-secret-metrics-server-tls\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.732559 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732484 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d75518b9-0436-4476-8bce-0c6156f4c4e9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.732559 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-client-ca-bundle\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.732875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d75518b9-0436-4476-8bce-0c6156f4c4e9-audit-log\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.732875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-secret-metrics-server-client-certs\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.732875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprff\" (UniqueName: \"kubernetes.io/projected/d75518b9-0436-4476-8bce-0c6156f4c4e9-kube-api-access-tprff\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.732875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.732766 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d75518b9-0436-4476-8bce-0c6156f4c4e9-metrics-server-audit-profiles\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.777310 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.777279 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7858c7496-9t8f6"] Jul 21 08:55:21.834024 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.833980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d75518b9-0436-4476-8bce-0c6156f4c4e9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.834218 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-client-ca-bundle\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.834218 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d75518b9-0436-4476-8bce-0c6156f4c4e9-audit-log\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.834334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834243 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-secret-metrics-server-client-certs\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.834334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprff\" (UniqueName: \"kubernetes.io/projected/d75518b9-0436-4476-8bce-0c6156f4c4e9-kube-api-access-tprff\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.834334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d75518b9-0436-4476-8bce-0c6156f4c4e9-metrics-server-audit-profiles\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.834486 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-secret-metrics-server-tls\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.835289 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.834811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d75518b9-0436-4476-8bce-0c6156f4c4e9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.835289 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.835247 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d75518b9-0436-4476-8bce-0c6156f4c4e9-audit-log\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.835808 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.835762 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d75518b9-0436-4476-8bce-0c6156f4c4e9-metrics-server-audit-profiles\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.837872 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.837828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-secret-metrics-server-tls\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.838818 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.838774 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-secret-metrics-server-client-certs\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.839152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.839126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d75518b9-0436-4476-8bce-0c6156f4c4e9-client-ca-bundle\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.844521 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.844496 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprff\" (UniqueName: \"kubernetes.io/projected/d75518b9-0436-4476-8bce-0c6156f4c4e9-kube-api-access-tprff\") pod \"metrics-server-6976c556c7-r8nhd\" (UID: \"d75518b9-0436-4476-8bce-0c6156f4c4e9\") " pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:21.948731 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:21.948687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:22.071190 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.071151 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx"] Jul 21 08:55:22.074823 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.074794 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.077335 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.077314 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 21 08:55:22.077815 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.077595 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qp8j9\"" Jul 21 08:55:22.084641 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.084616 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx"] Jul 21 08:55:22.238060 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.237976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d768df45-0655-4dff-a36f-68c80c4f872a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-wv5qx\" (UID: \"d768df45-0655-4dff-a36f-68c80c4f872a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.238060 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.238023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2rl6\" (UniqueName: \"kubernetes.io/projected/d768df45-0655-4dff-a36f-68c80c4f872a-kube-api-access-l2rl6\") pod \"monitoring-plugin-7b7b7bc8bf-wv5qx\" (UID: \"d768df45-0655-4dff-a36f-68c80c4f872a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.338711 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.338677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d768df45-0655-4dff-a36f-68c80c4f872a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-wv5qx\" (UID: \"d768df45-0655-4dff-a36f-68c80c4f872a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.338711 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.338716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2rl6\" (UniqueName: \"kubernetes.io/projected/d768df45-0655-4dff-a36f-68c80c4f872a-kube-api-access-l2rl6\") pod \"monitoring-plugin-7b7b7bc8bf-wv5qx\" (UID: \"d768df45-0655-4dff-a36f-68c80c4f872a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.341757 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.341735 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d768df45-0655-4dff-a36f-68c80c4f872a-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-wv5qx\" (UID: \"d768df45-0655-4dff-a36f-68c80c4f872a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.349222 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.349190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2rl6\" (UniqueName: \"kubernetes.io/projected/d768df45-0655-4dff-a36f-68c80c4f872a-kube-api-access-l2rl6\") pod \"monitoring-plugin-7b7b7bc8bf-wv5qx\" (UID: \"d768df45-0655-4dff-a36f-68c80c4f872a\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:22.387009 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:22.386973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:23.354611 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:23.354566 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a5116b_c42a_4f12_b08c_12e30f925f75.slice/crio-f9f2be67e5473d6d7320e3937294e2b26a44133a4a6a775af2afb9c521edaf82 WatchSource:0}: Error finding container f9f2be67e5473d6d7320e3937294e2b26a44133a4a6a775af2afb9c521edaf82: Status 404 returned error can't find the container with id f9f2be67e5473d6d7320e3937294e2b26a44133a4a6a775af2afb9c521edaf82 Jul 21 08:55:23.581903 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.581477 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:55:23.668612 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.668582 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6976c556c7-r8nhd"] Jul 21 08:55:23.692977 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.691403 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:55:23.699802 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.699767 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.703582 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.703329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 08:55:23.703582 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.703329 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 08:55:23.704004 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.703814 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4qqw\"" Jul 21 08:55:23.704004 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.703826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 08:55:23.708620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.707256 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 08:55:23.708620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.707488 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 08:55:23.708620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.707810 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 08:55:23.708620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.707841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 08:55:23.708620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.708090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 08:55:23.710875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.709768 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 08:55:23.710875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.710038 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 08:55:23.710875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.710118 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6q75ntiejjfjq\"" Jul 21 08:55:23.710875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.710321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 08:55:23.710875 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.710670 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 08:55:23.712164 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.711961 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 08:55:23.719611 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.719576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 08:55:23.727975 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.727936 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:55:23.728202 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.728190 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx"] Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-config\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855641 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-web-config\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr65s\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-kube-api-access-zr65s\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.856359 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.855970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.857185 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.856000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.857185 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.856038 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.857185 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.856066 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-config-out\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.857185 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.856104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957009 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.956971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957214 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-config-out\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-config\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-web-config\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr65s\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-kube-api-access-zr65s\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.957564 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957560 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.958099 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.958099 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.957909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.958919 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.958627 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.959988 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.959589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.959988 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.959941 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.960967 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.960265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.960967 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.960913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.962266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.961511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.962266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.961800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.962266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.962108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.962266 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.962231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.962504 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.962278 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.962504 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.962436 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-web-config\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966317 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.964632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966317 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.965110 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966317 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.965535 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-config\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966317 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.966011 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966317 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.966189 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-config-out\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966317 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.966239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.966676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.966575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:23.967347 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:23.967062 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr65s\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-kube-api-access-zr65s\") pod \"prometheus-k8s-0\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:24.021989 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.021926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:24.236529 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.236443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:55:24.243203 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:55:24.243169 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619f17de_9ca5_4408_a1f4_08778ad3186f.slice/crio-a78f4fb765fbd36fd04e1ae39c07ec51e2c23a0e7c7190e8a5688e22f721e814 WatchSource:0}: Error finding container a78f4fb765fbd36fd04e1ae39c07ec51e2c23a0e7c7190e8a5688e22f721e814: Status 404 returned error can't find the container with id a78f4fb765fbd36fd04e1ae39c07ec51e2c23a0e7c7190e8a5688e22f721e814 Jul 21 08:55:24.383611 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.382984 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" event={"ID":"5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838","Type":"ContainerStarted","Data":"78a9d6f724e323bbddc9568ea2bc61bbee8206556f2779cb8d997eee52239f6d"} Jul 21 08:55:24.385610 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.385506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"a78f4fb765fbd36fd04e1ae39c07ec51e2c23a0e7c7190e8a5688e22f721e814"} Jul 21 08:55:24.389763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.389692 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" event={"ID":"d768df45-0655-4dff-a36f-68c80c4f872a","Type":"ContainerStarted","Data":"b1bc105331b224ef206c3a6b6da59cb584d0b521e735de6eee9a915240a51397"} Jul 21 08:55:24.394395 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.394363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-brfrx" event={"ID":"23ce847a-6a34-4f52-a0c6-cda4d74e720c","Type":"ContainerStarted","Data":"6d2916efeada9835d73d63ee5c774d7fbffa6e6a2937e29d54969d215f1e1797"} Jul 21 08:55:24.398968 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.398922 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ndszr" event={"ID":"bf70dccc-a8b1-4129-b544-2243003907d0","Type":"ContainerStarted","Data":"cd505fe3563478fc6f94e2893fa73dd8ab774a896d541b5e5d802e31d4ff2302"} Jul 21 08:55:24.399105 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.399090 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:55:24.403939 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.402987 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-95qtq" podStartSLOduration=2.138372222 podStartE2EDuration="7.402968668s" totalImagesPullingTime="5.264596446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:24.400490575 +0000 UTC m=+75.906603819" watchObservedRunningTime="2026-07-21 08:55:24.402968668 +0000 UTC m=+75.909081903" Jul 21 08:55:24.407538 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.406822 2564 generic.go:356] "Generic (PLEG): container finished" podID="1b129e55-c41e-4258-9ac5-a251a730380e" containerID="949e4f507f23a59b3eed24e8deede47f6dd88296fe2b31de202ad091c18fad21" exitCode=0 Jul 21 08:55:24.407538 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.407054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxz4j" event={"ID":"1b129e55-c41e-4258-9ac5-a251a730380e","Type":"ContainerDied","Data":"949e4f507f23a59b3eed24e8deede47f6dd88296fe2b31de202ad091c18fad21"} Jul 21 08:55:24.412057 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.411978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" event={"ID":"d75518b9-0436-4476-8bce-0c6156f4c4e9","Type":"ContainerStarted","Data":"b5324441c0dd14d921c6b470c2f0d0e318a4d1f569fc9d5458616e3760a175d9"} Jul 21 08:55:24.417426 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.417269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"8a90a3076e7647de7daa7350a82528ee8e84281870f3102dad4a6682def70cac"} Jul 21 08:55:24.421030 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.420486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"f9f2be67e5473d6d7320e3937294e2b26a44133a4a6a775af2afb9c521edaf82"} Jul 21 08:55:24.424130 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.424005 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" event={"ID":"be7ff7af-2d10-4f06-ae50-831fca30922f","Type":"ContainerStarted","Data":"62a30212a5ae3ee139c3223368cc6d99945b05a02951717e26cfb061e6085a8f"} Jul 21 08:55:24.424130 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.424055 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" event={"ID":"be7ff7af-2d10-4f06-ae50-831fca30922f","Type":"ContainerStarted","Data":"0d51e7cc338371fcb78ef4bfd8f5c3bab7bc892e0dca5430a23059e951f92408"} Jul 21 08:55:24.424130 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.424082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" event={"ID":"be7ff7af-2d10-4f06-ae50-831fca30922f","Type":"ContainerStarted","Data":"e83be2b8196ed3a6b5267df42490fb16ca334b4d9924791fd5740a18ecf24ee0"} Jul 21 08:55:24.437073 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.435225 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ndszr" podStartSLOduration=69.148296917 podStartE2EDuration="1m15.435206875s" totalImagesPullingTime="6.286909958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:24.417306303 +0000 UTC m=+75.923419563" watchObservedRunningTime="2026-07-21 08:55:24.435206875 +0000 UTC m=+75.941320120" Jul 21 08:55:24.459318 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.458807 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-fxvxp" podStartSLOduration=1.906535312 podStartE2EDuration="7.458760887s" totalImagesPullingTime="5.552225575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:24.458146426 +0000 UTC m=+75.964259696" watchObservedRunningTime="2026-07-21 08:55:24.458760887 +0000 UTC m=+75.964874133" Jul 21 08:55:24.460023 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:24.459512 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-brfrx" podStartSLOduration=69.145866682 podStartE2EDuration="1m15.459496411s" totalImagesPullingTime="6.313629729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 08:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:24.436870334 +0000 UTC m=+75.942983578" watchObservedRunningTime="2026-07-21 08:55:24.459496411 +0000 UTC m=+75.965609658" Jul 21 08:55:25.432872 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:25.432794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxz4j" event={"ID":"1b129e55-c41e-4258-9ac5-a251a730380e","Type":"ContainerStarted","Data":"4e2a1236ca3fcd2cd21a350027506b6619aefda0d0e6712b712c90e6fcff2d8b"} Jul 21 08:55:25.432872 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:25.432866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vxz4j" event={"ID":"1b129e55-c41e-4258-9ac5-a251a730380e","Type":"ContainerStarted","Data":"2cdde8d78ca99e1b9243b132f2016e91b36555b9699b0bae0a11d65414473ea6"} Jul 21 08:55:25.458027 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:25.457343 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vxz4j" podStartSLOduration=3.179015539 podStartE2EDuration="8.457319323s" totalImagesPullingTime="5.103183937s" totalInitContainerRuntime="175.119847ms" isStatefulPod=true podCreationTimestamp="2026-07-21 08:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:25.455160864 +0000 UTC m=+76.961274109" watchObservedRunningTime="2026-07-21 08:55:25.457319323 +0000 UTC m=+76.963432569" Jul 21 08:55:34.471448 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.471397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" event={"ID":"d75518b9-0436-4476-8bce-0c6156f4c4e9","Type":"ContainerStarted","Data":"917fe5ff7a21418e627a86f4188b6bc47dbadb84dc094535ead3e60c2096ce66"} Jul 21 08:55:34.473234 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.473205 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="7e695cdccb3884cce5325dea57cbe77c6a3ead67a5c1f7cb51f7ae4519aac0f6" exitCode=0 Jul 21 08:55:34.473364 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.473287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"7e695cdccb3884cce5325dea57cbe77c6a3ead67a5c1f7cb51f7ae4519aac0f6"} Jul 21 08:55:34.474884 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.474864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"51873a53b819d0d81519daa77d61f07c4de77eddb45c34ddcdafeb8ccb0454a2"} Jul 21 08:55:34.476455 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.476426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" event={"ID":"d768df45-0655-4dff-a36f-68c80c4f872a","Type":"ContainerStarted","Data":"2dc63bd4a7385d07db22e6a8171cb8bdb71f83ead3e7ffc249cdccbcf80666a1"} Jul 21 08:55:34.476620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.476605 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:34.481191 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.481176 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" Jul 21 08:55:34.505276 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.505225 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-wv5qx" podStartSLOduration=2.119484015 podStartE2EDuration="12.505205649s" totalImagesPullingTime="10.385721634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:34.504613034 +0000 UTC m=+86.010726287" watchObservedRunningTime="2026-07-21 08:55:34.505205649 +0000 UTC m=+86.011318894" Jul 21 08:55:34.505816 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:34.505791 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" podStartSLOduration=3.051366372 podStartE2EDuration="13.505781331s" totalImagesPullingTime="10.454414959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:34.489034138 +0000 UTC m=+85.995147383" watchObservedRunningTime="2026-07-21 08:55:34.505781331 +0000 UTC m=+86.011894551" Jul 21 08:55:35.488012 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.487672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6hnhf" event={"ID":"befb277e-be4c-4cfc-bac4-0dfb02a69cc5","Type":"ContainerStarted","Data":"9a29dc326ffdfe1098774b832fd3f85793c46ecb522a159d57a9156f53bb60fd"} Jul 21 08:55:35.488012 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.488131 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:35.491279 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.491206 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624" exitCode=0 Jul 21 08:55:35.491514 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.491423 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624"} Jul 21 08:55:35.495970 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.495317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"2945c3a0cdb302c0126eb6ad15ee8ef40b91f988eea66f94b4d3f726b429b04c"} Jul 21 08:55:35.495970 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.495393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"045d1436c4176ba2216142ae7b730354556d18fcdafcf21deb2993433922730c"} Jul 21 08:55:35.498658 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.498368 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-6hnhf" Jul 21 08:55:35.507849 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:35.507786 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-6hnhf" podStartSLOduration=3.064485421 podStartE2EDuration="24.507767194s" totalImagesPullingTime="21.443281773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:35.505294242 +0000 UTC m=+87.011407486" watchObservedRunningTime="2026-07-21 08:55:35.507767194 +0000 UTC m=+87.013880438" Jul 21 08:55:37.509101 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.509069 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"b35bb30ae6ea61a25b49e79b24086901c832e6eb3a9b374375fde02480857f48"} Jul 21 08:55:37.509481 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.509153 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"d32cd4bcfefbc174cd6aa0d90e144bf5004ce0b92bff33cc9defa44b96faace6"} Jul 21 08:55:37.509481 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.509199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"0637ba6925e83ee1638413662c4f6dd4bcb5b3bfde581d8c2a12e915ec3d4e58"} Jul 21 08:55:37.509481 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.509242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"fd9979544666e06f50242f6bc4a889f7d011139f9c5e14c98318a8c36630a1b2"} Jul 21 08:55:37.514018 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.513799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"cad521fef7f01a73d31f1d37861fce5e758c0d70d10e835791cedeb00142e1fd"} Jul 21 08:55:37.514018 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.513879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"90b9337b0d11e98c83fc2eaadf0e52e5ba528da9d79a0499c1903635f7c75388"} Jul 21 08:55:37.514018 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.513921 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" event={"ID":"d2a5116b-c42a-4f12-b08c-12e30f925f75","Type":"ContainerStarted","Data":"0f74b32bf6a7a1b206ed1ca185cce36c0dfaf9e5c42759e55910c7efd1be812a"} Jul 21 08:55:37.514282 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.514204 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:37.541437 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:37.539919 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" podStartSLOduration=5.646637434 podStartE2EDuration="18.539895545s" totalImagesPullingTime="12.893258111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:37.53752076 +0000 UTC m=+89.043634023" watchObservedRunningTime="2026-07-21 08:55:37.539895545 +0000 UTC m=+89.046008790" Jul 21 08:55:38.525833 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:38.525792 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"ebe01e5af53cb4a7b7c317143186ebc19ea3e3751bfb0913dd0676d3faa9e8f2"} Jul 21 08:55:38.526500 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:38.525909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerStarted","Data":"132d664fec6a43d4541e1d02415365dd04d7f92335c899a86033262911c640b2"} Jul 21 08:55:38.558829 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:38.558765 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.643560725 podStartE2EDuration="20.558742977s" totalImagesPullingTime="12.883913285s" totalInitContainerRuntime="31.268967ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:38.557221469 +0000 UTC m=+90.063334753" watchObservedRunningTime="2026-07-21 08:55:38.558742977 +0000 UTC m=+90.064856222" Jul 21 08:55:41.544426 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.544392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671"} Jul 21 08:55:41.544853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.544456 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512"} Jul 21 08:55:41.544853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.544483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821"} Jul 21 08:55:41.544853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.544518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802"} Jul 21 08:55:41.544853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.544559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171"} Jul 21 08:55:41.544853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.544599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerStarted","Data":"5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1"} Jul 21 08:55:41.575659 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.575574 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.168643372 podStartE2EDuration="18.575551459s" totalImagesPullingTime="15.371679322s" totalInitContainerRuntime="35.228765ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:55:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:55:41.573443894 +0000 UTC m=+93.079557149" watchObservedRunningTime="2026-07-21 08:55:41.575551459 +0000 UTC m=+93.081664703" Jul 21 08:55:41.949201 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.949163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:41.949374 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:41.949230 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:55:43.532374 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:43.532343 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7858c7496-9t8f6" Jul 21 08:55:44.022641 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:44.022606 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:55:55.436638 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:55:55.436603 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ndszr" Jul 21 08:56:01.954301 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:01.954269 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:56:01.958041 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:01.958020 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6976c556c7-r8nhd" Jul 21 08:56:24.022744 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:24.022703 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:24.094154 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:24.094127 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:24.739790 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:24.739764 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:37.624858 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.624826 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:37.625345 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.625136 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="alertmanager" containerID="cri-o://fd9979544666e06f50242f6bc4a889f7d011139f9c5e14c98318a8c36630a1b2" gracePeriod=120 Jul 21 08:56:37.625345 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.625195 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-metric" containerID="cri-o://132d664fec6a43d4541e1d02415365dd04d7f92335c899a86033262911c640b2" gracePeriod=120 Jul 21 08:56:37.625345 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.625227 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="prom-label-proxy" containerID="cri-o://ebe01e5af53cb4a7b7c317143186ebc19ea3e3751bfb0913dd0676d3faa9e8f2" gracePeriod=120 Jul 21 08:56:37.625345 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.625255 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="config-reloader" containerID="cri-o://0637ba6925e83ee1638413662c4f6dd4bcb5b3bfde581d8c2a12e915ec3d4e58" gracePeriod=120 Jul 21 08:56:37.625345 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.625291 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy" containerID="cri-o://b35bb30ae6ea61a25b49e79b24086901c832e6eb3a9b374375fde02480857f48" gracePeriod=120 Jul 21 08:56:37.625620 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.625229 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-web" containerID="cri-o://d32cd4bcfefbc174cd6aa0d90e144bf5004ce0b92bff33cc9defa44b96faace6" gracePeriod=120 Jul 21 08:56:37.782054 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782025 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="ebe01e5af53cb4a7b7c317143186ebc19ea3e3751bfb0913dd0676d3faa9e8f2" exitCode=0 Jul 21 08:56:37.782054 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782049 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="132d664fec6a43d4541e1d02415365dd04d7f92335c899a86033262911c640b2" exitCode=0 Jul 21 08:56:37.782054 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782055 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="b35bb30ae6ea61a25b49e79b24086901c832e6eb3a9b374375fde02480857f48" exitCode=0 Jul 21 08:56:37.782054 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782061 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="0637ba6925e83ee1638413662c4f6dd4bcb5b3bfde581d8c2a12e915ec3d4e58" exitCode=0 Jul 21 08:56:37.782259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782066 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="fd9979544666e06f50242f6bc4a889f7d011139f9c5e14c98318a8c36630a1b2" exitCode=0 Jul 21 08:56:37.782259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"ebe01e5af53cb4a7b7c317143186ebc19ea3e3751bfb0913dd0676d3faa9e8f2"} Jul 21 08:56:37.782259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782152 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"132d664fec6a43d4541e1d02415365dd04d7f92335c899a86033262911c640b2"} Jul 21 08:56:37.782259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"b35bb30ae6ea61a25b49e79b24086901c832e6eb3a9b374375fde02480857f48"} Jul 21 08:56:37.782259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"0637ba6925e83ee1638413662c4f6dd4bcb5b3bfde581d8c2a12e915ec3d4e58"} Jul 21 08:56:37.782259 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:37.782222 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"fd9979544666e06f50242f6bc4a889f7d011139f9c5e14c98318a8c36630a1b2"} Jul 21 08:56:38.789813 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.789625 2564 generic.go:356] "Generic (PLEG): container finished" podID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerID="d32cd4bcfefbc174cd6aa0d90e144bf5004ce0b92bff33cc9defa44b96faace6" exitCode=0 Jul 21 08:56:38.789813 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.789693 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"d32cd4bcfefbc174cd6aa0d90e144bf5004ce0b92bff33cc9defa44b96faace6"} Jul 21 08:56:38.861651 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.861630 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:38.951415 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951343 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951415 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951378 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-web\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951415 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951398 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951420 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-trusted-ca-bundle\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951545 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-metrics-client-ca\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951612 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-web-config\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951665 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951695 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-main-db\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951723 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-config-out\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951755 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqngr\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-kube-api-access-nqngr\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951793 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-cluster-tls-config\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951809 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951838 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-config-volume\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.951882 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.951872 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-tls-assets\") pod \"656c3fad-698c-4bd0-9c86-55096d05afa6\" (UID: \"656c3fad-698c-4bd0-9c86-55096d05afa6\") " Jul 21 08:56:38.952293 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.952085 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:56:38.952293 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.952197 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:38.952293 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.952217 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/656c3fad-698c-4bd0-9c86-55096d05afa6-metrics-client-ca\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:38.952293 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.952233 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-alertmanager-main-db\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:38.954909 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.954879 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:38.955130 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.955058 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-config-out" (OuterVolumeSpecName: "config-out") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:56:38.955130 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.955058 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:38.955264 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.955184 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:38.955548 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.955503 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:38.955920 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.955894 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-kube-api-access-nqngr" (OuterVolumeSpecName: "kube-api-access-nqngr") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "kube-api-access-nqngr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:38.956166 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.956145 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-config-volume" (OuterVolumeSpecName: "config-volume") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:38.956263 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.956242 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:38.959220 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.959198 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:38.965354 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:38.965330 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-web-config" (OuterVolumeSpecName: "web-config") pod "656c3fad-698c-4bd0-9c86-55096d05afa6" (UID: "656c3fad-698c-4bd0-9c86-55096d05afa6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:39.053533 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053505 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053533 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053530 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-web-config\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053533 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053540 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-main-tls\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053549 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/656c3fad-698c-4bd0-9c86-55096d05afa6-config-out\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053558 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqngr\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-kube-api-access-nqngr\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053566 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-cluster-tls-config\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053574 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-config-volume\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053583 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/656c3fad-698c-4bd0-9c86-55096d05afa6-tls-assets\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053591 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.053763 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.053600 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/656c3fad-698c-4bd0-9c86-55096d05afa6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:39.796610 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.796576 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"656c3fad-698c-4bd0-9c86-55096d05afa6","Type":"ContainerDied","Data":"8a90a3076e7647de7daa7350a82528ee8e84281870f3102dad4a6682def70cac"} Jul 21 08:56:39.797037 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.796591 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.797037 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.796687 2564 scope.go:117] "RemoveContainer" containerID="ebe01e5af53cb4a7b7c317143186ebc19ea3e3751bfb0913dd0676d3faa9e8f2" Jul 21 08:56:39.804879 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.804862 2564 scope.go:117] "RemoveContainer" containerID="132d664fec6a43d4541e1d02415365dd04d7f92335c899a86033262911c640b2" Jul 21 08:56:39.811694 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.811667 2564 scope.go:117] "RemoveContainer" containerID="b35bb30ae6ea61a25b49e79b24086901c832e6eb3a9b374375fde02480857f48" Jul 21 08:56:39.818134 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.818115 2564 scope.go:117] "RemoveContainer" containerID="d32cd4bcfefbc174cd6aa0d90e144bf5004ce0b92bff33cc9defa44b96faace6" Jul 21 08:56:39.822551 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.822529 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:39.826281 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.826265 2564 scope.go:117] "RemoveContainer" containerID="0637ba6925e83ee1638413662c4f6dd4bcb5b3bfde581d8c2a12e915ec3d4e58" Jul 21 08:56:39.826793 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.826777 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:39.833323 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.833309 2564 scope.go:117] "RemoveContainer" containerID="fd9979544666e06f50242f6bc4a889f7d011139f9c5e14c98318a8c36630a1b2" Jul 21 08:56:39.839918 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.839902 2564 scope.go:117] "RemoveContainer" containerID="7e695cdccb3884cce5325dea57cbe77c6a3ead67a5c1f7cb51f7ae4519aac0f6" Jul 21 08:56:39.852999 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.852979 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:39.853307 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853293 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="prom-label-proxy" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853310 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="prom-label-proxy" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853326 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="alertmanager" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853334 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="alertmanager" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853345 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853353 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853365 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="init-config-reloader" Jul 21 08:56:39.853379 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853373 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="init-config-reloader" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853382 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="config-reloader" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853390 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="config-reloader" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853404 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-web" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853413 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-web" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853424 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-metric" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853432 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-metric" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853517 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="config-reloader" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853530 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-web" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853540 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="prom-label-proxy" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853549 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853559 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="kube-rbac-proxy-metric" Jul 21 08:56:39.853712 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.853567 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" containerName="alertmanager" Jul 21 08:56:39.856581 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.856563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.860371 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860349 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 08:56:39.860371 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 08:56:39.860535 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860377 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 08:56:39.860535 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860387 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p75bd\"" Jul 21 08:56:39.860853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860695 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 08:56:39.860853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860715 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 08:56:39.860853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860732 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 08:56:39.860853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860747 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 08:56:39.860853 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.860718 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 08:56:39.864990 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.864943 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 08:56:39.879655 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.879635 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:39.961421 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961421 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961421 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9vzh\" (UniqueName: \"kubernetes.io/projected/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-kube-api-access-n9vzh\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961678 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961678 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961542 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-config-volume\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961678 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961678 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961678 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961835 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-web-config\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961835 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961835 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-config-out\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961835 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:39.961835 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:39.961799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063096 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063096 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-web-config\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063334 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-config-out\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063489 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063489 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063451 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063586 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063586 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063586 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9vzh\" (UniqueName: \"kubernetes.io/projected/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-kube-api-access-n9vzh\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063737 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063737 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-config-volume\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.063737 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.063663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.064408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.064101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.064408 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.064301 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066379 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066397 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066399 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066498 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-web-config\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066680 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066640 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066932 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-config-out\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.066932 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.066880 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.067091 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.067072 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.068270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.068251 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-config-volume\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.075754 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.075738 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9vzh\" (UniqueName: \"kubernetes.io/projected/9bcc8ffa-a956-4fe1-bca6-8a1f8c069950-kube-api-access-n9vzh\") pod \"alertmanager-main-0\" (UID: \"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.166534 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.166507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 08:56:40.300265 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.300233 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 08:56:40.303710 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:56:40.303680 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcc8ffa_a956_4fe1_bca6_8a1f8c069950.slice/crio-26a2b73f3be88e89493ce4f5118ff3c02338e1c17a24fb83b664382156b4bf6e WatchSource:0}: Error finding container 26a2b73f3be88e89493ce4f5118ff3c02338e1c17a24fb83b664382156b4bf6e: Status 404 returned error can't find the container with id 26a2b73f3be88e89493ce4f5118ff3c02338e1c17a24fb83b664382156b4bf6e Jul 21 08:56:40.802996 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.802945 2564 generic.go:356] "Generic (PLEG): container finished" podID="9bcc8ffa-a956-4fe1-bca6-8a1f8c069950" containerID="44f55d514de836118b2503b350b5908f01e205893c4eb4c823e8cc0943417a13" exitCode=0 Jul 21 08:56:40.803368 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.803040 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerDied","Data":"44f55d514de836118b2503b350b5908f01e205893c4eb4c823e8cc0943417a13"} Jul 21 08:56:40.803368 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:40.803102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"26a2b73f3be88e89493ce4f5118ff3c02338e1c17a24fb83b664382156b4bf6e"} Jul 21 08:56:41.019415 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.019391 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="656c3fad-698c-4bd0-9c86-55096d05afa6" path="/var/lib/kubelet/pods/656c3fad-698c-4bd0-9c86-55096d05afa6/volumes" Jul 21 08:56:41.811644 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.811597 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"d1cc7bb54c9d425c7d56842ed498123d2ce41beec013571beb65238ab4be821b"} Jul 21 08:56:41.812119 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.811697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"c9360e81869c046deb44adcd7a41c133ee46c77785585502cfb8f15157bfe877"} Jul 21 08:56:41.812119 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.811745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"b797fca7de91cf304f21f4d9d56f8aaf77706c51dfa08bf2cf4c4e445fbfaff7"} Jul 21 08:56:41.812119 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.811788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"b212d67efaab558462fb21f477df4f853f4ceef0aeefc182bc28379ce9771f94"} Jul 21 08:56:41.812119 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.811837 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"89c92bc5ffe3f8b32b4f4c143e6f47b6f862ade8138b4de6dbdcd04df044c0b5"} Jul 21 08:56:41.812119 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.811876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9bcc8ffa-a956-4fe1-bca6-8a1f8c069950","Type":"ContainerStarted","Data":"941c49b9d7bcfde32cc3166d3fdf5bac93436a062e976777d7cd89e90f899771"} Jul 21 08:56:41.841920 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:41.841864 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.826415815 podStartE2EDuration="2.841846088s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.430273ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:56:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:56:41.840892084 +0000 UTC m=+153.347005381" watchObservedRunningTime="2026-07-21 08:56:41.841846088 +0000 UTC m=+153.347959344" Jul 21 08:56:42.002182 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002143 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:56:42.002556 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002507 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="prometheus" containerID="cri-o://5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1" gracePeriod=600 Jul 21 08:56:42.002640 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002553 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671" gracePeriod=600 Jul 21 08:56:42.002640 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002566 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-web" containerID="cri-o://bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821" gracePeriod=600 Jul 21 08:56:42.002640 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002606 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="thanos-sidecar" containerID="cri-o://75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802" gracePeriod=600 Jul 21 08:56:42.002765 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002637 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="config-reloader" containerID="cri-o://f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171" gracePeriod=600 Jul 21 08:56:42.002821 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.002773 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy" containerID="cri-o://ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512" gracePeriod=600 Jul 21 08:56:42.818791 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818759 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671" exitCode=0 Jul 21 08:56:42.818791 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818784 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512" exitCode=0 Jul 21 08:56:42.818791 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818791 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802" exitCode=0 Jul 21 08:56:42.818791 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818796 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171" exitCode=0 Jul 21 08:56:42.819308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818803 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1" exitCode=0 Jul 21 08:56:42.819308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671"} Jul 21 08:56:42.819308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512"} Jul 21 08:56:42.819308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.818978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802"} Jul 21 08:56:42.819308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.819020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171"} Jul 21 08:56:42.819308 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:42.819061 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1"} Jul 21 08:56:43.253134 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.253112 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.392606 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392518 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-kubelet-serving-ca-bundle\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392606 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392566 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-1\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392606 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392584 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-serving-certs-ca-bundle\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392606 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392610 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-kube-rbac-proxy\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392625 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-metrics-client-certs\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392654 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-metrics-client-ca\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392681 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-tls\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392705 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-0\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392731 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-trusted-ca-bundle\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392755 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-config-out\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392782 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-thanos-prometheus-http-client-file\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392814 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-config\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392848 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr65s\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-kube-api-access-zr65s\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.392910 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392892 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-tls-assets\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392922 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.392972 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-db\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393003 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393019 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393059 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-2\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393073 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393103 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-web-config\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393134 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-grpc-tls\") pod \"619f17de-9ca5-4408-a1f4-08778ad3186f\" (UID: \"619f17de-9ca5-4408-a1f4-08778ad3186f\") " Jul 21 08:56:43.393414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393201 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.393849 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393455 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.393849 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393476 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.393849 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393473 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.393849 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.393491 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-metrics-client-ca\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.394313 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.394198 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.394837 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.394811 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:56:43.395321 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.395290 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.396091 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.395829 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-kube-api-access-zr65s" (OuterVolumeSpecName: "kube-api-access-zr65s") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "kube-api-access-zr65s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:43.396091 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.396044 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.396290 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.396223 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.396354 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.396333 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 08:56:43.396458 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.396431 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-config-out" (OuterVolumeSpecName: "config-out") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 08:56:43.396719 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.396682 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.396813 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.396777 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.397725 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.397696 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 08:56:43.398101 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.398071 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.398331 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.398308 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.398432 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.398411 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.398884 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.398859 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-config" (OuterVolumeSpecName: "config") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.407489 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.407466 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-web-config" (OuterVolumeSpecName: "web-config") pod "619f17de-9ca5-4408-a1f4-08778ad3186f" (UID: "619f17de-9ca5-4408-a1f4-08778ad3186f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 08:56:43.494702 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494675 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494702 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494698 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494702 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494707 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494717 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-config-out\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494726 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494735 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-config\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494744 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr65s\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-kube-api-access-zr65s\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494753 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/619f17de-9ca5-4408-a1f4-08778ad3186f-tls-assets\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494761 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494770 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-db\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494778 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494786 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494796 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-web-config\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494804 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-grpc-tls\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494811 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/619f17de-9ca5-4408-a1f4-08778ad3186f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494820 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-kube-rbac-proxy\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.494899 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.494828 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/619f17de-9ca5-4408-a1f4-08778ad3186f-secret-metrics-client-certs\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 08:56:43.826881 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.826849 2564 generic.go:356] "Generic (PLEG): container finished" podID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerID="bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821" exitCode=0 Jul 21 08:56:43.827249 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.826942 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.827249 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.826937 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821"} Jul 21 08:56:43.827249 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.827112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"619f17de-9ca5-4408-a1f4-08778ad3186f","Type":"ContainerDied","Data":"a78f4fb765fbd36fd04e1ae39c07ec51e2c23a0e7c7190e8a5688e22f721e814"} Jul 21 08:56:43.827249 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.827146 2564 scope.go:117] "RemoveContainer" containerID="e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671" Jul 21 08:56:43.835532 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.835512 2564 scope.go:117] "RemoveContainer" containerID="ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512" Jul 21 08:56:43.842242 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.842227 2564 scope.go:117] "RemoveContainer" containerID="bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821" Jul 21 08:56:43.848833 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.848814 2564 scope.go:117] "RemoveContainer" containerID="75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802" Jul 21 08:56:43.853388 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.853360 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:56:43.858632 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.858605 2564 scope.go:117] "RemoveContainer" containerID="f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171" Jul 21 08:56:43.860415 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.860398 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:56:43.866023 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.866006 2564 scope.go:117] "RemoveContainer" containerID="5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1" Jul 21 08:56:43.872933 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.872914 2564 scope.go:117] "RemoveContainer" containerID="cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624" Jul 21 08:56:43.879392 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.879376 2564 scope.go:117] "RemoveContainer" containerID="e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671" Jul 21 08:56:43.879632 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.879614 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671\": container with ID starting with e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671 not found: ID does not exist" containerID="e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671" Jul 21 08:56:43.879674 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.879641 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671"} err="failed to get container status \"e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671\": rpc error: code = NotFound desc = could not find container \"e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671\": container with ID starting with e77d9da56c959b5c0ec41be22a74bb2ae198694ee30e0a8296036d21a7b87671 not found: ID does not exist" Jul 21 08:56:43.879714 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.879674 2564 scope.go:117] "RemoveContainer" containerID="ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512" Jul 21 08:56:43.879916 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.879902 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512\": container with ID starting with ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512 not found: ID does not exist" containerID="ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512" Jul 21 08:56:43.879977 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.879920 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512"} err="failed to get container status \"ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512\": rpc error: code = NotFound desc = could not find container \"ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512\": container with ID starting with ea255c97331d240d72ad57d3b9f8ed544ce93c579c6928710c7cb9a84aa86512 not found: ID does not exist" Jul 21 08:56:43.879977 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.879933 2564 scope.go:117] "RemoveContainer" containerID="bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821" Jul 21 08:56:43.880162 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.880148 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821\": container with ID starting with bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821 not found: ID does not exist" containerID="bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821" Jul 21 08:56:43.880204 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880165 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821"} err="failed to get container status \"bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821\": rpc error: code = NotFound desc = could not find container \"bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821\": container with ID starting with bfe7a947115145cb8a93d94a4ca6b343e66c43bb016ee563654953b1cf97f821 not found: ID does not exist" Jul 21 08:56:43.880204 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880176 2564 scope.go:117] "RemoveContainer" containerID="75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802" Jul 21 08:56:43.880399 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.880370 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802\": container with ID starting with 75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802 not found: ID does not exist" containerID="75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802" Jul 21 08:56:43.880436 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880403 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802"} err="failed to get container status \"75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802\": rpc error: code = NotFound desc = could not find container \"75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802\": container with ID starting with 75ddebbca2670752cfec8bfbcd5c530532fb5709eaa17678f126a2dde111e802 not found: ID does not exist" Jul 21 08:56:43.880436 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880414 2564 scope.go:117] "RemoveContainer" containerID="f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171" Jul 21 08:56:43.880628 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.880613 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171\": container with ID starting with f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171 not found: ID does not exist" containerID="f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171" Jul 21 08:56:43.880679 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880632 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171"} err="failed to get container status \"f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171\": rpc error: code = NotFound desc = could not find container \"f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171\": container with ID starting with f2cc57a27bf138c4dfac97ec85b07186bdc5c09c79d4bdd8f862b4cd352dd171 not found: ID does not exist" Jul 21 08:56:43.880679 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880644 2564 scope.go:117] "RemoveContainer" containerID="5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1" Jul 21 08:56:43.880830 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.880815 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1\": container with ID starting with 5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1 not found: ID does not exist" containerID="5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1" Jul 21 08:56:43.880867 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880833 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1"} err="failed to get container status \"5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1\": rpc error: code = NotFound desc = could not find container \"5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1\": container with ID starting with 5cd5ff39954c1c41d92c75f3628d1bc89554fe282d3b2e0855b51a174a406fd1 not found: ID does not exist" Jul 21 08:56:43.880867 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.880846 2564 scope.go:117] "RemoveContainer" containerID="cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624" Jul 21 08:56:43.881102 ip-10-0-133-119 kubenswrapper[2564]: E0721 08:56:43.881085 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624\": container with ID starting with cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624 not found: ID does not exist" containerID="cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624" Jul 21 08:56:43.881178 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.881103 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624"} err="failed to get container status \"cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624\": rpc error: code = NotFound desc = could not find container \"cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624\": container with ID starting with cc91a53f7557c1d2a3a990b39ca0259bcd47965e73c842b03f07e38244f96624 not found: ID does not exist" Jul 21 08:56:43.889437 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889417 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:56:43.889708 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889697 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="init-config-reloader" Jul 21 08:56:43.889753 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889710 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="init-config-reloader" Jul 21 08:56:43.889753 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889726 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="thanos-sidecar" Jul 21 08:56:43.889753 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889731 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="thanos-sidecar" Jul 21 08:56:43.889753 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889743 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy" Jul 21 08:56:43.889753 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889750 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889758 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-thanos" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889763 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-thanos" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889771 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="prometheus" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889776 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="prometheus" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889782 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="config-reloader" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889787 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="config-reloader" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889795 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-web" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889800 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-web" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889841 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="config-reloader" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889849 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="prometheus" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889856 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889862 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-web" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889867 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="kube-rbac-proxy-thanos" Jul 21 08:56:43.889898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.889873 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" containerName="thanos-sidecar" Jul 21 08:56:43.893553 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.893535 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.899728 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.899625 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 21 08:56:43.899809 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.899624 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 21 08:56:43.899902 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.899885 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 21 08:56:43.900181 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.900138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 21 08:56:43.902912 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.902650 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 21 08:56:43.902912 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.902873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 21 08:56:43.902912 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.902893 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 21 08:56:43.903149 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903028 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 21 08:56:43.903149 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903059 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 21 08:56:43.903149 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903135 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z4qqw\"" Jul 21 08:56:43.903295 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903147 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 21 08:56:43.903480 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 21 08:56:43.903480 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903471 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 21 08:56:43.903735 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.903723 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6q75ntiejjfjq\"" Jul 21 08:56:43.905389 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.905374 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 21 08:56:43.909866 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.909851 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 21 08:56:43.918352 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.918333 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:56:43.997907 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.997807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da1bdea8-b78a-440d-8381-4ef42b284cd9-config-out\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.997907 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.997852 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.997907 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.997880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.997907 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.997906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-config\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.997927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.997975 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da1bdea8-b78a-440d-8381-4ef42b284cd9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998135 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-web-config\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998163 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998193 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998260 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998354 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:43.998444 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:43.998398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6vj\" (UniqueName: \"kubernetes.io/projected/da1bdea8-b78a-440d-8381-4ef42b284cd9-kube-api-access-xp6vj\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.099757 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-config\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.099757 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100032 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099779 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100032 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da1bdea8-b78a-440d-8381-4ef42b284cd9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100032 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099837 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100032 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099866 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100032 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.099900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-web-config\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100193 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100270 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6vj\" (UniqueName: \"kubernetes.io/projected/da1bdea8-b78a-440d-8381-4ef42b284cd9-kube-api-access-xp6vj\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da1bdea8-b78a-440d-8381-4ef42b284cd9-config-out\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100517 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.100676 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.100555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.101288 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.101100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.101862 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.101835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.102178 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.102153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.102433 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.102407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.102770 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.102745 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.103515 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.103490 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.103938 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.103909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.104046 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.103985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-web-config\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.104414 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.104388 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da1bdea8-b78a-440d-8381-4ef42b284cd9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.104625 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.104603 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.105421 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.105098 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/da1bdea8-b78a-440d-8381-4ef42b284cd9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.105421 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.105383 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.105556 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.105442 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.105673 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.105656 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da1bdea8-b78a-440d-8381-4ef42b284cd9-config-out\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.105761 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.105740 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.106152 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.106137 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-config\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.106563 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.106547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/da1bdea8-b78a-440d-8381-4ef42b284cd9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.111795 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.111778 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6vj\" (UniqueName: \"kubernetes.io/projected/da1bdea8-b78a-440d-8381-4ef42b284cd9-kube-api-access-xp6vj\") pod \"prometheus-k8s-0\" (UID: \"da1bdea8-b78a-440d-8381-4ef42b284cd9\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.203086 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.203056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:56:44.356157 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.356126 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 21 08:56:44.359690 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:56:44.359659 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1bdea8_b78a_440d_8381_4ef42b284cd9.slice/crio-9733db8bb981099b5ca865559fcfbe0bcdc8ca635c663b04e9265bb7a938cb28 WatchSource:0}: Error finding container 9733db8bb981099b5ca865559fcfbe0bcdc8ca635c663b04e9265bb7a938cb28: Status 404 returned error can't find the container with id 9733db8bb981099b5ca865559fcfbe0bcdc8ca635c663b04e9265bb7a938cb28 Jul 21 08:56:44.833101 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.833065 2564 generic.go:356] "Generic (PLEG): container finished" podID="da1bdea8-b78a-440d-8381-4ef42b284cd9" containerID="beb91e9f3d4309ada0e1b80ac447dee1c7bd73ff34290449c44eb79057075aa8" exitCode=0 Jul 21 08:56:44.833511 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.833146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerDied","Data":"beb91e9f3d4309ada0e1b80ac447dee1c7bd73ff34290449c44eb79057075aa8"} Jul 21 08:56:44.833511 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:44.833211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"9733db8bb981099b5ca865559fcfbe0bcdc8ca635c663b04e9265bb7a938cb28"} Jul 21 08:56:45.022939 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.022911 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619f17de-9ca5-4408-a1f4-08778ad3186f" path="/var/lib/kubelet/pods/619f17de-9ca5-4408-a1f4-08778ad3186f/volumes" Jul 21 08:56:45.841085 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.841052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"9e307d7c1d37d04a1303c8db8e620305ab40ce85d05b08e3bed6bb57f2e0ddd7"} Jul 21 08:56:45.841518 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.841114 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"f0ecc16bca2a14352bd30c23b2b6cc33f3ada3dbb3db6e1e2646dcc084291f60"} Jul 21 08:56:45.841518 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.841142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"53a5e9d068df6478b64fc622fe0dc17611b6804a60888ce42074b151abbc84a7"} Jul 21 08:56:45.841518 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.841168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"132206c5d5274ce6a07263ff9b8195d8cf97c9163af7b9e9c1fe270b63129f62"} Jul 21 08:56:45.841518 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.841190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"efa632c4acdbd3c732742ada42a949113c122d3d8bc9ab96d92af826967a2376"} Jul 21 08:56:45.841518 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.841213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"da1bdea8-b78a-440d-8381-4ef42b284cd9","Type":"ContainerStarted","Data":"151b70d6fb83049337115e15c27287204898d1f759a4c160cf481a47e031a833"} Jul 21 08:56:45.887514 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:45.887461 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.869991697 podStartE2EDuration="2.88744253s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.450833ms" isStatefulPod=false podCreationTimestamp="2026-07-21 08:56:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:56:45.886169177 +0000 UTC m=+157.392282421" watchObservedRunningTime="2026-07-21 08:56:45.88744253 +0000 UTC m=+157.393555773" Jul 21 08:56:49.203475 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:56:49.203447 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:44.203328 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:57:44.203276 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:44.218943 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:57:44.218920 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:57:45.094522 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:57:45.094495 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 21 08:59:08.852149 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:08.852122 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 08:59:21.730211 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.730171 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9q4zk"] Jul 21 08:59:21.733718 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.733695 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:21.737004 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.736979 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2spmj\"" Jul 21 08:59:21.738225 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.738211 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 08:59:21.738307 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.738291 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 08:59:21.751945 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.751925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9q4zk"] Jul 21 08:59:21.834852 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.834816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gb82\" (UniqueName: \"kubernetes.io/projected/87ff14e8-3df4-4233-9384-ca42eef7c376-kube-api-access-9gb82\") pod \"cert-manager-webhook-6486ffd997-9q4zk\" (UID: \"87ff14e8-3df4-4233-9384-ca42eef7c376\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:21.835052 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.834860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87ff14e8-3df4-4233-9384-ca42eef7c376-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9q4zk\" (UID: \"87ff14e8-3df4-4233-9384-ca42eef7c376\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:21.936058 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.936023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gb82\" (UniqueName: \"kubernetes.io/projected/87ff14e8-3df4-4233-9384-ca42eef7c376-kube-api-access-9gb82\") pod \"cert-manager-webhook-6486ffd997-9q4zk\" (UID: \"87ff14e8-3df4-4233-9384-ca42eef7c376\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:21.936223 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.936067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87ff14e8-3df4-4233-9384-ca42eef7c376-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9q4zk\" (UID: \"87ff14e8-3df4-4233-9384-ca42eef7c376\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:21.947438 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.947414 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87ff14e8-3df4-4233-9384-ca42eef7c376-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9q4zk\" (UID: \"87ff14e8-3df4-4233-9384-ca42eef7c376\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:21.947563 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:21.947545 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gb82\" (UniqueName: \"kubernetes.io/projected/87ff14e8-3df4-4233-9384-ca42eef7c376-kube-api-access-9gb82\") pod \"cert-manager-webhook-6486ffd997-9q4zk\" (UID: \"87ff14e8-3df4-4233-9384-ca42eef7c376\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:22.056012 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:22.055901 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:22.197210 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:22.197187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9q4zk"] Jul 21 08:59:22.198253 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:59:22.198227 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ff14e8_3df4_4233_9384_ca42eef7c376.slice/crio-95f654a76f02fccb718ef0f9abafed2758bc0b352685fceff5029aef19d23f0c WatchSource:0}: Error finding container 95f654a76f02fccb718ef0f9abafed2758bc0b352685fceff5029aef19d23f0c: Status 404 returned error can't find the container with id 95f654a76f02fccb718ef0f9abafed2758bc0b352685fceff5029aef19d23f0c Jul 21 08:59:22.200103 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:22.200088 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 08:59:22.465491 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:22.465459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" event={"ID":"87ff14e8-3df4-4233-9384-ca42eef7c376","Type":"ContainerStarted","Data":"95f654a76f02fccb718ef0f9abafed2758bc0b352685fceff5029aef19d23f0c"} Jul 21 08:59:25.481465 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:25.481430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" event={"ID":"87ff14e8-3df4-4233-9384-ca42eef7c376","Type":"ContainerStarted","Data":"e7b84f6ac05b4bb5d3181a91de44da51a3bdc5974fae184140d93f7cf4619ba7"} Jul 21 08:59:25.481907 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:25.481496 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:25.499898 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:25.499814 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" podStartSLOduration=1.4492886170000001 podStartE2EDuration="4.499799425s" totalImagesPullingTime="3.050510808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:59:25.498796164 +0000 UTC m=+317.004909413" watchObservedRunningTime="2026-07-21 08:59:25.499799425 +0000 UTC m=+317.005912668" Jul 21 08:59:31.488540 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:31.488502 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9q4zk" Jul 21 08:59:33.890574 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:33.890542 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-496cj"] Jul 21 08:59:33.893705 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:33.893689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:33.896163 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:33.896140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tdd2h\"" Jul 21 08:59:33.903693 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:33.903673 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-496cj"] Jul 21 08:59:33.935437 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:33.935406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4mm\" (UniqueName: \"kubernetes.io/projected/f84b6737-dc2e-441f-9b4b-3c01c5eeecc3-kube-api-access-sk4mm\") pod \"cert-manager-55b4d954d5-496cj\" (UID: \"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3\") " pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:33.935595 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:33.935445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f84b6737-dc2e-441f-9b4b-3c01c5eeecc3-bound-sa-token\") pod \"cert-manager-55b4d954d5-496cj\" (UID: \"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3\") " pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:34.036363 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.036316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4mm\" (UniqueName: \"kubernetes.io/projected/f84b6737-dc2e-441f-9b4b-3c01c5eeecc3-kube-api-access-sk4mm\") pod \"cert-manager-55b4d954d5-496cj\" (UID: \"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3\") " pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:34.036363 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.036370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f84b6737-dc2e-441f-9b4b-3c01c5eeecc3-bound-sa-token\") pod \"cert-manager-55b4d954d5-496cj\" (UID: \"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3\") " pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:34.045117 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.045089 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f84b6737-dc2e-441f-9b4b-3c01c5eeecc3-bound-sa-token\") pod \"cert-manager-55b4d954d5-496cj\" (UID: \"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3\") " pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:34.045224 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.045157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4mm\" (UniqueName: \"kubernetes.io/projected/f84b6737-dc2e-441f-9b4b-3c01c5eeecc3-kube-api-access-sk4mm\") pod \"cert-manager-55b4d954d5-496cj\" (UID: \"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3\") " pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:34.201893 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.201865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-496cj" Jul 21 08:59:34.327023 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.326988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-496cj"] Jul 21 08:59:34.330512 ip-10-0-133-119 kubenswrapper[2564]: W0721 08:59:34.330482 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf84b6737_dc2e_441f_9b4b_3c01c5eeecc3.slice/crio-9cbbc4eaf7097bd56a2ee41e999cedc4a2e51cc5cc8f7bc8a7eda7175c7953b0 WatchSource:0}: Error finding container 9cbbc4eaf7097bd56a2ee41e999cedc4a2e51cc5cc8f7bc8a7eda7175c7953b0: Status 404 returned error can't find the container with id 9cbbc4eaf7097bd56a2ee41e999cedc4a2e51cc5cc8f7bc8a7eda7175c7953b0 Jul 21 08:59:34.517822 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.517737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-496cj" event={"ID":"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3","Type":"ContainerStarted","Data":"9faa005bf0295c5f04cd9642a1a36a3897881f1203bd31b497c1424e44675241"} Jul 21 08:59:34.517822 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.517781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-496cj" event={"ID":"f84b6737-dc2e-441f-9b4b-3c01c5eeecc3","Type":"ContainerStarted","Data":"9cbbc4eaf7097bd56a2ee41e999cedc4a2e51cc5cc8f7bc8a7eda7175c7953b0"} Jul 21 08:59:34.534690 ip-10-0-133-119 kubenswrapper[2564]: I0721 08:59:34.534639 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-496cj" podStartSLOduration=1.5346235049999999 podStartE2EDuration="1.534623505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 08:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 08:59:34.533533862 +0000 UTC m=+326.039647103" watchObservedRunningTime="2026-07-21 08:59:34.534623505 +0000 UTC m=+326.040736747" Jul 21 09:02:35.111622 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.111593 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7"] Jul 21 09:02:35.114812 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.114793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.118045 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.118027 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"kube-root-ca.crt\"" Jul 21 09:02:35.118151 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.118081 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"trainer-operator-system\"/\"trainer-operator-controller-manager-dockercfg-gg8rb\"" Jul 21 09:02:35.119286 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.119272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"trainer-operator-system\"/\"openshift-service-ca.crt\"" Jul 21 09:02:35.123319 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.123299 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7"] Jul 21 09:02:35.132456 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.132435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2653d35e-2039-4ce0-91dc-0b17e81291de-tmp\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.132540 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.132473 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k46kn\" (UniqueName: \"kubernetes.io/projected/2653d35e-2039-4ce0-91dc-0b17e81291de-kube-api-access-k46kn\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.132540 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.132508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/2653d35e-2039-4ce0-91dc-0b17e81291de-manifests-work\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.233463 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.233430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k46kn\" (UniqueName: \"kubernetes.io/projected/2653d35e-2039-4ce0-91dc-0b17e81291de-kube-api-access-k46kn\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.233663 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.233492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/2653d35e-2039-4ce0-91dc-0b17e81291de-manifests-work\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.233663 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.233577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2653d35e-2039-4ce0-91dc-0b17e81291de-tmp\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.233918 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.233898 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2653d35e-2039-4ce0-91dc-0b17e81291de-tmp\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.234009 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.233925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests-work\" (UniqueName: \"kubernetes.io/empty-dir/2653d35e-2039-4ce0-91dc-0b17e81291de-manifests-work\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.242572 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.242551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k46kn\" (UniqueName: \"kubernetes.io/projected/2653d35e-2039-4ce0-91dc-0b17e81291de-kube-api-access-k46kn\") pod \"trainer-operator-controller-manager-6b558fc48f-xkvd7\" (UID: \"2653d35e-2039-4ce0-91dc-0b17e81291de\") " pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.424582 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.424500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:35.558001 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:35.557978 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7"] Jul 21 09:02:35.560544 ip-10-0-133-119 kubenswrapper[2564]: W0721 09:02:35.560522 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2653d35e_2039_4ce0_91dc_0b17e81291de.slice/crio-9f457cb7ae849a86ffd7ea518dec7c5779d602337116d66a085e9f0300d90e35 WatchSource:0}: Error finding container 9f457cb7ae849a86ffd7ea518dec7c5779d602337116d66a085e9f0300d90e35: Status 404 returned error can't find the container with id 9f457cb7ae849a86ffd7ea518dec7c5779d602337116d66a085e9f0300d90e35 Jul 21 09:02:36.260011 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:36.259975 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" event={"ID":"2653d35e-2039-4ce0-91dc-0b17e81291de","Type":"ContainerStarted","Data":"9f457cb7ae849a86ffd7ea518dec7c5779d602337116d66a085e9f0300d90e35"} Jul 21 09:02:38.270274 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:38.270236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" event={"ID":"2653d35e-2039-4ce0-91dc-0b17e81291de","Type":"ContainerStarted","Data":"d5297c083e4b1018df29da09309bbf5824c009a8812bf814fe24ef1d26bca30f"} Jul 21 09:02:38.270685 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:38.270345 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:38.292593 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:38.292541 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" podStartSLOduration=0.990645906 podStartE2EDuration="3.292525317s" totalImagesPullingTime="2.301879411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 09:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 09:02:38.290452112 +0000 UTC m=+509.796565355" watchObservedRunningTime="2026-07-21 09:02:38.292525317 +0000 UTC m=+509.798638560" Jul 21 09:02:49.276712 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:49.276634 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="trainer-operator-system/trainer-operator-controller-manager-6b558fc48f-xkvd7" Jul 21 09:02:52.971523 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:52.971486 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bphwp/must-gather-snftm"] Jul 21 09:02:52.975109 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:52.975090 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:52.977995 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:52.977977 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bphwp\"/\"openshift-service-ca.crt\"" Jul 21 09:02:52.978094 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:52.978026 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bphwp\"/\"kube-root-ca.crt\"" Jul 21 09:02:52.979152 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:52.979140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bphwp\"/\"default-dockercfg-45bfz\"" Jul 21 09:02:52.983116 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:52.983097 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bphwp/must-gather-snftm"] Jul 21 09:02:53.072769 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.072730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfsqq\" (UniqueName: \"kubernetes.io/projected/31ede27b-cc73-4884-afac-a8ca9f53daef-kube-api-access-wfsqq\") pod \"must-gather-snftm\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.072769 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.072782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31ede27b-cc73-4884-afac-a8ca9f53daef-must-gather-output\") pod \"must-gather-snftm\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.174215 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.174176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfsqq\" (UniqueName: \"kubernetes.io/projected/31ede27b-cc73-4884-afac-a8ca9f53daef-kube-api-access-wfsqq\") pod \"must-gather-snftm\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.174215 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.174219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31ede27b-cc73-4884-afac-a8ca9f53daef-must-gather-output\") pod \"must-gather-snftm\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.174504 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.174489 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31ede27b-cc73-4884-afac-a8ca9f53daef-must-gather-output\") pod \"must-gather-snftm\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.183304 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.183280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfsqq\" (UniqueName: \"kubernetes.io/projected/31ede27b-cc73-4884-afac-a8ca9f53daef-kube-api-access-wfsqq\") pod \"must-gather-snftm\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.284729 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.284645 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:02:53.414618 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:53.414593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bphwp/must-gather-snftm"] Jul 21 09:02:53.416735 ip-10-0-133-119 kubenswrapper[2564]: W0721 09:02:53.416705 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31ede27b_cc73_4884_afac_a8ca9f53daef.slice/crio-adea8e5dd95fe042da84d6ed8c88f3d00d85d30b1767a75c570ab97c46c9c3d8 WatchSource:0}: Error finding container adea8e5dd95fe042da84d6ed8c88f3d00d85d30b1767a75c570ab97c46c9c3d8: Status 404 returned error can't find the container with id adea8e5dd95fe042da84d6ed8c88f3d00d85d30b1767a75c570ab97c46c9c3d8 Jul 21 09:02:54.338895 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:02:54.338837 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bphwp/must-gather-snftm" event={"ID":"31ede27b-cc73-4884-afac-a8ca9f53daef","Type":"ContainerStarted","Data":"adea8e5dd95fe042da84d6ed8c88f3d00d85d30b1767a75c570ab97c46c9c3d8"} Jul 21 09:03:00.367308 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:00.367266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bphwp/must-gather-snftm" event={"ID":"31ede27b-cc73-4884-afac-a8ca9f53daef","Type":"ContainerStarted","Data":"60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e"} Jul 21 09:03:00.367308 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:00.367319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bphwp/must-gather-snftm" event={"ID":"31ede27b-cc73-4884-afac-a8ca9f53daef","Type":"ContainerStarted","Data":"294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad"} Jul 21 09:03:00.387982 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:00.387904 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bphwp/must-gather-snftm" podStartSLOduration=2.174110636 podStartE2EDuration="8.387884141s" totalImagesPullingTime="6.213773505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 09:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 09:03:00.386359288 +0000 UTC m=+531.892472530" watchObservedRunningTime="2026-07-21 09:03:00.387884141 +0000 UTC m=+531.893997387" Jul 21 09:03:46.575664 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:46.575631 2564 generic.go:356] "Generic (PLEG): container finished" podID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerID="294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad" exitCode=0 Jul 21 09:03:46.575664 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:46.575672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bphwp/must-gather-snftm" event={"ID":"31ede27b-cc73-4884-afac-a8ca9f53daef","Type":"ContainerDied","Data":"294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad"} Jul 21 09:03:46.576262 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:46.576098 2564 scope.go:117] "RemoveContainer" containerID="294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad" Jul 21 09:03:46.652776 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:46.652748 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bphwp_must-gather-snftm_31ede27b-cc73-4884-afac-a8ca9f53daef/gather/0.log" Jul 21 09:03:49.831493 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:49.831460 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-brfrx_23ce847a-6a34-4f52-a0c6-cda4d74e720c/global-pull-secret-syncer/0.log" Jul 21 09:03:50.014531 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:50.014501 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-846ck_a0fdae8f-fd1f-45f7-8948-2a11b86cfe9d/konnectivity-agent/0.log" Jul 21 09:03:50.093425 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:50.093347 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-119.ec2.internal_a6ae4102a8a8f6bbe6a8e1b8ed09059a/haproxy/0.log" Jul 21 09:03:52.001181 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.001149 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bphwp/must-gather-snftm"] Jul 21 09:03:52.001555 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.001328 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-bphwp/must-gather-snftm" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="copy" containerID="cri-o://60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e" gracePeriod=2 Jul 21 09:03:52.005872 ip-10-0-133-119 kubenswrapper[2564]: E0721 09:03:52.005826 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-snftm\" is forbidden: User \"system:node:ip-10-0-133-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bphwp\": no relationship found between node 'ip-10-0-133-119.ec2.internal' and this object" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:03:52.007656 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.007634 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bphwp/must-gather-snftm"] Jul 21 09:03:52.230355 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.230337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bphwp_must-gather-snftm_31ede27b-cc73-4884-afac-a8ca9f53daef/copy/0.log" Jul 21 09:03:52.232826 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.232806 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:03:52.235464 ip-10-0-133-119 kubenswrapper[2564]: E0721 09:03:52.235441 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-snftm\" is forbidden: User \"system:node:ip-10-0-133-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bphwp\": no relationship found between node 'ip-10-0-133-119.ec2.internal' and this object" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:03:52.316805 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.316720 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfsqq\" (UniqueName: \"kubernetes.io/projected/31ede27b-cc73-4884-afac-a8ca9f53daef-kube-api-access-wfsqq\") pod \"31ede27b-cc73-4884-afac-a8ca9f53daef\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " Jul 21 09:03:52.316805 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.316786 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31ede27b-cc73-4884-afac-a8ca9f53daef-must-gather-output\") pod \"31ede27b-cc73-4884-afac-a8ca9f53daef\" (UID: \"31ede27b-cc73-4884-afac-a8ca9f53daef\") " Jul 21 09:03:52.318091 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.318065 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31ede27b-cc73-4884-afac-a8ca9f53daef-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "31ede27b-cc73-4884-afac-a8ca9f53daef" (UID: "31ede27b-cc73-4884-afac-a8ca9f53daef"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 09:03:52.318973 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.318936 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31ede27b-cc73-4884-afac-a8ca9f53daef-kube-api-access-wfsqq" (OuterVolumeSpecName: "kube-api-access-wfsqq") pod "31ede27b-cc73-4884-afac-a8ca9f53daef" (UID: "31ede27b-cc73-4884-afac-a8ca9f53daef"). InnerVolumeSpecName "kube-api-access-wfsqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 09:03:52.417700 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.417670 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfsqq\" (UniqueName: \"kubernetes.io/projected/31ede27b-cc73-4884-afac-a8ca9f53daef-kube-api-access-wfsqq\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 09:03:52.417700 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.417693 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31ede27b-cc73-4884-afac-a8ca9f53daef-must-gather-output\") on node \"ip-10-0-133-119.ec2.internal\" DevicePath \"\"" Jul 21 09:03:52.600766 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.600699 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bphwp_must-gather-snftm_31ede27b-cc73-4884-afac-a8ca9f53daef/copy/0.log" Jul 21 09:03:52.601072 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.601052 2564 generic.go:356] "Generic (PLEG): container finished" podID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerID="60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e" exitCode=143 Jul 21 09:03:52.601115 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.601096 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:03:52.601167 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.601151 2564 scope.go:117] "RemoveContainer" containerID="60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e" Jul 21 09:03:52.603564 ip-10-0-133-119 kubenswrapper[2564]: E0721 09:03:52.603534 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-snftm\" is forbidden: User \"system:node:ip-10-0-133-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bphwp\": no relationship found between node 'ip-10-0-133-119.ec2.internal' and this object" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:03:52.608964 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.608934 2564 scope.go:117] "RemoveContainer" containerID="294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad" Jul 21 09:03:52.611177 ip-10-0-133-119 kubenswrapper[2564]: E0721 09:03:52.611145 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-snftm\" is forbidden: User \"system:node:ip-10-0-133-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bphwp\": no relationship found between node 'ip-10-0-133-119.ec2.internal' and this object" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" pod="openshift-must-gather-bphwp/must-gather-snftm" Jul 21 09:03:52.620718 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.620703 2564 scope.go:117] "RemoveContainer" containerID="60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e" Jul 21 09:03:52.620930 ip-10-0-133-119 kubenswrapper[2564]: E0721 09:03:52.620912 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e\": container with ID starting with 60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e not found: ID does not exist" containerID="60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e" Jul 21 09:03:52.621011 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.620940 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e"} err="failed to get container status \"60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e\": rpc error: code = NotFound desc = could not find container \"60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e\": container with ID starting with 60534198e3539cb8b96d41ff3a38ad9cede54d3fb8260b2964bffbcbdca5779e not found: ID does not exist" Jul 21 09:03:52.621011 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.620978 2564 scope.go:117] "RemoveContainer" containerID="294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad" Jul 21 09:03:52.621204 ip-10-0-133-119 kubenswrapper[2564]: E0721 09:03:52.621186 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad\": container with ID starting with 294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad not found: ID does not exist" containerID="294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad" Jul 21 09:03:52.621254 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:52.621210 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad"} err="failed to get container status \"294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad\": rpc error: code = NotFound desc = could not find container \"294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad\": container with ID starting with 294dbbbfaaee202adb2bff4dfdf990cf43d7af24f05d30f2aa7f0c0ef15cc0ad not found: ID does not exist" Jul 21 09:03:53.019687 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.019654 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" path="/var/lib/kubelet/pods/31ede27b-cc73-4884-afac-a8ca9f53daef/volumes" Jul 21 09:03:53.818380 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.818357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/alertmanager/0.log" Jul 21 09:03:53.849795 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.849772 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/config-reloader/0.log" Jul 21 09:03:53.874011 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.873989 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/kube-rbac-proxy-web/0.log" Jul 21 09:03:53.900192 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.900134 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/kube-rbac-proxy/0.log" Jul 21 09:03:53.925938 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.925917 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/kube-rbac-proxy-metric/0.log" Jul 21 09:03:53.950944 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.950921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/prom-label-proxy/0.log" Jul 21 09:03:53.980254 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:53.980231 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9bcc8ffa-a956-4fe1-bca6-8a1f8c069950/init-config-reloader/0.log" Jul 21 09:03:54.059795 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.059764 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-fxvxp_be7ff7af-2d10-4f06-ae50-831fca30922f/kube-state-metrics/0.log" Jul 21 09:03:54.085207 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.085141 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-fxvxp_be7ff7af-2d10-4f06-ae50-831fca30922f/kube-rbac-proxy-main/0.log" Jul 21 09:03:54.120662 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.120616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-fxvxp_be7ff7af-2d10-4f06-ae50-831fca30922f/kube-rbac-proxy-self/0.log" Jul 21 09:03:54.149986 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.149924 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6976c556c7-r8nhd_d75518b9-0436-4476-8bce-0c6156f4c4e9/metrics-server/0.log" Jul 21 09:03:54.197235 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.197209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-wv5qx_d768df45-0655-4dff-a36f-68c80c4f872a/monitoring-plugin/0.log" Jul 21 09:03:54.408890 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.408795 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vxz4j_1b129e55-c41e-4258-9ac5-a251a730380e/node-exporter/0.log" Jul 21 09:03:54.431749 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.431718 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vxz4j_1b129e55-c41e-4258-9ac5-a251a730380e/kube-rbac-proxy/0.log" Jul 21 09:03:54.456718 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.456695 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vxz4j_1b129e55-c41e-4258-9ac5-a251a730380e/init-textfile/0.log" Jul 21 09:03:54.486830 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.486802 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-95qtq_5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838/kube-rbac-proxy-main/0.log" Jul 21 09:03:54.520409 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.520385 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-95qtq_5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838/kube-rbac-proxy-self/0.log" Jul 21 09:03:54.552734 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.552702 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-95qtq_5aac5c8c-f3fc-43c5-bc5c-a6cef1fb7838/openshift-state-metrics/0.log" Jul 21 09:03:54.604492 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.604466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/prometheus/0.log" Jul 21 09:03:54.631658 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.631632 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/config-reloader/0.log" Jul 21 09:03:54.670932 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.670861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/thanos-sidecar/0.log" Jul 21 09:03:54.696466 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.696442 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/kube-rbac-proxy-web/0.log" Jul 21 09:03:54.724270 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.724251 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/kube-rbac-proxy/0.log" Jul 21 09:03:54.751773 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.751753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/kube-rbac-proxy-thanos/0.log" Jul 21 09:03:54.777502 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.777482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_da1bdea8-b78a-440d-8381-4ef42b284cd9/init-config-reloader/0.log" Jul 21 09:03:54.810009 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.809983 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-8gv4b_d4c66ef4-f6e4-421c-b013-f630e9f18989/prometheus-operator/0.log" Jul 21 09:03:54.834270 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.834242 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-8gv4b_d4c66ef4-f6e4-421c-b013-f630e9f18989/kube-rbac-proxy/0.log" Jul 21 09:03:54.861031 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.861015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-hhkn5_aa81938d-52a3-42f3-9ea8-957551f8e09f/prometheus-operator-admission-webhook/0.log" Jul 21 09:03:54.995893 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:54.995869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7858c7496-9t8f6_d2a5116b-c42a-4f12-b08c-12e30f925f75/thanos-query/0.log" Jul 21 09:03:55.023850 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:55.023829 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7858c7496-9t8f6_d2a5116b-c42a-4f12-b08c-12e30f925f75/kube-rbac-proxy-web/0.log" Jul 21 09:03:55.062156 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:55.062116 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7858c7496-9t8f6_d2a5116b-c42a-4f12-b08c-12e30f925f75/kube-rbac-proxy/0.log" Jul 21 09:03:55.108094 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:55.108072 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7858c7496-9t8f6_d2a5116b-c42a-4f12-b08c-12e30f925f75/prom-label-proxy/0.log" Jul 21 09:03:55.152111 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:55.152085 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7858c7496-9t8f6_d2a5116b-c42a-4f12-b08c-12e30f925f75/kube-rbac-proxy-rules/0.log" Jul 21 09:03:55.200361 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:55.200334 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7858c7496-9t8f6_d2a5116b-c42a-4f12-b08c-12e30f925f75/kube-rbac-proxy-metrics/0.log" Jul 21 09:03:57.404241 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404205 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6"] Jul 21 09:03:57.404653 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404636 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="gather" Jul 21 09:03:57.404711 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404656 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="gather" Jul 21 09:03:57.404711 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404669 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="copy" Jul 21 09:03:57.404711 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404675 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="copy" Jul 21 09:03:57.404805 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404733 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="gather" Jul 21 09:03:57.404805 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.404739 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="31ede27b-cc73-4884-afac-a8ca9f53daef" containerName="copy" Jul 21 09:03:57.406848 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.406830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-6hnhf_befb277e-be4c-4cfc-bac4-0dfb02a69cc5/download-server/0.log" Jul 21 09:03:57.409568 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.409553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.412559 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.412543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b94rk\"/\"kube-root-ca.crt\"" Jul 21 09:03:57.413870 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.413852 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b94rk\"/\"default-dockercfg-4xjpg\"" Jul 21 09:03:57.413979 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.413909 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b94rk\"/\"openshift-service-ca.crt\"" Jul 21 09:03:57.419933 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.419908 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6"] Jul 21 09:03:57.563677 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.563639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-lib-modules\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.563677 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.563680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khx29\" (UniqueName: \"kubernetes.io/projected/60166868-5d3d-4340-aa8b-3af3de141fb1-kube-api-access-khx29\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.564040 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.563710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-podres\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.564040 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.563787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-proc\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.564040 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.563854 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-sys\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665326 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-lib-modules\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665326 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khx29\" (UniqueName: \"kubernetes.io/projected/60166868-5d3d-4340-aa8b-3af3de141fb1-kube-api-access-khx29\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665499 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-podres\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665499 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-proc\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665499 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-sys\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665602 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665500 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-podres\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665602 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-lib-modules\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665602 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-proc\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.665602 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.665577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60166868-5d3d-4340-aa8b-3af3de141fb1-sys\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.674405 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.674385 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khx29\" (UniqueName: \"kubernetes.io/projected/60166868-5d3d-4340-aa8b-3af3de141fb1-kube-api-access-khx29\") pod \"perf-node-gather-daemonset-4nsl6\" (UID: \"60166868-5d3d-4340-aa8b-3af3de141fb1\") " pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.720129 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.720091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:57.850824 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:57.850799 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6"] Jul 21 09:03:57.853326 ip-10-0-133-119 kubenswrapper[2564]: W0721 09:03:57.853301 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod60166868_5d3d_4340_aa8b_3af3de141fb1.slice/crio-67b506868b1be9bfa2064b8556861307fe4aa26186758403de55f704992c64ac WatchSource:0}: Error finding container 67b506868b1be9bfa2064b8556861307fe4aa26186758403de55f704992c64ac: Status 404 returned error can't find the container with id 67b506868b1be9bfa2064b8556861307fe4aa26186758403de55f704992c64ac Jul 21 09:03:58.628633 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.628599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" event={"ID":"60166868-5d3d-4340-aa8b-3af3de141fb1","Type":"ContainerStarted","Data":"de061aea778beff30dc89e53cc892710c479252f88c6c04a63e5b6892944d53d"} Jul 21 09:03:58.629099 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.628645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" event={"ID":"60166868-5d3d-4340-aa8b-3af3de141fb1","Type":"ContainerStarted","Data":"67b506868b1be9bfa2064b8556861307fe4aa26186758403de55f704992c64ac"} Jul 21 09:03:58.629099 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.628683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:03:58.651823 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.651771 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" podStartSLOduration=1.651756462 podStartE2EDuration="1.651756462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 09:03:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 09:03:58.650266225 +0000 UTC m=+590.156379469" watchObservedRunningTime="2026-07-21 09:03:58.651756462 +0000 UTC m=+590.157869704" Jul 21 09:03:58.756372 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.756342 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22pbh_48787522-730b-4277-88a4-ae42927ef428/dns/0.log" Jul 21 09:03:58.786716 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.786689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-22pbh_48787522-730b-4277-88a4-ae42927ef428/kube-rbac-proxy/0.log" Jul 21 09:03:58.977001 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:58.976946 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxh4b_b98ae77d-01f1-4ccb-9e78-0c22b54f56ab/dns-node-resolver/0.log" Jul 21 09:03:59.514866 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:03:59.514836 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hmpbk_d386336a-956d-49bb-b5de-b454b9273c07/node-ca/0.log" Jul 21 09:04:00.683942 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:00.683916 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r49xt_6bd544cc-2a52-4258-b662-d6399ef2c8b2/serve-healthcheck-canary/0.log" Jul 21 09:04:01.101216 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:01.101142 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-drmz5_c0e87473-0e46-45d9-9fa9-3cb4a3179459/kube-rbac-proxy/0.log" Jul 21 09:04:01.122472 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:01.122445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-drmz5_c0e87473-0e46-45d9-9fa9-3cb4a3179459/exporter/0.log" Jul 21 09:04:01.145355 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:01.145315 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-drmz5_c0e87473-0e46-45d9-9fa9-3cb4a3179459/extractor/0.log" Jul 21 09:04:04.642568 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:04.642538 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b94rk/perf-node-gather-daemonset-4nsl6" Jul 21 09:04:08.510971 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.510921 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/kube-multus-additional-cni-plugins/0.log" Jul 21 09:04:08.542688 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.542661 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/egress-router-binary-copy/0.log" Jul 21 09:04:08.573879 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.573857 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/cni-plugins/0.log" Jul 21 09:04:08.627364 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.627339 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/bond-cni-plugin/0.log" Jul 21 09:04:08.655725 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.655702 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/routeoverride-cni/0.log" Jul 21 09:04:08.689139 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.689114 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/whereabouts-cni-bincopy/0.log" Jul 21 09:04:08.719434 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.719415 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-khzlq_7d981685-8ff8-467f-a909-24bfb7879462/whereabouts-cni/0.log" Jul 21 09:04:08.943698 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:08.943632 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j9lzw_655a93a7-f1ce-430c-88fb-83dbc8978c6c/kube-multus/0.log" Jul 21 09:04:09.184129 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:09.184107 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zgdhz_e08b2d0e-e440-4a23-9f99-13227f98a428/network-metrics-daemon/0.log" Jul 21 09:04:09.231817 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:09.231743 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zgdhz_e08b2d0e-e440-4a23-9f99-13227f98a428/kube-rbac-proxy/0.log" Jul 21 09:04:10.618296 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.618263 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/ovn-controller/0.log" Jul 21 09:04:10.639272 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.639241 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/ovn-acl-logging/0.log" Jul 21 09:04:10.662803 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.662776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/kube-rbac-proxy-node/0.log" Jul 21 09:04:10.686699 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.686673 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/kube-rbac-proxy-ovn-metrics/0.log" Jul 21 09:04:10.709999 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.709975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/northd/0.log" Jul 21 09:04:10.735942 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.735913 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/nbdb/0.log" Jul 21 09:04:10.758867 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.758839 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/sbdb/0.log" Jul 21 09:04:10.799851 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:10.799823 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-th279_1156f322-ce2d-4daf-9dd0-51ee525f042b/ovnkube-controller/0.log" Jul 21 09:04:11.856538 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:11.856508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ndszr_bf70dccc-a8b1-4129-b544-2243003907d0/network-check-target-container/0.log" Jul 21 09:04:12.861136 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:12.861106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8xzpv_82170038-0c50-4b51-a029-0a131d44d9f2/iptables-alerter/0.log" Jul 21 09:04:13.608000 ip-10-0-133-119 kubenswrapper[2564]: I0721 09:04:13.607974 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-27kpr_b8a0eab6-967d-4fc5-9259-587495db7f54/tuned/0.log"