Jul 24 13:35:36.298622 ip-10-0-138-191 systemd[1]: Starting Kubernetes Kubelet... Jul 24 13:35:36.686973 ip-10-0-138-191 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 13:35:36.686973 ip-10-0-138-191 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 13:35:36.686973 ip-10-0-138-191 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 13:35:36.686973 ip-10-0-138-191 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 13:35:36.686973 ip-10-0-138-191 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 13:35:36.687874 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.687039 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 13:35:36.695895 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695868 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:35:36.695895 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695896 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:35:36.695895 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695902 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695906 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695911 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695914 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695918 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695921 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695924 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695928 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695931 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695933 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695936 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695940 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695942 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695945 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695948 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695951 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695954 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695957 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695960 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695963 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:35:36.696023 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695966 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695969 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695972 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695975 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695977 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695980 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695984 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695987 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695990 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.695993 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696004 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696008 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696011 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696015 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696019 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696023 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696026 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696029 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696032 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696036 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:35:36.696572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696039 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696042 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696045 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696048 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696051 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696053 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696056 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696060 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696063 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696066 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696069 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696072 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696075 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696077 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696080 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696083 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696086 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696088 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696093 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696097 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:35:36.697136 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696100 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696103 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696106 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696109 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696114 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696116 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696120 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696122 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696125 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696128 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696131 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696133 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696136 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696139 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696142 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696144 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696147 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696150 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696153 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696157 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:35:36.697704 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696160 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696163 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696166 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696169 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696172 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696175 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696177 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696180 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696183 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696187 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696190 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696192 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696196 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696198 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696201 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696204 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.696206 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697047 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697055 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:35:36.698225 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697058 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697062 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697065 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697068 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697071 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697074 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697077 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697079 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697082 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697085 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697088 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697091 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697094 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697098 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697101 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697104 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697108 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697110 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697113 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697116 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:35:36.698738 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697119 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697121 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697124 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697127 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697130 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697133 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697136 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697139 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697142 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697146 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697149 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697153 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697156 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697159 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697162 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697165 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697168 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697171 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697174 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697177 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:35:36.699274 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697182 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697186 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697190 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697193 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697197 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697201 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697205 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697209 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697212 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697215 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697218 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697221 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697224 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697226 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697229 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697232 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697235 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697238 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697241 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697243 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:35:36.699810 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697247 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697250 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697252 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697255 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697258 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697261 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697263 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697266 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697269 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697272 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697278 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697282 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697285 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697288 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697291 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697294 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697300 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697302 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697306 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:35:36.700329 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697317 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697320 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697323 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697326 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697328 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697331 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697334 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697337 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697341 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697345 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697364 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697368 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697372 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697375 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697378 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697381 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697385 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697387 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697878 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:35:36.700855 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697884 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697889 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697893 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697896 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697900 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697903 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697907 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697910 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697914 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697917 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697923 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697926 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697929 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697933 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697936 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697939 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697942 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697945 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697948 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697951 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:35:36.701397 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697954 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697957 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697960 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697963 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697966 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697969 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697972 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697974 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697977 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697980 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697983 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697986 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697989 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697992 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.697995 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698000 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698003 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698006 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698009 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698011 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:35:36.701925 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698014 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698017 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698021 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698024 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698027 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698030 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698034 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698037 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698039 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698042 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698045 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698048 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698051 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698054 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698056 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698059 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698062 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698065 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698067 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:35:36.702535 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698070 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698073 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698077 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698081 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698084 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698087 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698090 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698097 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698099 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698102 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698105 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698109 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698112 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698114 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698119 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698122 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698125 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698128 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698131 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:35:36.703041 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698134 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698137 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698140 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698143 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698145 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698148 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698151 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698154 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698157 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698160 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698163 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698165 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698168 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698172 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698176 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698179 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698182 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698185 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.698188 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698269 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698280 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 13:35:36.703581 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698289 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698295 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698300 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698303 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698308 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698312 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698317 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698321 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698325 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698328 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698332 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698335 2579 flags.go:64] FLAG: --cgroup-root="" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698339 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698342 2579 flags.go:64] FLAG: --client-ca-file="" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698360 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698363 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698369 2579 flags.go:64] FLAG: --cluster-domain="" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698372 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698375 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698379 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698383 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698387 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698390 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 13:35:36.704174 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698394 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698397 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698400 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698403 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698407 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698411 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698414 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698419 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698422 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698426 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698429 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698432 2579 flags.go:64] FLAG: --enable-server="true" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698436 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698441 2579 flags.go:64] FLAG: --event-burst="100" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698444 2579 flags.go:64] FLAG: --event-qps="50" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698451 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698454 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698458 2579 flags.go:64] FLAG: --eviction-hard="" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698463 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698466 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698469 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698472 2579 flags.go:64] FLAG: --eviction-soft="" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698476 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698479 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698483 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 13:35:36.704777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698486 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698489 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698492 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698495 2579 flags.go:64] FLAG: --feature-gates="" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698500 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698503 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698506 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698510 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698513 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698517 2579 flags.go:64] FLAG: --help="false" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698520 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-138-191.ec2.internal" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698523 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698526 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698529 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698533 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698537 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698540 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698543 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698546 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698550 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698553 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698556 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698561 2579 flags.go:64] FLAG: --kube-reserved="" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698564 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 13:35:36.705541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698567 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698571 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698574 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698577 2579 flags.go:64] FLAG: --lock-file="" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698580 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698584 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698589 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698595 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698598 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698601 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698605 2579 flags.go:64] FLAG: --logging-format="text" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698608 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698611 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698614 2579 flags.go:64] FLAG: --manifest-url="" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698617 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698622 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698625 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698630 2579 flags.go:64] FLAG: --max-pods="110" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698633 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698637 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698640 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698659 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698663 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698667 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698671 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 13:35:36.706295 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698679 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698682 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698685 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698689 2579 flags.go:64] FLAG: --pod-cidr="" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698692 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698698 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698703 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698707 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698711 2579 flags.go:64] FLAG: --port="10250" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698714 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698718 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-072de4a4eaa5653da" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698721 2579 flags.go:64] FLAG: --qos-reserved="" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698724 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698728 2579 flags.go:64] FLAG: --register-node="true" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698732 2579 flags.go:64] FLAG: --register-with-taints="" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698736 2579 flags.go:64] FLAG: --registry-burst="10" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698740 2579 flags.go:64] FLAG: --registry-qps="5" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698743 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698746 2579 flags.go:64] FLAG: --reserved-memory="" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698751 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698754 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698758 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698761 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698764 2579 flags.go:64] FLAG: --runonce="false" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698767 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 13:35:36.707088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698771 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698774 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698777 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698780 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698784 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698789 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698793 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698796 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698799 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698803 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698806 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698809 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698813 2579 flags.go:64] FLAG: --system-cgroups="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698817 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698822 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698826 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698829 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698833 2579 flags.go:64] FLAG: --tls-min-version="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698836 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698839 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698843 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698846 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698849 2579 flags.go:64] FLAG: --v="2" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698854 2579 flags.go:64] FLAG: --version="false" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698858 2579 flags.go:64] FLAG: --vmodule="" Jul 24 13:35:36.707844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698862 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.698865 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699016 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699020 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699024 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699027 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699030 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699033 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699038 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699041 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699045 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699048 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699052 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699055 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699058 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699061 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699064 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699067 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699070 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699072 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:35:36.708646 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699075 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699078 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699081 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699083 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699086 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699089 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699092 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699095 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699098 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699100 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699104 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699108 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699110 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699113 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699116 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699119 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699122 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699124 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699129 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699132 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:35:36.709317 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699135 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699138 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699141 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699144 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699148 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699151 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699154 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699157 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699159 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699162 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699165 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699167 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699170 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699173 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699176 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699179 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699182 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699186 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699189 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699191 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:35:36.709933 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699194 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699197 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699200 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699203 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699206 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699209 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699212 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699214 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699217 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699220 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699223 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699226 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699229 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699232 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699235 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699238 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699242 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699245 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699247 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699250 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:35:36.710528 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699253 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699257 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699261 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699264 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699267 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699270 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699273 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699276 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699279 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699282 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699284 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699287 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699290 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699293 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699296 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699299 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699302 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699306 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699309 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:35:36.711095 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699312 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.699315 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.699942 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.707497 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.707520 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.707545 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.707552 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707618 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707624 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707628 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707631 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707634 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707637 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707642 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:35:36.711612 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707646 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707650 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707653 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707656 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707658 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707661 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707664 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707667 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707670 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707673 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707676 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707680 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707683 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707685 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707688 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707692 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707695 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707698 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707701 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:35:36.712004 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707704 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707706 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707709 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707712 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707715 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707719 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707722 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707724 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707727 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707730 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707733 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707735 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707738 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707741 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707744 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707747 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707750 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707753 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707756 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707758 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:35:36.712499 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707761 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707764 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707766 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707769 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707772 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707775 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707778 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707781 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707783 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707787 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707790 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707792 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707795 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707798 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707800 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707803 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707806 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707809 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707813 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707817 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:35:36.713031 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707820 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707823 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707826 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707829 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707832 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707835 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707838 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707841 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707843 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707846 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707849 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707852 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707856 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707858 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707861 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707865 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707869 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707872 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707875 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707878 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:35:36.713614 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707880 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707883 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707887 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707890 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707893 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707895 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707898 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707903 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707907 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707910 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707913 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707916 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.707919 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.707924 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708046 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 13:35:36.714153 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708052 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708055 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708058 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708062 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708065 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708068 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708071 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708075 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708078 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708081 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708084 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708087 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708090 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708093 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708096 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708098 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708101 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708104 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708106 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708109 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 13:35:36.714579 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708116 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708119 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708122 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708125 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708127 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708131 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708133 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708136 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708139 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708142 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708144 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708147 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708150 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708153 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708156 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708158 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708162 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708166 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708170 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708173 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 13:35:36.715121 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708175 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708178 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708181 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708184 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708187 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708190 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708192 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708195 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708198 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708200 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708203 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708205 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708208 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708212 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708215 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708218 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708220 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708223 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708226 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 13:35:36.715648 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708231 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708234 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708238 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708242 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708245 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708248 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708251 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708254 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708257 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708260 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708263 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708266 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708268 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708271 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708274 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708277 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708280 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708283 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708286 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708289 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 13:35:36.716496 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708291 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708295 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708297 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708300 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708303 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708306 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708310 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708314 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708318 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708320 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708323 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708326 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708329 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708332 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708334 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708337 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708340 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708343 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 13:35:36.717168 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:36.708346 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.708368 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.708521 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.710773 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.712151 2579 server.go:1019] "Starting client certificate rotation" Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.712262 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.712306 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 13:35:36.717748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.714693 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 13:35:36.718675 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.718658 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 13:35:36.734187 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.734155 2579 log.go:25] "Validated CRI v1 runtime API" Jul 24 13:35:36.736825 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.736804 2579 log.go:25] "Validated CRI v1 image API" Jul 24 13:35:36.737730 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.737715 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 13:35:36.740587 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.740563 2579 fs.go:135] Filesystem UUIDs: map[45f31157-4730-48d1-b8fe-a6063402d379:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c11b170d-44ce-4c42-9f55-c60c1db53551:/dev/nvme0n1p4] Jul 24 13:35:36.740694 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.740585 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 13:35:36.742672 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.742646 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 13:35:36.746362 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.746209 2579 manager.go:216] Machine: {Timestamp:2026-07-24 13:35:36.744808604 +0000 UTC m=+0.330411650 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098911 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2691ae7b840b0a826ebf28b217b6e0 SystemUUID:ec2691ae-7b84-0b0a-826e-bf28b217b6e0 BootID:d5954b1a-0ea5-4d97-a8ff-08b8b18e9708 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:c0:56:a7:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:c0:56:a7:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:a0:7d:60:10:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 13:35:36.746362 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.746335 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 13:35:36.746498 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.746449 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 13:35:36.749441 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.749389 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 13:35:36.749614 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.749444 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 13:35:36.750239 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.750227 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 13:35:36.750276 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.750242 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 13:35:36.750276 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.750251 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 13:35:36.750863 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.750850 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 13:35:36.752103 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.752090 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 13:35:36.755144 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755129 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 24 13:35:36.755304 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755293 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 13:35:36.755340 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755332 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 24 13:35:36.755403 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755369 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 13:35:36.755403 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755393 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 13:35:36.755460 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755408 2579 kubelet.go:398] "Adding apiserver pod source" Jul 24 13:35:36.755460 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755422 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 13:35:36.755890 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755877 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 13:35:36.755932 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.755897 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 13:35:36.758441 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.758420 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 13:35:36.761403 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.761379 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 13:35:36.761509 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.761418 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 13:35:36.762676 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.762210 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 13:35:36.763770 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763748 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 13:35:36.763770 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763770 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763782 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763796 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763806 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763820 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763829 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763840 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763850 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763878 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 13:35:36.763892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.763887 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 13:35:36.765009 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.764994 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 13:35:36.765050 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.765012 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 13:35:36.766508 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.766486 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 13:35:36.766849 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.766829 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 13:35:36.766954 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.766932 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 13:35:36.768850 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.768835 2579 server.go:1268] "Started kubelet" Jul 24 13:35:36.769009 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.768942 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 13:35:36.769111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.768953 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 13:35:36.769111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.769051 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 13:35:36.769730 ip-10-0-138-191 systemd[1]: Started Kubernetes Kubelet. Jul 24 13:35:36.771566 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.771542 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 13:35:36.771742 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.771729 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 24 13:35:36.774329 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.774306 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 13:35:36.778710 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.778682 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 13:35:36.778710 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.778697 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 13:35:36.778974 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.778947 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:36.779423 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779402 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 13:35:36.779423 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779423 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 13:35:36.779551 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779535 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 24 13:35:36.779551 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779545 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 24 13:35:36.779551 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779549 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 13:35:36.779687 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779673 2579 factory.go:55] Registering systemd factory Jul 24 13:35:36.779732 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779688 2579 factory.go:223] Registration of the systemd container factory successfully Jul 24 13:35:36.780017 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.779991 2579 factory.go:153] Registering CRI-O factory Jul 24 13:35:36.780141 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.780032 2579 factory.go:223] Registration of the crio container factory successfully Jul 24 13:35:36.780141 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.780086 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 13:35:36.780141 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.780110 2579 factory.go:103] Registering Raw factory Jul 24 13:35:36.780141 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.780121 2579 manager.go:1196] Started watching for new ooms in manager Jul 24 13:35:36.781462 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.781447 2579 manager.go:349] Starting recovery of all containers Jul 24 13:35:36.785388 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.785333 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jdpsf" Jul 24 13:35:36.788212 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.788180 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 13:35:36.788585 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.788550 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 13:35:36.789385 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.788312 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-191.ec2.internal.18c53d37b3a67e62 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-191.ec2.internal,UID:ip-10-0-138-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-191.ec2.internal,},FirstTimestamp:2026-07-24 13:35:36.768798306 +0000 UTC m=+0.354401352,LastTimestamp:2026-07-24 13:35:36.768798306 +0000 UTC m=+0.354401352,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-191.ec2.internal,}" Jul 24 13:35:36.792777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.792607 2579 manager.go:354] Recovery completed Jul 24 13:35:36.792926 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.792828 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jdpsf" Jul 24 13:35:36.795142 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.795121 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 24 13:35:36.799598 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.799581 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.801832 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.801814 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.801893 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.801847 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.801893 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.801858 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:36.802385 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.802370 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 13:35:36.802458 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.802386 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 13:35:36.802458 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.802407 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 24 13:35:36.802536 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.802387 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.803298 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.803270 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.803359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.803300 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.803359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.803330 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:36.803475 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.803462 2579 policy_none.go:49] "None policy: Start" Jul 24 13:35:36.803513 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.803483 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 13:35:36.803513 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.803497 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 13:35:36.804637 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.804620 2579 policy_none.go:47] "Start" Jul 24 13:35:36.805119 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.805041 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-191.ec2.internal.18c53d37b59e8f49 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-191.ec2.internal,UID:ip-10-0-138-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-191.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-191.ec2.internal,},FirstTimestamp:2026-07-24 13:35:36.801832777 +0000 UTC m=+0.387435823,LastTimestamp:2026-07-24 13:35:36.801832777 +0000 UTC m=+0.387435823,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-191.ec2.internal,}" Jul 24 13:35:36.846078 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846055 2579 manager.go:337] "Starting Device Plugin manager" Jul 24 13:35:36.846208 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.846105 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 13:35:36.846208 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846120 2579 server.go:87] "Starting device plugin registration server" Jul 24 13:35:36.846464 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846445 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 13:35:36.846586 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846464 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 13:35:36.846586 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846570 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 13:35:36.846694 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846654 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 13:35:36.846694 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.846661 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 13:35:36.847161 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.847131 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 13:35:36.847307 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.847196 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:36.887532 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.887494 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 13:35:36.888888 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.888871 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 13:35:36.888971 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.888913 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 13:35:36.888971 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.888941 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 13:35:36.889046 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.888983 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 13:35:36.891833 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.891810 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:35:36.949012 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.948911 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.949990 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.949970 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.950111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.950024 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.950111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.950037 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:36.950111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.950064 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-191.ec2.internal" Jul 24 13:35:36.962292 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.962258 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-191.ec2.internal" Jul 24 13:35:36.962457 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.962311 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-191.ec2.internal\": node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:36.985939 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:36.985903 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:36.989233 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.989196 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal"] Jul 24 13:35:36.989308 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.989278 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.990238 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.990220 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.990318 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.990252 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.990318 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.990263 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:36.991971 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.991956 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.992082 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:36.992132 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992113 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.992788 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992768 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.992883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992800 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.992883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992773 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.992883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992812 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:36.992883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992826 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.992883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.992844 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:36.993942 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.993925 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" Jul 24 13:35:36.994041 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.993953 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 13:35:36.994698 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.994680 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientMemory" Jul 24 13:35:36.994807 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.994714 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 13:35:36.994807 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:36.994728 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeHasSufficientPID" Jul 24 13:35:37.021304 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.021269 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-191.ec2.internal\" not found" node="ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.026256 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.026237 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-191.ec2.internal\" not found" node="ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.081579 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.081542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83d4f91c0f4457bcc1710dd7a49a3551-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal\" (UID: \"83d4f91c0f4457bcc1710dd7a49a3551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.081710 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.081584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d4f91c0f4457bcc1710dd7a49a3551-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal\" (UID: \"83d4f91c0f4457bcc1710dd7a49a3551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.081710 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.081604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e33b40bd57bdc85611250cbc4f13a08e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-191.ec2.internal\" (UID: \"e33b40bd57bdc85611250cbc4f13a08e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.087072 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.087038 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.181999 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.181970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83d4f91c0f4457bcc1710dd7a49a3551-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal\" (UID: \"83d4f91c0f4457bcc1710dd7a49a3551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.182066 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.182003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d4f91c0f4457bcc1710dd7a49a3551-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal\" (UID: \"83d4f91c0f4457bcc1710dd7a49a3551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.182066 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.182022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e33b40bd57bdc85611250cbc4f13a08e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-191.ec2.internal\" (UID: \"e33b40bd57bdc85611250cbc4f13a08e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.182131 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.182085 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83d4f91c0f4457bcc1710dd7a49a3551-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal\" (UID: \"83d4f91c0f4457bcc1710dd7a49a3551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.182131 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.182115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e33b40bd57bdc85611250cbc4f13a08e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-191.ec2.internal\" (UID: \"e33b40bd57bdc85611250cbc4f13a08e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.182248 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.182085 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83d4f91c0f4457bcc1710dd7a49a3551-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal\" (UID: \"83d4f91c0f4457bcc1710dd7a49a3551\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.187450 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.187420 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.288583 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.288514 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.325537 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.325486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.330453 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.330296 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" Jul 24 13:35:37.388797 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.388753 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.488868 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.488831 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.589449 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.589366 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.631424 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.631389 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:35:37.689572 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.689527 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.711819 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.711787 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 13:35:37.712013 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.711991 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 13:35:37.712069 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.712015 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 13:35:37.789773 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.789738 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.797336 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.797294 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 13:30:37 +0000 UTC" deadline="2028-01-10 15:34:32.204713841 +0000 UTC" Jul 24 13:35:37.797336 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.797341 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12841h58m54.407387469s" Jul 24 13:35:37.850047 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:37.849958 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33b40bd57bdc85611250cbc4f13a08e.slice/crio-c6421b32c2fc85809ee655c76e596df0b67dbf92606d2aa0ffc163b2e825be02 WatchSource:0}: Error finding container c6421b32c2fc85809ee655c76e596df0b67dbf92606d2aa0ffc163b2e825be02: Status 404 returned error can't find the container with id c6421b32c2fc85809ee655c76e596df0b67dbf92606d2aa0ffc163b2e825be02 Jul 24 13:35:37.850430 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:37.850401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d4f91c0f4457bcc1710dd7a49a3551.slice/crio-61ffbcb68e4750f07dc51ad2f1704ac60dd88abe9f7e0d78ce3c3bd601dc8402 WatchSource:0}: Error finding container 61ffbcb68e4750f07dc51ad2f1704ac60dd88abe9f7e0d78ce3c3bd601dc8402: Status 404 returned error can't find the container with id 61ffbcb68e4750f07dc51ad2f1704ac60dd88abe9f7e0d78ce3c3bd601dc8402 Jul 24 13:35:37.854053 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.854034 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 13:35:37.890135 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:37.890093 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-191.ec2.internal\" not found" Jul 24 13:35:37.892451 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.892403 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" event={"ID":"e33b40bd57bdc85611250cbc4f13a08e","Type":"ContainerStarted","Data":"c6421b32c2fc85809ee655c76e596df0b67dbf92606d2aa0ffc163b2e825be02"} Jul 24 13:35:37.893545 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.893522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" event={"ID":"83d4f91c0f4457bcc1710dd7a49a3551","Type":"ContainerStarted","Data":"61ffbcb68e4750f07dc51ad2f1704ac60dd88abe9f7e0d78ce3c3bd601dc8402"} Jul 24 13:35:37.909318 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.909277 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:35:37.984002 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:37.983970 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" Jul 24 13:35:38.002666 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.002635 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 13:35:38.003809 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.003791 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" Jul 24 13:35:38.018723 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.018697 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 13:35:38.367715 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.367678 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:35:38.707523 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.707431 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:35:38.756633 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.756601 2579 apiserver.go:52] "Watching apiserver" Jul 24 13:35:38.766921 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.766805 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 13:35:38.767331 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.767286 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m","openshift-dns/node-resolver-sc54w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal","openshift-multus/multus-additional-cni-plugins-gvb2c","openshift-network-diagnostics/network-check-target-cvl5r","openshift-network-operator/iptables-alerter-q2cw8","openshift-ovn-kubernetes/ovnkube-node-j7z6j","kube-system/global-pull-secret-syncer-9vnwp","kube-system/konnectivity-agent-bgmf8","kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2ptfg","openshift-image-registry/node-ca-ts5qc","openshift-multus/multus-znqm4","openshift-multus/network-metrics-daemon-94n97"] Jul 24 13:35:38.769305 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.769270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.770509 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.770487 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.771653 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.771627 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:38.771754 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.771728 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:38.772868 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.772849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.774143 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.774115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:38.774245 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.774199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:38.775867 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.775845 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.776842 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.776777 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777016 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777031 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8j6qp\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777031 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777137 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777154 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.777562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777300 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 13:35:38.778068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.777939 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 13:35:38.778196 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778146 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 13:35:38.778264 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778244 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.778319 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778277 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cjs5t\"" Jul 24 13:35:38.778397 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778378 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-66jj2\"" Jul 24 13:35:38.778474 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778457 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 13:35:38.779212 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778795 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.779212 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.778872 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 13:35:38.779772 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.779621 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 13:35:38.780940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.780887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.782352 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.782325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:38.782447 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.782405 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:38.782627 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.782606 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.782910 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.782889 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zsttv\"" Jul 24 13:35:38.783031 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783013 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 13:35:38.783242 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783224 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.783319 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783236 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 13:35:38.783319 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.783452 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nz6sv\"" Jul 24 13:35:38.783648 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783562 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 13:35:38.784135 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.783939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbmqn\"" Jul 24 13:35:38.784135 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.784012 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.784135 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.784030 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sg7s4\"" Jul 24 13:35:38.784375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.784243 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.784375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.784272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.785682 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.785662 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:38.790575 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.790449 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-system-cni-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-cni-bin\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791505 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nd9b\" (UniqueName: \"kubernetes.io/projected/65787285-0f43-4ecc-9487-ed2044a70ea9-kube-api-access-4nd9b\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-sys-fs\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-cni-bin\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-conf-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-cni-multus\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65787285-0f43-4ecc-9487-ed2044a70ea9-tmp-dir\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-hostroot\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-system-cni-dir\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-os-release\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.791949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-cni-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.792102 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9pqvj\"" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.792331 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.792528 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.792975 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 13:35:38.794375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793170 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v6pr2\"" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793215 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-systemd-units\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlmxl\" (UniqueName: \"kubernetes.io/projected/3d9a4584-97d4-48e1-992e-26c98459b163-kube-api-access-zlmxl\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4lhv\" (UniqueName: \"kubernetes.io/projected/65a8a998-e460-4249-9fb2-a15d80a3cd80-kube-api-access-w4lhv\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2dd32a5-5ef7-40ff-9dd2-e8113010c18c-konnectivity-ca\") pod \"konnectivity-agent-bgmf8\" (UID: \"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c\") " pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793836 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d9a4584-97d4-48e1-992e-26c98459b163-cni-binary-copy\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-netns\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-cnibin\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-registration-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.793967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-slash\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-etc-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-os-release\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-k8s-cni-cncf-io\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d9a4584-97d4-48e1-992e-26c98459b163-multus-daemon-config\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsf9f\" (UniqueName: \"kubernetes.io/projected/c484f13e-5565-408d-a98c-226f5680525f-kube-api-access-jsf9f\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.795398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-device-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794411 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5f2\" (UniqueName: \"kubernetes.io/projected/6ce5a025-3559-497f-9fbf-546dd3301fb7-kube-api-access-gj5f2\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65787285-0f43-4ecc-9487-ed2044a70ea9-hosts-file\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-run-netns\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794542 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95311aa4-fb21-494c-b640-0bb859713422-iptables-alerter-script\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2dd32a5-5ef7-40ff-9dd2-e8113010c18c-agent-certs\") pod \"konnectivity-agent-bgmf8\" (UID: \"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c\") " pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794685 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-env-overrides\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-etc-kubernetes\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bj59\" (UniqueName: \"kubernetes.io/projected/95311aa4-fb21-494c-b640-0bb859713422-kube-api-access-4bj59\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-systemd\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-log-socket\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.794941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95311aa4-fb21-494c-b640-0bb859713422-host-slash\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-socket-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-kubelet\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-ovn\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-socket-dir-parent\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-kubelet\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795302 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-var-lib-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-cni-netd\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovnkube-config\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795481 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovn-node-metrics-cert\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-node-log\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-cnibin\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovnkube-script-lib\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.796878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.795944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-multus-certs\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.797658 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.796032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whlr\" (UniqueName: \"kubernetes.io/projected/98acef95-1507-4028-b5af-7e45f79b68e3-kube-api-access-2whlr\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.799622 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.799511 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 13:35:38.823564 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.823535 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bz8pk" Jul 24 13:35:38.834340 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.834313 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bz8pk" Jul 24 13:35:38.880741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.880707 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 13:35:38.897004 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.896967 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.897004 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.897275 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95311aa4-fb21-494c-b640-0bb859713422-iptables-alerter-script\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.897275 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2dd32a5-5ef7-40ff-9dd2-e8113010c18c-agent-certs\") pod \"konnectivity-agent-bgmf8\" (UID: \"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c\") " pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.897275 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-env-overrides\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.897275 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-etc-kubernetes\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4vd2\" (UniqueName: \"kubernetes.io/projected/b6179e1d-c181-4b39-92ba-8287e0b3843f-kube-api-access-v4vd2\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bj59\" (UniqueName: \"kubernetes.io/projected/95311aa4-fb21-494c-b640-0bb859713422-kube-api-access-4bj59\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-etc-kubernetes\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-systemd\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-log-socket\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.897514 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.897507 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6179e1d-c181-4b39-92ba-8287e0b3843f-serviceca\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95311aa4-fb21-494c-b640-0bb859713422-host-slash\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-socket-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.897612 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:39.397569925 +0000 UTC m=+2.983172981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-kubelet\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-ovn\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897704 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-socket-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897708 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-socket-dir-parent\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-kubelet\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897760 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-socket-dir-parent\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysctl-conf\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897786 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897799 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-lib-modules\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-cni-binary-copy\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.897965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95311aa4-fb21-494c-b640-0bb859713422-iptables-alerter-script\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897860 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-var-lib-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-env-overrides\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897904 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-cni-netd\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897962 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-systemd\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.897997 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95311aa4-fb21-494c-b640-0bb859713422-host-slash\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898009 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898017 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-cni-netd\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898043 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-var-lib-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898049 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-ovn\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-kubelet\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898085 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-kubelet\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898104 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovnkube-config\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898140 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-log-socket\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovn-node-metrics-cert\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-modprobe-d\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898226 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 13:35:38.898783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898303 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-node-log\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-node-log\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-cnibin\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysconfig\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c484f13e-5565-408d-a98c-226f5680525f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-var-lib-kubelet\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898587 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-cnibin\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898604 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovnkube-script-lib\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-multus-certs\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-host\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898700 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898721 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whlr\" (UniqueName: \"kubernetes.io/projected/98acef95-1507-4028-b5af-7e45f79b68e3-kube-api-access-2whlr\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-multus-certs\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-system-cni-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-cni-bin\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.899720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa3ea906-be99-40aa-944d-a38f2665910d-kubelet-config\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898853 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovnkube-config\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898865 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-system-cni-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898873 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-kubernetes\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nd9b\" (UniqueName: \"kubernetes.io/projected/65787285-0f43-4ecc-9487-ed2044a70ea9-kube-api-access-4nd9b\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898921 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-cni-bin\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-sys-fs\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-cni-bin\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.898976 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-sys-fs\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-conf-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-cni-bin\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-cni-multus\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899110 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-conf-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-systemd\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899147 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899159 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-sys\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.900553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-tuned\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-var-lib-cni-multus\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65787285-0f43-4ecc-9487-ed2044a70ea9-tmp-dir\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899265 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovnkube-script-lib\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-run-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-hostroot\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899359 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-hostroot\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6179e1d-c181-4b39-92ba-8287e0b3843f-host\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-system-cni-dir\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899446 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-system-cni-dir\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-os-release\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-cni-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-run\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-systemd-units\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899565 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65787285-0f43-4ecc-9487-ed2044a70ea9-tmp-dir\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899570 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-os-release\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlmxl\" (UniqueName: \"kubernetes.io/projected/3d9a4584-97d4-48e1-992e-26c98459b163-kube-api-access-zlmxl\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.901383 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4lhv\" (UniqueName: \"kubernetes.io/projected/65a8a998-e460-4249-9fb2-a15d80a3cd80-kube-api-access-w4lhv\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-systemd-units\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-multus-cni-dir\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2dd32a5-5ef7-40ff-9dd2-e8113010c18c-konnectivity-ca\") pod \"konnectivity-agent-bgmf8\" (UID: \"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c\") " pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d9a4584-97d4-48e1-992e-26c98459b163-cni-binary-copy\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-netns\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysctl-d\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-cnibin\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899880 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-netns\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-registration-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-slash\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899932 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c484f13e-5565-408d-a98c-226f5680525f-cnibin\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-etc-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.899986 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-os-release\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900008 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-registration-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900021 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-slash\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-k8s-cni-cncf-io\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900059 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-etc-openvswitch\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d9a4584-97d4-48e1-992e-26c98459b163-multus-daemon-config\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900099 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-os-release\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900109 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3d9a4584-97d4-48e1-992e-26c98459b163-host-run-k8s-cni-cncf-io\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0c4113-e4f4-4933-a36f-ca24682ff13e-tmp\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900173 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900200 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsf9f\" (UniqueName: \"kubernetes.io/projected/c484f13e-5565-408d-a98c-226f5680525f-kube-api-access-jsf9f\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-device-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5f2\" (UniqueName: \"kubernetes.io/projected/6ce5a025-3559-497f-9fbf-546dd3301fb7-kube-api-access-gj5f2\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa3ea906-be99-40aa-944d-a38f2665910d-dbus\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2dd32a5-5ef7-40ff-9dd2-e8113010c18c-konnectivity-ca\") pod \"konnectivity-agent-bgmf8\" (UID: \"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c\") " pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmfq\" (UniqueName: \"kubernetes.io/projected/db0c4113-e4f4-4933-a36f-ca24682ff13e-kube-api-access-whmfq\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900382 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-device-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65787285-0f43-4ecc-9487-ed2044a70ea9-hosts-file\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900431 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d9a4584-97d4-48e1-992e-26c98459b163-cni-binary-copy\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-run-netns\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900574 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ce5a025-3559-497f-9fbf-546dd3301fb7-host-run-netns\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.902798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900581 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65787285-0f43-4ecc-9487-ed2044a70ea9-hosts-file\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.903344 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900586 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3d9a4584-97d4-48e1-992e-26c98459b163-multus-daemon-config\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.903344 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.900639 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98acef95-1507-4028-b5af-7e45f79b68e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.903344 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.902015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce5a025-3559-497f-9fbf-546dd3301fb7-ovn-node-metrics-cert\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.903344 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.902206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2dd32a5-5ef7-40ff-9dd2-e8113010c18c-agent-certs\") pod \"konnectivity-agent-bgmf8\" (UID: \"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c\") " pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:38.920489 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.920448 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:35:38.920489 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.920488 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:35:38.920712 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.920508 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:38.920712 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:38.920587 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:39.420562875 +0000 UTC m=+3.006165920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:38.932274 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.931794 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsf9f\" (UniqueName: \"kubernetes.io/projected/c484f13e-5565-408d-a98c-226f5680525f-kube-api-access-jsf9f\") pod \"multus-additional-cni-plugins-gvb2c\" (UID: \"c484f13e-5565-408d-a98c-226f5680525f\") " pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:38.932274 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.932039 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlmxl\" (UniqueName: \"kubernetes.io/projected/3d9a4584-97d4-48e1-992e-26c98459b163-kube-api-access-zlmxl\") pod \"multus-znqm4\" (UID: \"3d9a4584-97d4-48e1-992e-26c98459b163\") " pod="openshift-multus/multus-znqm4" Jul 24 13:35:38.932274 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.932137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nd9b\" (UniqueName: \"kubernetes.io/projected/65787285-0f43-4ecc-9487-ed2044a70ea9-kube-api-access-4nd9b\") pod \"node-resolver-sc54w\" (UID: \"65787285-0f43-4ecc-9487-ed2044a70ea9\") " pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:38.932274 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.932215 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whlr\" (UniqueName: \"kubernetes.io/projected/98acef95-1507-4028-b5af-7e45f79b68e3-kube-api-access-2whlr\") pod \"aws-ebs-csi-driver-node-k4r8m\" (UID: \"98acef95-1507-4028-b5af-7e45f79b68e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:38.932613 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.932584 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5f2\" (UniqueName: \"kubernetes.io/projected/6ce5a025-3559-497f-9fbf-546dd3301fb7-kube-api-access-gj5f2\") pod \"ovnkube-node-j7z6j\" (UID: \"6ce5a025-3559-497f-9fbf-546dd3301fb7\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:38.933684 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.933650 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bj59\" (UniqueName: \"kubernetes.io/projected/95311aa4-fb21-494c-b640-0bb859713422-kube-api-access-4bj59\") pod \"iptables-alerter-q2cw8\" (UID: \"95311aa4-fb21-494c-b640-0bb859713422\") " pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:38.934652 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:38.934632 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4lhv\" (UniqueName: \"kubernetes.io/projected/65a8a998-e460-4249-9fb2-a15d80a3cd80-kube-api-access-w4lhv\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:39.001667 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysctl-conf\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001667 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-lib-modules\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001667 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-modprobe-d\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001695 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysconfig\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-var-lib-kubelet\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001794 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-host\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysctl-conf\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001827 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysconfig\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001819 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa3ea906-be99-40aa-944d-a38f2665910d-kubelet-config\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-lib-modules\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001870 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa3ea906-be99-40aa-944d-a38f2665910d-kubelet-config\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001871 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-modprobe-d\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-kubernetes\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-var-lib-kubelet\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001923 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-systemd\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-sys\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001956 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-kubernetes\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.001965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001938 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-host\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001968 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-tuned\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-sys\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6179e1d-c181-4b39-92ba-8287e0b3843f-host\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.001985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-systemd\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-run\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.001971 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysctl-d\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002102 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6179e1d-c181-4b39-92ba-8287e0b3843f-host\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.002124 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:35:39.502100878 +0000 UTC m=+3.087703930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-run\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0c4113-e4f4-4933-a36f-ca24682ff13e-tmp\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa3ea906-be99-40aa-944d-a38f2665910d-dbus\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002190 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-sysctl-d\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmfq\" (UniqueName: \"kubernetes.io/projected/db0c4113-e4f4-4933-a36f-ca24682ff13e-kube-api-access-whmfq\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4vd2\" (UniqueName: \"kubernetes.io/projected/b6179e1d-c181-4b39-92ba-8287e0b3843f-kube-api-access-v4vd2\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6179e1d-c181-4b39-92ba-8287e0b3843f-serviceca\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.002799 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002411 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa3ea906-be99-40aa-944d-a38f2665910d-dbus\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:39.003599 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.002953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6179e1d-c181-4b39-92ba-8287e0b3843f-serviceca\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.004673 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.004642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db0c4113-e4f4-4933-a36f-ca24682ff13e-etc-tuned\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.004790 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.004747 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db0c4113-e4f4-4933-a36f-ca24682ff13e-tmp\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.016834 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.016806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmfq\" (UniqueName: \"kubernetes.io/projected/db0c4113-e4f4-4933-a36f-ca24682ff13e-kube-api-access-whmfq\") pod \"tuned-2ptfg\" (UID: \"db0c4113-e4f4-4933-a36f-ca24682ff13e\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.016987 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.016860 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4vd2\" (UniqueName: \"kubernetes.io/projected/b6179e1d-c181-4b39-92ba-8287e0b3843f-kube-api-access-v4vd2\") pod \"node-ca-ts5qc\" (UID: \"b6179e1d-c181-4b39-92ba-8287e0b3843f\") " pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.084228 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.084188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:35:39.094701 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.094664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-znqm4" Jul 24 13:35:39.103861 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.103827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" Jul 24 13:35:39.111543 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.111503 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2cw8" Jul 24 13:35:39.117665 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.117633 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:35:39.124850 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.124825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" Jul 24 13:35:39.132594 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.132566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sc54w" Jul 24 13:35:39.139052 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.139028 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" Jul 24 13:35:39.145883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.145858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ts5qc" Jul 24 13:35:39.405647 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.405549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:39.405817 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.405744 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:39.405876 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.405834 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:40.405808122 +0000 UTC m=+3.991411159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:39.506893 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.506850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:39.507113 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.506939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:39.507113 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.507073 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:39.507113 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.507089 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:35:39.507282 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.507117 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:35:39.507282 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.507132 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:39.507282 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.507144 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:35:40.507124114 +0000 UTC m=+4.092727149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:39.507282 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:39.507191 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:40.507172865 +0000 UTC m=+4.092775918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:39.635018 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.634985 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 13:35:39.823395 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.823360 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95311aa4_fb21_494c_b640_0bb859713422.slice/crio-50fbcb46485bcd50aa7286664f8ada9295080edccf5f7d8b9b1fc2284e460282 WatchSource:0}: Error finding container 50fbcb46485bcd50aa7286664f8ada9295080edccf5f7d8b9b1fc2284e460282: Status 404 returned error can't find the container with id 50fbcb46485bcd50aa7286664f8ada9295080edccf5f7d8b9b1fc2284e460282 Jul 24 13:35:39.825460 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.825341 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc484f13e_5565_408d_a98c_226f5680525f.slice/crio-03a63ec69b00f75d4c57ce9725b9bcf5e96884afce7575dce0c8361c9974948d WatchSource:0}: Error finding container 03a63ec69b00f75d4c57ce9725b9bcf5e96884afce7575dce0c8361c9974948d: Status 404 returned error can't find the container with id 03a63ec69b00f75d4c57ce9725b9bcf5e96884afce7575dce0c8361c9974948d Jul 24 13:35:39.826104 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.826050 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98acef95_1507_4028_b5af_7e45f79b68e3.slice/crio-bb169ce649e1846caa46941633df3f645c9bf3070d754e5f4cfab6406d25504e WatchSource:0}: Error finding container bb169ce649e1846caa46941633df3f645c9bf3070d754e5f4cfab6406d25504e: Status 404 returned error can't find the container with id bb169ce649e1846caa46941633df3f645c9bf3070d754e5f4cfab6406d25504e Jul 24 13:35:39.827098 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.826880 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6179e1d_c181_4b39_92ba_8287e0b3843f.slice/crio-99be81c93e5118556779d9fca91e8754211f2ca9b25953f33cff8a7bf79e66d5 WatchSource:0}: Error finding container 99be81c93e5118556779d9fca91e8754211f2ca9b25953f33cff8a7bf79e66d5: Status 404 returned error can't find the container with id 99be81c93e5118556779d9fca91e8754211f2ca9b25953f33cff8a7bf79e66d5 Jul 24 13:35:39.829799 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.829763 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d9a4584_97d4_48e1_992e_26c98459b163.slice/crio-b4b9e50696284989e748cde4c494849e0aa7d4bbf18743c151d36e3aa8e3abe3 WatchSource:0}: Error finding container b4b9e50696284989e748cde4c494849e0aa7d4bbf18743c151d36e3aa8e3abe3: Status 404 returned error can't find the container with id b4b9e50696284989e748cde4c494849e0aa7d4bbf18743c151d36e3aa8e3abe3 Jul 24 13:35:39.830589 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.830565 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2dd32a5_5ef7_40ff_9dd2_e8113010c18c.slice/crio-4486f5406831ae6f9009c47b97ffa4b4c7d561b87f6b0ad453fe8d951e0337ed WatchSource:0}: Error finding container 4486f5406831ae6f9009c47b97ffa4b4c7d561b87f6b0ad453fe8d951e0337ed: Status 404 returned error can't find the container with id 4486f5406831ae6f9009c47b97ffa4b4c7d561b87f6b0ad453fe8d951e0337ed Jul 24 13:35:39.832340 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.832249 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0c4113_e4f4_4933_a36f_ca24682ff13e.slice/crio-6cb2c5f87a86b97d9cc212ad36a6c0fc1fbfcd0dd9adf24347ecb1e78bc32b9e WatchSource:0}: Error finding container 6cb2c5f87a86b97d9cc212ad36a6c0fc1fbfcd0dd9adf24347ecb1e78bc32b9e: Status 404 returned error can't find the container with id 6cb2c5f87a86b97d9cc212ad36a6c0fc1fbfcd0dd9adf24347ecb1e78bc32b9e Jul 24 13:35:39.833481 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:35:39.833451 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce5a025_3559_497f_9fbf_546dd3301fb7.slice/crio-1b66dce8604f462f2579c303b5585a704b5ca618aa9e358e3698935ddce60554 WatchSource:0}: Error finding container 1b66dce8604f462f2579c303b5585a704b5ca618aa9e358e3698935ddce60554: Status 404 returned error can't find the container with id 1b66dce8604f462f2579c303b5585a704b5ca618aa9e358e3698935ddce60554 Jul 24 13:35:39.836696 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.836611 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:30:39 +0000 UTC" deadline="2028-04-05 20:54:56.675528362 +0000 UTC" Jul 24 13:35:39.836696 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.836645 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14911h19m16.838889016s" Jul 24 13:35:39.897720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.897519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"1b66dce8604f462f2579c303b5585a704b5ca618aa9e358e3698935ddce60554"} Jul 24 13:35:39.899153 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.899108 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bgmf8" event={"ID":"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c","Type":"ContainerStarted","Data":"4486f5406831ae6f9009c47b97ffa4b4c7d561b87f6b0ad453fe8d951e0337ed"} Jul 24 13:35:39.900576 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.900550 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ts5qc" event={"ID":"b6179e1d-c181-4b39-92ba-8287e0b3843f","Type":"ContainerStarted","Data":"99be81c93e5118556779d9fca91e8754211f2ca9b25953f33cff8a7bf79e66d5"} Jul 24 13:35:39.902309 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.902257 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" event={"ID":"98acef95-1507-4028-b5af-7e45f79b68e3","Type":"ContainerStarted","Data":"bb169ce649e1846caa46941633df3f645c9bf3070d754e5f4cfab6406d25504e"} Jul 24 13:35:39.905029 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.905000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerStarted","Data":"03a63ec69b00f75d4c57ce9725b9bcf5e96884afce7575dce0c8361c9974948d"} Jul 24 13:35:39.906841 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.906814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sc54w" event={"ID":"65787285-0f43-4ecc-9487-ed2044a70ea9","Type":"ContainerStarted","Data":"d98b2b2cef28483b6b109093a063f74e95abee65ecbbe6b5e6a501fe63704d27"} Jul 24 13:35:39.908128 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.908088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" event={"ID":"db0c4113-e4f4-4933-a36f-ca24682ff13e","Type":"ContainerStarted","Data":"6cb2c5f87a86b97d9cc212ad36a6c0fc1fbfcd0dd9adf24347ecb1e78bc32b9e"} Jul 24 13:35:39.910265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.910172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-znqm4" event={"ID":"3d9a4584-97d4-48e1-992e-26c98459b163","Type":"ContainerStarted","Data":"b4b9e50696284989e748cde4c494849e0aa7d4bbf18743c151d36e3aa8e3abe3"} Jul 24 13:35:39.911602 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:39.911536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2cw8" event={"ID":"95311aa4-fb21-494c-b640-0bb859713422","Type":"ContainerStarted","Data":"50fbcb46485bcd50aa7286664f8ada9295080edccf5f7d8b9b1fc2284e460282"} Jul 24 13:35:40.415337 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.414665 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:40.415337 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.414837 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:40.415337 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.414911 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:42.414887525 +0000 UTC m=+6.000490564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.515540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.515629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.515770 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.515835 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:35:42.515817044 +0000 UTC m=+6.101420094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.516280 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.516300 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.516315 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:40.516433 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.516378 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:42.516347807 +0000 UTC m=+6.101950861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:40.837798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.837725 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:30:39 +0000 UTC" deadline="2028-02-01 21:41:47.451269775 +0000 UTC" Jul 24 13:35:40.837798 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.837795 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13376h6m6.613479155s" Jul 24 13:35:40.894061 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.894005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:40.894241 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.894149 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:40.894368 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.894328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:40.894689 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.894442 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:40.894689 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.894542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:40.894689 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:40.894640 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:40.962947 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.962214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" event={"ID":"e33b40bd57bdc85611250cbc4f13a08e","Type":"ContainerStarted","Data":"9b319edd77274dd3e327986800838a497e67bbd948b193f94ae9680df0c1ba9d"} Jul 24 13:35:40.970446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.969746 2579 generic.go:356] "Generic (PLEG): container finished" podID="83d4f91c0f4457bcc1710dd7a49a3551" containerID="10341881f32b7c3b03e14dd223bfd72aeaa620274eabe027187ecc32780eedc0" exitCode=0 Jul 24 13:35:40.970446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.969800 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" event={"ID":"83d4f91c0f4457bcc1710dd7a49a3551","Type":"ContainerDied","Data":"10341881f32b7c3b03e14dd223bfd72aeaa620274eabe027187ecc32780eedc0"} Jul 24 13:35:40.983529 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:40.983463 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-191.ec2.internal" podStartSLOduration=2.983439246 podStartE2EDuration="2.983439246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:40.982255867 +0000 UTC m=+4.567858925" watchObservedRunningTime="2026-07-24 13:35:40.983439246 +0000 UTC m=+4.569042303" Jul 24 13:35:41.991196 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:41.991153 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" event={"ID":"83d4f91c0f4457bcc1710dd7a49a3551","Type":"ContainerStarted","Data":"659f47b9af680521e2a4634b138195721f34eccc7ef7dbb3f0a5a89a8560890d"} Jul 24 13:35:42.024269 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.024204 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-191.ec2.internal" podStartSLOduration=4.024180304 podStartE2EDuration="4.024180304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:42.023738751 +0000 UTC m=+5.609341809" watchObservedRunningTime="2026-07-24 13:35:42.024180304 +0000 UTC m=+5.609783362" Jul 24 13:35:42.432323 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.432194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:42.432495 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.432410 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:42.432495 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.432484 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:46.432462859 +0000 UTC m=+10.018065893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.533297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.533394 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.533560 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.533580 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.533594 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.533657 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:46.533636879 +0000 UTC m=+10.119239914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.533729 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:42.534340 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.533765 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:35:46.533753097 +0000 UTC m=+10.119356144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:42.891426 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.890466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:42.891426 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.890609 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:42.891426 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.891047 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:42.891426 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.891167 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:42.892154 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:42.891856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:42.892154 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:42.891981 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:44.891562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:44.890792 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:44.891562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:44.890811 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:44.891562 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:44.891007 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:44.891562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:44.891422 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:44.891562 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:44.891523 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:44.892193 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:44.891648 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:46.467466 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:46.467431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:46.467873 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.467578 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:46.467873 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.467643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:54.467625503 +0000 UTC m=+18.053228534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:46.568619 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:46.568575 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:46.568811 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:46.568667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:46.568811 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.568766 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:35:46.568811 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.568796 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:35:46.568811 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.568808 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:46.568999 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.568868 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:35:54.568849084 +0000 UTC m=+18.154452129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:46.568999 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.568773 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:46.568999 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.568914 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:35:54.568901199 +0000 UTC m=+18.154504233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:46.890892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:46.890326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:46.890892 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.890455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:46.890892 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:46.890823 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:46.891153 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:46.890910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:46.891153 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.890983 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:46.891153 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:46.891024 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:48.890457 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:48.890000 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:48.890457 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:48.890135 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:48.890457 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:48.890009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:48.890457 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:48.890295 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:48.890457 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:48.890321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:48.890457 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:48.890415 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:50.889187 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:50.889148 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:50.889187 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:50.889174 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:50.889617 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:50.889305 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:50.889617 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:50.889337 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:50.889617 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:50.889412 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:50.889617 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:50.889472 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:52.890096 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:52.890062 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:52.890605 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:52.890055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:52.890605 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:52.890192 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:52.890605 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:52.890055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:52.890605 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:52.890310 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:52.890605 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:52.890343 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:54.528605 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:54.528564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:54.529095 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.528718 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:54.529095 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.528796 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:10.528775972 +0000 UTC m=+34.114379019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:35:54.629719 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:54.629676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:54.629889 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:54.629750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:54.629889 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.629874 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:54.629889 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.629878 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:35:54.630058 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.629906 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:35:54.630058 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.629921 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:54.630058 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.629944 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:10.629923719 +0000 UTC m=+34.215526754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:35:54.630058 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.629966 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:10.629950879 +0000 UTC m=+34.215553909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:35:54.890026 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:54.889947 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:54.890193 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:54.890067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:54.890193 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.890089 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:54.890193 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:54.890106 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:54.890412 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.890190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:54.890412 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:54.890293 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:56.890087 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:56.890042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:56.890581 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:56.890163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:56.890581 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:56.890170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:56.890581 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:56.890300 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:56.890581 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:56.890381 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:56.890581 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:56.890498 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:58.891073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:58.889979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:35:58.891073 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:58.890113 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:35:58.891073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:58.890449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:35:58.891073 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:58.890525 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:35:58.891073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:58.890584 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:35:58.891073 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:35:58.890662 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:35:59.038700 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.037964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bgmf8" event={"ID":"d2dd32a5-5ef7-40ff-9dd2-e8113010c18c","Type":"ContainerStarted","Data":"3458926109b3fdc1e4e399a3203d04cc6bc78e54ea205fdeb3f01e5a64ba02da"} Jul 24 13:35:59.040660 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.040600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ts5qc" event={"ID":"b6179e1d-c181-4b39-92ba-8287e0b3843f","Type":"ContainerStarted","Data":"a8de99e711ded5fc4cdb2738492b546119072caf9a97f5897dca6a26324a99b2"} Jul 24 13:35:59.042262 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.042219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" event={"ID":"98acef95-1507-4028-b5af-7e45f79b68e3","Type":"ContainerStarted","Data":"de1c077a1adfbe0d8453f0e8e39bba9ceefccea9ed430893a5ffc387ae612665"} Jul 24 13:35:59.050671 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.050586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerStarted","Data":"5fcd1e6ffa6dea88a821f5d5ba2e5d054f1ac6dd29817a194abaacb4e4082a3e"} Jul 24 13:35:59.054145 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.054119 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" event={"ID":"db0c4113-e4f4-4933-a36f-ca24682ff13e","Type":"ContainerStarted","Data":"e09f7ffd9f6a6d6a548f42dbf8cb8fece8d4eb92aacc80b5f01740fad08faeaf"} Jul 24 13:35:59.055911 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.055868 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-znqm4" event={"ID":"3d9a4584-97d4-48e1-992e-26c98459b163","Type":"ContainerStarted","Data":"5693bfea2210f1ba17d9ca72cad3e5dda33a8ef83a28a55c4cb1e4f16e5bf064"} Jul 24 13:35:59.073055 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.073010 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bgmf8" podStartSLOduration=6.906905658 podStartE2EDuration="22.072995005s" totalImagesPullingTime="15.166089347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:59.072489766 +0000 UTC m=+22.658092818" watchObservedRunningTime="2026-07-24 13:35:59.072995005 +0000 UTC m=+22.658598056" Jul 24 13:35:59.091192 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.091117 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sc54w" podStartSLOduration=3.081767701 podStartE2EDuration="22.091102299s" totalImagesPullingTime="19.009334598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:59.090792898 +0000 UTC m=+22.676395950" watchObservedRunningTime="2026-07-24 13:35:59.091102299 +0000 UTC m=+22.676705353" Jul 24 13:35:59.115816 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.115659 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2ptfg" podStartSLOduration=3.078078148 podStartE2EDuration="22.115642715s" totalImagesPullingTime="19.037564567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:59.115481146 +0000 UTC m=+22.701084199" watchObservedRunningTime="2026-07-24 13:35:59.115642715 +0000 UTC m=+22.701245767" Jul 24 13:35:59.177723 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.177670 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ts5qc" podStartSLOduration=3.164291604 podStartE2EDuration="22.177648458s" totalImagesPullingTime="19.013356854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:59.177526392 +0000 UTC m=+22.763129447" watchObservedRunningTime="2026-07-24 13:35:59.177648458 +0000 UTC m=+22.763251511" Jul 24 13:35:59.199484 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:35:59.199428 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-znqm4" podStartSLOduration=3.119426605 podStartE2EDuration="22.199403479s" totalImagesPullingTime="19.079976874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:35:59.199002814 +0000 UTC m=+22.784605867" watchObservedRunningTime="2026-07-24 13:35:59.199403479 +0000 UTC m=+22.785006532" Jul 24 13:36:00.061254 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.061216 2579 generic.go:356] "Generic (PLEG): container finished" podID="c484f13e-5565-408d-a98c-226f5680525f" containerID="5fcd1e6ffa6dea88a821f5d5ba2e5d054f1ac6dd29817a194abaacb4e4082a3e" exitCode=0 Jul 24 13:36:00.062121 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.061314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerDied","Data":"5fcd1e6ffa6dea88a821f5d5ba2e5d054f1ac6dd29817a194abaacb4e4082a3e"} Jul 24 13:36:00.062862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.062705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sc54w" event={"ID":"65787285-0f43-4ecc-9487-ed2044a70ea9","Type":"ContainerStarted","Data":"2914b13b3c92bd85b552a6d7325652c1e2f1c86cb1c91d83659453dbd2595a06"} Jul 24 13:36:00.065577 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.065554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"caaf7b18ce3672afb2df2e0c4606ce2baf79cb5013d4e31c91f63b19d42283e9"} Jul 24 13:36:00.065672 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.065630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"0ead48dd9171511df9b1c135209f14fe2353de19e7eef21d9cb9f364de3f0e74"} Jul 24 13:36:00.065734 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.065683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"0c9d123a14ad12a4c3fc54b6793976973f0136c90acb5d9b52f22d30142ea0f9"} Jul 24 13:36:00.065789 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.065736 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"8cb7ca3c55337a405e75bc8fcbc7f7ebc83bfd6bddf0e81b4ee4e3bf870dc113"} Jul 24 13:36:00.065846 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.065786 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"09f437d66fbb64ea2e0e5aba0ed772fa9b4f48e10a019495636e30acb0950261"} Jul 24 13:36:00.065846 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.065835 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"7896ddd50ada395d9c7105941bf9a9ba90c1d8288a50916f8dc0a7b8ac1a04fa"} Jul 24 13:36:00.353773 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.353743 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 13:36:00.857855 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.857744 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T13:36:00.353765855Z","UUID":"8078429e-4edb-45a6-b106-5e46b628178e","Handler":null,"Name":"","Endpoint":""} Jul 24 13:36:00.859412 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.859379 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 13:36:00.859538 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.859429 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 13:36:00.890118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.890086 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:00.890118 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.890108 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:00.890409 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:00.890201 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:00.890480 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:00.890461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:00.890480 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:00.890463 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:00.890592 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:00.890568 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:01.070562 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:01.070512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2cw8" event={"ID":"95311aa4-fb21-494c-b640-0bb859713422","Type":"ContainerStarted","Data":"7f65b6e65abbea05b9e184f5366a6e5ef7f5a6e4c2b7c8e706368fe2413c6b77"} Jul 24 13:36:01.073563 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:01.073532 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" event={"ID":"98acef95-1507-4028-b5af-7e45f79b68e3","Type":"ContainerStarted","Data":"6d88682e6b3d6e05f0353e4a8e2e780b81a43b4d9ff28735591de1072c0ee5da"} Jul 24 13:36:01.089638 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:01.089578 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q2cw8" podStartSLOduration=5.072732897 podStartE2EDuration="24.089560002s" totalImagesPullingTime="19.016827105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:01.089092554 +0000 UTC m=+24.674695607" watchObservedRunningTime="2026-07-24 13:36:01.089560002 +0000 UTC m=+24.675163053" Jul 24 13:36:02.081343 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:02.080391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"6660e48236b55390448650fc6af7e8396b36bc4689eb4ddf42a6b78be77cf1df"} Jul 24 13:36:02.083742 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:02.083668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" event={"ID":"98acef95-1507-4028-b5af-7e45f79b68e3","Type":"ContainerStarted","Data":"50658e2bb47bbe2ef67ef1d52ab3cc44767de55385602fb8480387f3e16183e8"} Jul 24 13:36:02.890125 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:02.889930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:02.890343 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:02.889931 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:02.890343 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:02.890221 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:02.890472 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:02.889995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:02.890472 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:02.890388 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:02.890581 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:02.890499 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:03.189881 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:03.189805 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:36:03.190482 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:03.190463 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:36:03.216579 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:03.216509 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k4r8m" podStartSLOduration=4.69876845 podStartE2EDuration="26.216486966s" totalImagesPullingTime="21.517718516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:02.115040373 +0000 UTC m=+25.700643437" watchObservedRunningTime="2026-07-24 13:36:03.216486966 +0000 UTC m=+26.802090022" Jul 24 13:36:04.088453 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:04.088385 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:36:04.088886 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:04.088869 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bgmf8" Jul 24 13:36:04.890046 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:04.889872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:04.890772 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:04.889887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:04.890772 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:04.890130 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:04.890772 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:04.889887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:04.890772 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:04.890260 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:04.890772 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:04.890194 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:05.094361 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:05.094260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" event={"ID":"6ce5a025-3559-497f-9fbf-546dd3301fb7","Type":"ContainerStarted","Data":"3fbda81d79969895f5a43bf2ffa121c75ed68d61c8abb2c13ce0433a6f526e1d"} Jul 24 13:36:05.094535 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:05.094516 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:36:05.096103 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:05.096077 2579 generic.go:356] "Generic (PLEG): container finished" podID="c484f13e-5565-408d-a98c-226f5680525f" containerID="0f11f1bca07c6d72394ec88b61cceeb902431da764a2ab2ec5374fb44325d08a" exitCode=0 Jul 24 13:36:05.096230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:05.096157 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerDied","Data":"0f11f1bca07c6d72394ec88b61cceeb902431da764a2ab2ec5374fb44325d08a"} Jul 24 13:36:05.110815 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:05.110786 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:36:05.130292 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:05.130226 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" podStartSLOduration=9.051144644 podStartE2EDuration="28.13021276s" totalImagesPullingTime="19.079068116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:05.129601747 +0000 UTC m=+28.715204837" watchObservedRunningTime="2026-07-24 13:36:05.13021276 +0000 UTC m=+28.715815811" Jul 24 13:36:06.099043 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.099010 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:36:06.099408 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.099131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:36:06.122537 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.122512 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:36:06.335037 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.334963 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vnwp"] Jul 24 13:36:06.335186 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.335099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:06.335227 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:06.335182 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:06.338511 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.338487 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94n97"] Jul 24 13:36:06.338647 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.338602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:06.338709 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:06.338687 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:06.354550 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.354522 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cvl5r"] Jul 24 13:36:06.354679 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:06.354612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:06.354724 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:06.354676 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:07.102960 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:07.102925 2579 generic.go:356] "Generic (PLEG): container finished" podID="c484f13e-5565-408d-a98c-226f5680525f" containerID="127bfe404cab85327a5b371aa5d0a1801288b8dc832b96814b9e7eb14f1098e2" exitCode=0 Jul 24 13:36:07.103392 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:07.103008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerDied","Data":"127bfe404cab85327a5b371aa5d0a1801288b8dc832b96814b9e7eb14f1098e2"} Jul 24 13:36:07.889674 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:07.889646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:07.889826 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:07.889645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:07.889826 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:07.889756 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:07.889894 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:07.889868 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:07.889925 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:07.889646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:07.889979 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:07.889960 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:08.478647 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:08.478426 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:08.620620 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:08.620575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:09.109544 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:09.109512 2579 generic.go:356] "Generic (PLEG): container finished" podID="c484f13e-5565-408d-a98c-226f5680525f" containerID="e35ef6528c9214123f386bfdfd89ee3fa194f1d2d691678cd7332dcff6b93dcd" exitCode=0 Jul 24 13:36:09.109721 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:09.109551 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerDied","Data":"e35ef6528c9214123f386bfdfd89ee3fa194f1d2d691678cd7332dcff6b93dcd"} Jul 24 13:36:09.889495 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:09.889460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:09.890033 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:09.889460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:09.890033 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:09.889591 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:09.890033 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:09.889460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:09.890033 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:09.889657 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:09.890033 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:09.889721 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:10.551088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:10.551061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:10.551251 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.551161 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:36:10.551251 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.551215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:42.551200356 +0000 UTC m=+66.136803386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 13:36:10.651915 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:10.651826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:10.651915 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:10.651907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:10.652103 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.652011 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 13:36:10.652103 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.652022 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 13:36:10.652103 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.652046 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 13:36:10.652103 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.652060 2579 projected.go:196] Error preparing data for projected volume kube-api-access-r9cxc for pod openshift-network-diagnostics/network-check-target-cvl5r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:36:10.652103 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.652065 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret podName:aa3ea906-be99-40aa-944d-a38f2665910d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:42.6520496 +0000 UTC m=+66.237652636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret") pod "global-pull-secret-syncer-9vnwp" (UID: "aa3ea906-be99-40aa-944d-a38f2665910d") : object "kube-system"/"original-pull-secret" not registered Jul 24 13:36:10.652316 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:10.652110 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc podName:9c322816-e088-444d-8237-87aaef482b94 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:42.65209404 +0000 UTC m=+66.237697085 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9cxc" (UniqueName: "kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc") pod "network-check-target-cvl5r" (UID: "9c322816-e088-444d-8237-87aaef482b94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 13:36:11.370990 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:11.370954 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:11.476726 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:11.476678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:11.889667 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:11.889631 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:11.889846 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:11.889645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:11.889846 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:11.889754 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9vnwp" podUID="aa3ea906-be99-40aa-944d-a38f2665910d" Jul 24 13:36:11.889846 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:11.889645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:11.889846 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:11.889816 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-94n97" podUID="65a8a998-e460-4249-9fb2-a15d80a3cd80" Jul 24 13:36:11.890050 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:11.889920 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cvl5r" podUID="9c322816-e088-444d-8237-87aaef482b94" Jul 24 13:36:12.739092 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.739013 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-191.ec2.internal" event="NodeReady" Jul 24 13:36:12.739526 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.739173 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 13:36:12.854247 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.854216 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n4h99"] Jul 24 13:36:12.858979 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.858951 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:12.878399 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.878329 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 13:36:12.878399 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.878384 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 13:36:12.878627 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.878419 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 13:36:12.878627 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.878422 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jxrzw\"" Jul 24 13:36:12.880591 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.880519 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5gf8d"] Jul 24 13:36:12.885811 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.885790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:12.910949 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.910915 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n4h99"] Jul 24 13:36:12.913683 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.913634 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 13:36:12.913844 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.913643 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8szdn\"" Jul 24 13:36:12.914054 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.913631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 13:36:12.925068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.925039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gf8d"] Jul 24 13:36:12.966671 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.966640 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpwp8\" (UniqueName: \"kubernetes.io/projected/49ac5e95-afe2-4c2d-90a4-fd837b438c1e-kube-api-access-wpwp8\") pod \"ingress-canary-n4h99\" (UID: \"49ac5e95-afe2-4c2d-90a4-fd837b438c1e\") " pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:12.966848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.966709 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66d35e6c-6cab-41ff-8299-62800a776bbf-config-volume\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:12.966848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.966773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:12.966848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.966796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d35e6c-6cab-41ff-8299-62800a776bbf-tmp-dir\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:12.967024 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.966866 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrsks\" (UniqueName: \"kubernetes.io/projected/66d35e6c-6cab-41ff-8299-62800a776bbf-kube-api-access-jrsks\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:12.967024 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:12.966913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac5e95-afe2-4c2d-90a4-fd837b438c1e-cert\") pod \"ingress-canary-n4h99\" (UID: \"49ac5e95-afe2-4c2d-90a4-fd837b438c1e\") " pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:13.067287 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66d35e6c-6cab-41ff-8299-62800a776bbf-config-volume\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.067416 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.067416 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067385 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d35e6c-6cab-41ff-8299-62800a776bbf-tmp-dir\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.067528 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrsks\" (UniqueName: \"kubernetes.io/projected/66d35e6c-6cab-41ff-8299-62800a776bbf-kube-api-access-jrsks\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.067528 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac5e95-afe2-4c2d-90a4-fd837b438c1e-cert\") pod \"ingress-canary-n4h99\" (UID: \"49ac5e95-afe2-4c2d-90a4-fd837b438c1e\") " pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:13.067528 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:13.067504 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:13.067683 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpwp8\" (UniqueName: \"kubernetes.io/projected/49ac5e95-afe2-4c2d-90a4-fd837b438c1e-kube-api-access-wpwp8\") pod \"ingress-canary-n4h99\" (UID: \"49ac5e95-afe2-4c2d-90a4-fd837b438c1e\") " pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:13.067683 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:13.067605 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:36:13.567585085 +0000 UTC m=+37.153188115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:13.067977 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067818 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d35e6c-6cab-41ff-8299-62800a776bbf-tmp-dir\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.067977 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.067924 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66d35e6c-6cab-41ff-8299-62800a776bbf-config-volume\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.072192 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.072168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac5e95-afe2-4c2d-90a4-fd837b438c1e-cert\") pod \"ingress-canary-n4h99\" (UID: \"49ac5e95-afe2-4c2d-90a4-fd837b438c1e\") " pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:13.083778 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.083745 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpwp8\" (UniqueName: \"kubernetes.io/projected/49ac5e95-afe2-4c2d-90a4-fd837b438c1e-kube-api-access-wpwp8\") pod \"ingress-canary-n4h99\" (UID: \"49ac5e95-afe2-4c2d-90a4-fd837b438c1e\") " pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:13.083923 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.083901 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrsks\" (UniqueName: \"kubernetes.io/projected/66d35e6c-6cab-41ff-8299-62800a776bbf-kube-api-access-jrsks\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.169835 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.169804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n4h99" Jul 24 13:36:13.312883 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.312641 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n4h99"] Jul 24 13:36:13.315608 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:36:13.315565 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ac5e95_afe2_4c2d_90a4_fd837b438c1e.slice/crio-a04ad3e12141f84196fc8fff64d9054963ef8e12d54113ce8e4f20e2fd210849 WatchSource:0}: Error finding container a04ad3e12141f84196fc8fff64d9054963ef8e12d54113ce8e4f20e2fd210849: Status 404 returned error can't find the container with id a04ad3e12141f84196fc8fff64d9054963ef8e12d54113ce8e4f20e2fd210849 Jul 24 13:36:13.571136 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.571053 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:13.571297 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:13.571222 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:13.571344 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:13.571313 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:36:14.571294394 +0000 UTC m=+38.156897427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:13.872954 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.872863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:13.889943 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.889900 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:13.889943 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.889940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:13.890152 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.889941 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:13.895421 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.895398 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8pjz\"" Jul 24 13:36:13.896420 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.896401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 13:36:13.896584 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.896505 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tpb48\"" Jul 24 13:36:13.896758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.896740 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 13:36:13.898651 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.898628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 13:36:13.899592 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.899577 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 13:36:13.974613 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:13.974573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:14.122688 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:14.122654 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n4h99" event={"ID":"49ac5e95-afe2-4c2d-90a4-fd837b438c1e","Type":"ContainerStarted","Data":"a04ad3e12141f84196fc8fff64d9054963ef8e12d54113ce8e4f20e2fd210849"} Jul 24 13:36:14.126674 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:14.126596 2579 generic.go:356] "Generic (PLEG): container finished" podID="c484f13e-5565-408d-a98c-226f5680525f" containerID="ec2e5886162460e3d7747ad2e93c8e91b5887599cbe2aa3f68bf0d5aef55b5f1" exitCode=0 Jul 24 13:36:14.126674 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:14.126639 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerDied","Data":"ec2e5886162460e3d7747ad2e93c8e91b5887599cbe2aa3f68bf0d5aef55b5f1"} Jul 24 13:36:14.526692 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:14.526600 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:14.579687 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:14.579649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:14.579943 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:14.579924 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:14.580026 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:14.579994 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:36:16.579977293 +0000 UTC m=+40.165580327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:15.133734 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:15.133697 2579 generic.go:356] "Generic (PLEG): container finished" podID="c484f13e-5565-408d-a98c-226f5680525f" containerID="eed987c48b123e5d311acb60a4f782eb0c359ff4e24e057c17a82b74eba46f1a" exitCode=0 Jul 24 13:36:15.134242 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:15.133764 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerDied","Data":"eed987c48b123e5d311acb60a4f782eb0c359ff4e24e057c17a82b74eba46f1a"} Jul 24 13:36:16.139650 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.139342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" event={"ID":"c484f13e-5565-408d-a98c-226f5680525f","Type":"ContainerStarted","Data":"b957d5b72ccf23771eed54c14c24a9d0b1b70163a2995e914dff9b567f155cbd"} Jul 24 13:36:16.140825 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.140805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n4h99" event={"ID":"49ac5e95-afe2-4c2d-90a4-fd837b438c1e","Type":"ContainerStarted","Data":"7322083242e8f96bb348720f292a68706cfc71d9fc0c94694e6e3b7b02e3be5e"} Jul 24 13:36:16.165893 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.165845 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gvb2c" podStartSLOduration=9.976655248 podStartE2EDuration="39.165826758s" totalImagesPullingTime="29.18917151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:16.164689555 +0000 UTC m=+39.750292605" watchObservedRunningTime="2026-07-24 13:36:16.165826758 +0000 UTC m=+39.751429809" Jul 24 13:36:16.303707 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.303675 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:16.417047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.416951 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:16.553735 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.553702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:16.595847 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:16.595820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:16.595982 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:16.595950 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:16.596017 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:16.596002 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:36:20.595987872 +0000 UTC m=+44.181590902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:20.622744 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:20.622706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:20.623172 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:20.622870 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:20.623172 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:20.622942 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:36:28.622922092 +0000 UTC m=+52.208525139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:21.220741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:21.220711 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:21.311063 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:21.311034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:23.296977 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:23.296942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:23.419014 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:23.418979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:23.515470 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:23.515439 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:28.677558 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:28.677523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:28.677955 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:28.677665 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:28.677955 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:28.677726 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:36:44.677712081 +0000 UTC m=+68.263315110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:31.223776 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.223721 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n4h99" podStartSLOduration=16.81161154 podStartE2EDuration="19.223703977s" totalImagesPullingTime="2.412092437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:16.181563392 +0000 UTC m=+39.767166447" watchObservedRunningTime="2026-07-24 13:36:31.223703977 +0000 UTC m=+54.809307007" Jul 24 13:36:31.224662 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.224493 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht"] Jul 24 13:36:31.246031 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.245995 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9bqn9"] Jul 24 13:36:31.246200 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.246130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.254124 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.254101 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 13:36:31.254124 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.254116 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 13:36:31.254124 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.254101 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 13:36:31.254386 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.254126 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 13:36:31.254489 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.254475 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dm469\"" Jul 24 13:36:31.263965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.263942 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht"] Jul 24 13:36:31.263965 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.263971 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9bqn9"] Jul 24 13:36:31.264124 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.264045 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.269597 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.269566 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 13:36:31.269726 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.269630 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 13:36:31.275076 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.275058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tzzwm\"" Jul 24 13:36:31.275453 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.275439 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 13:36:31.275590 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.275578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 13:36:31.277791 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.277776 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 13:36:31.396027 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.395989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-config\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.396027 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-serving-cert\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.396232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.396232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396114 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.396232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-service-ca-bundle\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.396232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhc62\" (UniqueName: \"kubernetes.io/projected/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-kube-api-access-bhc62\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.396232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-snapshots\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.396415 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-tmp\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.396415 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.396321 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7fx5\" (UniqueName: \"kubernetes.io/projected/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-kube-api-access-x7fx5\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.461456 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.461422 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64df8477cf-kqfkq"] Jul 24 13:36:31.479730 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.479652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.484052 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.484021 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 13:36:31.484188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.484085 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 13:36:31.484188 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.484133 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 13:36:31.484353 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.484230 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 13:36:31.484353 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.484229 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 13:36:31.484353 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.484264 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 13:36:31.485194 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.485179 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ssv4l\"" Jul 24 13:36:31.497571 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-config\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.497656 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-serving-cert\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.497656 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.497729 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.497762 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497750 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-service-ca-bundle\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.497802 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhc62\" (UniqueName: \"kubernetes.io/projected/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-kube-api-access-bhc62\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.497853 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-snapshots\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.497907 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-tmp\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.497907 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.497888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7fx5\" (UniqueName: \"kubernetes.io/projected/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-kube-api-access-x7fx5\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.498269 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.498235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-service-ca-bundle\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.498385 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.498300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-config\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.498493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.498475 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-tmp\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.498547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.498522 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.498547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.498519 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-snapshots\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.501230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.501209 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.501323 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.501290 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-serving-cert\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.502137 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.502114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64df8477cf-kqfkq"] Jul 24 13:36:31.528871 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.528843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7fx5\" (UniqueName: \"kubernetes.io/projected/a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b-kube-api-access-x7fx5\") pod \"service-ca-operator-5d6c75f84f-64cht\" (UID: \"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.529025 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.529004 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhc62\" (UniqueName: \"kubernetes.io/projected/fa5e0d2f-290e-48ec-9d19-1aed1244e8b2-kube-api-access-bhc62\") pod \"insights-operator-5885fdb759-9bqn9\" (UID: \"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2\") " pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.555808 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.555783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" Jul 24 13:36:31.572985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.572964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" Jul 24 13:36:31.599094 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.599059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.599230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.599106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-default-certificate\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.599230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.599143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.599230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.599167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-stats-auth\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.599230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.599198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zntx\" (UniqueName: \"kubernetes.io/projected/cda31855-c87f-40b6-aeea-62353661b26d-kube-api-access-2zntx\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.699792 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.699764 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zntx\" (UniqueName: \"kubernetes.io/projected/cda31855-c87f-40b6-aeea-62353661b26d-kube-api-access-2zntx\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.699954 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.699883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.699954 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.699911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-default-certificate\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.699954 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.699931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.699954 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.699951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-stats-auth\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.700151 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:31.700036 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 13:36:31.700151 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:31.700103 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:32.200083106 +0000 UTC m=+55.785686139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : secret "router-metrics-certs-default" not found Jul 24 13:36:31.700151 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:31.700131 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:32.200120672 +0000 UTC m=+55.785723717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : configmap references non-existent config key: service-ca.crt Jul 24 13:36:31.702363 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.702343 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-stats-auth\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.702461 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.702414 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-default-certificate\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.720558 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.720538 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zntx\" (UniqueName: \"kubernetes.io/projected/cda31855-c87f-40b6-aeea-62353661b26d-kube-api-access-2zntx\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:31.740136 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.740114 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht"] Jul 24 13:36:31.741921 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:36:31.741900 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4a3a91c_c1fd_41b3_bb6b_99cd84b3123b.slice/crio-1057d6a4d75eedf9cc4598d8c2bcee9bf7c7b610683e829a2c530b95673ed6da WatchSource:0}: Error finding container 1057d6a4d75eedf9cc4598d8c2bcee9bf7c7b610683e829a2c530b95673ed6da: Status 404 returned error can't find the container with id 1057d6a4d75eedf9cc4598d8c2bcee9bf7c7b610683e829a2c530b95673ed6da Jul 24 13:36:31.758949 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:36:31.758929 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa5e0d2f_290e_48ec_9d19_1aed1244e8b2.slice/crio-e59c5853c44693db2494fc040466da2f1a3b342b075f37c7667b7d45091ddc22 WatchSource:0}: Error finding container e59c5853c44693db2494fc040466da2f1a3b342b075f37c7667b7d45091ddc22: Status 404 returned error can't find the container with id e59c5853c44693db2494fc040466da2f1a3b342b075f37c7667b7d45091ddc22 Jul 24 13:36:31.760582 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.760497 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9bqn9"] Jul 24 13:36:31.868820 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.868784 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:31.994576 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:31.994484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:32.176748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:32.176715 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" event={"ID":"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2","Type":"ContainerStarted","Data":"e59c5853c44693db2494fc040466da2f1a3b342b075f37c7667b7d45091ddc22"} Jul 24 13:36:32.177633 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:32.177611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" event={"ID":"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b","Type":"ContainerStarted","Data":"1057d6a4d75eedf9cc4598d8c2bcee9bf7c7b610683e829a2c530b95673ed6da"} Jul 24 13:36:32.204423 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:32.204392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:32.204520 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:32.204429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:32.204576 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:32.204535 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:33.204521948 +0000 UTC m=+56.790124978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : configmap references non-existent config key: service-ca.crt Jul 24 13:36:32.204576 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:32.204550 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 13:36:32.204670 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:32.204608 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:33.204590285 +0000 UTC m=+56.790193333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : secret "router-metrics-certs-default" not found Jul 24 13:36:33.213806 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:33.213771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:33.214257 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:33.213820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:33.214257 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:33.213953 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 13:36:33.214257 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:33.213971 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:35.213951602 +0000 UTC m=+58.799554654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : configmap references non-existent config key: service-ca.crt Jul 24 13:36:33.214257 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:33.214021 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:35.214004176 +0000 UTC m=+58.799607224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : secret "router-metrics-certs-default" not found Jul 24 13:36:34.185125 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:34.185097 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" event={"ID":"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b","Type":"ContainerStarted","Data":"59a306238c30a2b81a088037082afaddc4de8d7db527c61a3825e7ec8c7205a8"} Jul 24 13:36:34.434794 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:34.434688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:34.531029 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:34.530984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:35.189501 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.189463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" event={"ID":"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2","Type":"ContainerStarted","Data":"176ae48a9536011efedb3d5cf6d9beed69b2f3f2f8f512be90c2d45d5235d8d6"} Jul 24 13:36:35.212346 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.212263 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" podStartSLOduration=1.856878391 podStartE2EDuration="4.212246168s" totalImagesPullingTime="2.355367777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:35.210978738 +0000 UTC m=+58.796581807" watchObservedRunningTime="2026-07-24 13:36:35.212246168 +0000 UTC m=+58.797849220" Jul 24 13:36:35.212626 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.212599 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" podStartSLOduration=1.837321212 podStartE2EDuration="4.212589629s" totalImagesPullingTime="2.375268417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:34.224825944 +0000 UTC m=+57.810428997" watchObservedRunningTime="2026-07-24 13:36:35.212589629 +0000 UTC m=+58.798192681" Jul 24 13:36:35.234120 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.234088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:35.234120 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.234129 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:35.234391 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.234285 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 13:36:35.234391 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.234351 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:39.234332252 +0000 UTC m=+62.819935300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : configmap references non-existent config key: service-ca.crt Jul 24 13:36:35.234391 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.234376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:39.234365221 +0000 UTC m=+62.819968258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : secret "router-metrics-certs-default" not found Jul 24 13:36:35.418686 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.418653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:35.430265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.430230 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xjvvp"] Jul 24 13:36:35.432411 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.432390 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.438912 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.438677 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 13:36:35.440792 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.440735 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 13:36:35.441852 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.441837 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m5bd2\"" Jul 24 13:36:35.443658 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.443637 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-xjvvp\" is forbidden: User \"system:node:ip-10-0-138-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-191.ec2.internal' and this object" podUID="82a271ff-6fcc-456e-97e2-d468b389c333" pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.450006 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.449986 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xjvvp"] Jul 24 13:36:35.507108 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.507078 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:35.537462 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.537432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82a271ff-6fcc-456e-97e2-d468b389c333-crio-socket\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.537626 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.537467 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6l94\" (UniqueName: \"kubernetes.io/projected/82a271ff-6fcc-456e-97e2-d468b389c333-kube-api-access-p6l94\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.537626 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.537487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.537626 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.537506 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.537626 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.537584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82a271ff-6fcc-456e-97e2-d468b389c333-data-volume\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638764 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.638714 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82a271ff-6fcc-456e-97e2-d468b389c333-crio-socket\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638764 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.638763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6l94\" (UniqueName: \"kubernetes.io/projected/82a271ff-6fcc-456e-97e2-d468b389c333-kube-api-access-p6l94\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.638826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.638845 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/82a271ff-6fcc-456e-97e2-d468b389c333-crio-socket\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.638859 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.638912 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.638915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82a271ff-6fcc-456e-97e2-d468b389c333-data-volume\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.638934 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 13:36:35.638978 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.638976 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:36.138953714 +0000 UTC m=+59.724556757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : configmap "kube-rbac-proxy" not found Jul 24 13:36:35.639192 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:35.639087 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:36.139076605 +0000 UTC m=+59.724679634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : secret "insights-runtime-extractor-tls" not found Jul 24 13:36:35.639229 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.639208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/82a271ff-6fcc-456e-97e2-d468b389c333-data-volume\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.647829 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.647806 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6l94\" (UniqueName: \"kubernetes.io/projected/82a271ff-6fcc-456e-97e2-d468b389c333-kube-api-access-p6l94\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:35.797044 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.797013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:35.902178 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:35.902142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:36.090024 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:36.089929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:36.142386 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:36.142347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:36.142386 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:36.142389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:36.142609 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:36.142470 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 13:36:36.142609 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:36.142499 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 13:36:36.142609 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:36.142536 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:37.142516567 +0000 UTC m=+60.728119614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : configmap "kube-rbac-proxy" not found Jul 24 13:36:36.142609 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:36.142552 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:37.142544788 +0000 UTC m=+60.728147823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : secret "insights-runtime-extractor-tls" not found Jul 24 13:36:36.187307 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:36.187266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:36.935614 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:36.935579 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:36.975091 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:36.975057 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng"] Jul 24 13:36:37.006173 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.006146 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng"] Jul 24 13:36:37.006349 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.006265 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" Jul 24 13:36:37.009667 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.009644 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 13:36:37.009903 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.009889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 13:36:37.009903 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.009899 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rlc4r\"" Jul 24 13:36:37.026521 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.026489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:37.049711 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.049684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb9kt\" (UniqueName: \"kubernetes.io/projected/790bb256-dc5f-4007-9e7f-716b8b70cd45-kube-api-access-fb9kt\") pod \"migrator-6865c9967-w7nng\" (UID: \"790bb256-dc5f-4007-9e7f-716b8b70cd45\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" Jul 24 13:36:37.126698 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.126669 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:37.150475 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.150444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:37.150571 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.150481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:37.150571 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.150500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb9kt\" (UniqueName: \"kubernetes.io/projected/790bb256-dc5f-4007-9e7f-716b8b70cd45-kube-api-access-fb9kt\") pod \"migrator-6865c9967-w7nng\" (UID: \"790bb256-dc5f-4007-9e7f-716b8b70cd45\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" Jul 24 13:36:37.150644 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:37.150591 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 13:36:37.150680 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:37.150651 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:39.150635351 +0000 UTC m=+62.736238381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : secret "insights-runtime-extractor-tls" not found Jul 24 13:36:37.150737 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:37.150589 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 13:36:37.150737 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:37.150732 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:39.150718619 +0000 UTC m=+62.736321652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : configmap "kube-rbac-proxy" not found Jul 24 13:36:37.179813 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.179777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb9kt\" (UniqueName: \"kubernetes.io/projected/790bb256-dc5f-4007-9e7f-716b8b70cd45-kube-api-access-fb9kt\") pod \"migrator-6865c9967-w7nng\" (UID: \"790bb256-dc5f-4007-9e7f-716b8b70cd45\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" Jul 24 13:36:37.314816 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.314781 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" Jul 24 13:36:37.454872 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.454849 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng"] Jul 24 13:36:37.457210 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:36:37.457178 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790bb256_dc5f_4007_9e7f_716b8b70cd45.slice/crio-12899e9b5711b96cb9a18237cb10ca808daa5d4ce71d55708b70eda241dd8cda WatchSource:0}: Error finding container 12899e9b5711b96cb9a18237cb10ca808daa5d4ce71d55708b70eda241dd8cda: Status 404 returned error can't find the container with id 12899e9b5711b96cb9a18237cb10ca808daa5d4ce71d55708b70eda241dd8cda Jul 24 13:36:37.580807 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.580743 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sc54w_65787285-0f43-4ecc-9487-ed2044a70ea9/dns-node-resolver/0.log" Jul 24 13:36:37.789502 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.789472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:37.888666 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:37.888591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:38.124032 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:38.124001 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7z6j" Jul 24 13:36:38.197247 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:38.197162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" event={"ID":"790bb256-dc5f-4007-9e7f-716b8b70cd45","Type":"ContainerStarted","Data":"12899e9b5711b96cb9a18237cb10ca808daa5d4ce71d55708b70eda241dd8cda"} Jul 24 13:36:38.351264 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:38.351236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:38.379289 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:38.379244 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ts5qc_b6179e1d-c181-4b39-92ba-8287e0b3843f/node-ca/0.log" Jul 24 13:36:38.459325 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:38.459230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:39.162413 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.162381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:39.165448 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.165429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:39.165531 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.165457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:39.165585 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.165526 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 13:36:39.165634 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.165587 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:43.165570174 +0000 UTC m=+66.751173203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : configmap "kube-rbac-proxy" not found Jul 24 13:36:39.165634 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.165596 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 13:36:39.165721 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.165663 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:43.165640204 +0000 UTC m=+66.751243249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : secret "insights-runtime-extractor-tls" not found Jul 24 13:36:39.200648 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.200623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" event={"ID":"790bb256-dc5f-4007-9e7f-716b8b70cd45","Type":"ContainerStarted","Data":"0bf8470df190df382d75f35fd5a2b18b873385dc6fd835eb57670fe53868d928"} Jul 24 13:36:39.200773 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.200666 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" event={"ID":"790bb256-dc5f-4007-9e7f-716b8b70cd45","Type":"ContainerStarted","Data":"d8123d97e9dd04bdb67da4edd01c2694dce0840df14b5eeee17722d62097f672"} Jul 24 13:36:39.221109 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.221062 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-w7nng" podStartSLOduration=2.024442323 podStartE2EDuration="3.221048423s" totalImagesPullingTime="1.1966061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:39.220415341 +0000 UTC m=+62.806018393" watchObservedRunningTime="2026-07-24 13:36:39.221048423 +0000 UTC m=+62.806651474" Jul 24 13:36:39.266006 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.265974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:39.266155 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.266013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:39.266155 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.266121 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 13:36:39.266155 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.266145 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:47.266125028 +0000 UTC m=+70.851728072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : configmap references non-existent config key: service-ca.crt Jul 24 13:36:39.266353 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:39.266174 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:36:47.266160783 +0000 UTC m=+70.851763835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : secret "router-metrics-certs-default" not found Jul 24 13:36:39.380113 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:39.380086 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n4h99_49ac5e95-afe2-4c2d-90a4-fd837b438c1e/serve-healthcheck-canary/0.log" Jul 24 13:36:41.532761 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:41.532721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:41.783039 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:41.782959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:41.883378 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:41.883345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:41.984574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:41.984538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:42.084049 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.083974 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:42.185652 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.185622 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:42.596250 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.596205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:36:42.599322 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.599300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 13:36:42.606853 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:42.606831 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 24 13:36:42.606948 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:42.606898 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs podName:65a8a998-e460-4249-9fb2-a15d80a3cd80 nodeName:}" failed. No retries permitted until 2026-07-24 13:37:46.606880343 +0000 UTC m=+130.192483373 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs") pod "network-metrics-daemon-94n97" (UID: "65a8a998-e460-4249-9fb2-a15d80a3cd80") : secret "metrics-daemon-secret" not found Jul 24 13:36:42.609126 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.609104 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:42.696770 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.696728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:42.696943 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.696796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:42.699691 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.699674 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 13:36:42.700261 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.700249 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 13:36:42.703622 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.703591 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:42.709722 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.709701 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa3ea906-be99-40aa-944d-a38f2665910d-original-pull-secret\") pod \"global-pull-secret-syncer-9vnwp\" (UID: \"aa3ea906-be99-40aa-944d-a38f2665910d\") " pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:42.710114 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.710097 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 13:36:42.720241 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:42.720214 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9cxc\" (UniqueName: \"kubernetes.io/projected/9c322816-e088-444d-8237-87aaef482b94-kube-api-access-r9cxc\") pod \"network-check-target-cvl5r\" (UID: \"9c322816-e088-444d-8237-87aaef482b94\") " pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:43.002134 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.002104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vnwp" Jul 24 13:36:43.017694 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.017671 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tpb48\"" Jul 24 13:36:43.025265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.025237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:43.054446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.054401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:43.137287 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.137245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vnwp"] Jul 24 13:36:43.139422 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:36:43.139393 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3ea906_be99_40aa_944d_a38f2665910d.slice/crio-3a2a0f2191c2dc77920026ac8633c31a64895c3720ffa95507bbeede35083027 WatchSource:0}: Error finding container 3a2a0f2191c2dc77920026ac8633c31a64895c3720ffa95507bbeede35083027: Status 404 returned error can't find the container with id 3a2a0f2191c2dc77920026ac8633c31a64895c3720ffa95507bbeede35083027 Jul 24 13:36:43.167530 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.167503 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cvl5r"] Jul 24 13:36:43.170034 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:36:43.170004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c322816_e088_444d_8237_87aaef482b94.slice/crio-593104ecb6982a3b4a9ddfbbfe199087a361f85833420cd389269618f70f39ab WatchSource:0}: Error finding container 593104ecb6982a3b4a9ddfbbfe199087a361f85833420cd389269618f70f39ab: Status 404 returned error can't find the container with id 593104ecb6982a3b4a9ddfbbfe199087a361f85833420cd389269618f70f39ab Jul 24 13:36:43.200778 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.200751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:43.200778 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.200784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:43.201012 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:43.200881 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 13:36:43.201012 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:43.200939 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:51.200924374 +0000 UTC m=+74.786527404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : configmap "kube-rbac-proxy" not found Jul 24 13:36:43.201012 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:43.200964 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 13:36:43.201128 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:43.201029 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:36:51.201006815 +0000 UTC m=+74.786609845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : secret "insights-runtime-extractor-tls" not found Jul 24 13:36:43.211758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.211722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vnwp" event={"ID":"aa3ea906-be99-40aa-944d-a38f2665910d","Type":"ContainerStarted","Data":"3a2a0f2191c2dc77920026ac8633c31a64895c3720ffa95507bbeede35083027"} Jul 24 13:36:43.212836 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.212816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cvl5r" event={"ID":"9c322816-e088-444d-8237-87aaef482b94","Type":"ContainerStarted","Data":"593104ecb6982a3b4a9ddfbbfe199087a361f85833420cd389269618f70f39ab"} Jul 24 13:36:43.882745 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:43.882688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:44.340995 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:44.340953 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:44.489807 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:44.489764 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:44.712305 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:44.712198 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:44.714216 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:44.714187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:36:44.714418 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:44.714396 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 13:36:44.714508 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:44.714472 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls podName:66d35e6c-6cab-41ff-8299-62800a776bbf nodeName:}" failed. No retries permitted until 2026-07-24 13:37:16.714451345 +0000 UTC m=+100.300054391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls") pod "dns-default-5gf8d" (UID: "66d35e6c-6cab-41ff-8299-62800a776bbf") : secret "dns-default-metrics-tls" not found Jul 24 13:36:44.877171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:44.877134 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:45.087549 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:45.087516 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:45.289707 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:45.289666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:45.533986 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:45.533877 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:46.091783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:46.091746 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:46.407600 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:46.407524 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:46.607213 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:46.607179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:46.706331 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:46.706230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:46.888651 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:46.888611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:47.307773 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:47.307741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:47.339197 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:47.339158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:47.339417 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:47.339212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:47.339490 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:47.339432 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle podName:cda31855-c87f-40b6-aeea-62353661b26d nodeName:}" failed. No retries permitted until 2026-07-24 13:37:03.339410102 +0000 UTC m=+86.925013137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle") pod "router-default-64df8477cf-kqfkq" (UID: "cda31855-c87f-40b6-aeea-62353661b26d") : configmap references non-existent config key: service-ca.crt Jul 24 13:36:47.341876 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:47.341849 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cda31855-c87f-40b6-aeea-62353661b26d-metrics-certs\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:36:47.396099 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:47.396066 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:47.496108 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:47.496073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:48.081237 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.081161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:48.234387 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.234353 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vnwp" event={"ID":"aa3ea906-be99-40aa-944d-a38f2665910d","Type":"ContainerStarted","Data":"592cbf8df941d2ab188bb720e94355138a710305762bd1e375b067365d5dfca7"} Jul 24 13:36:48.235802 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.235777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cvl5r" event={"ID":"9c322816-e088-444d-8237-87aaef482b94","Type":"ContainerStarted","Data":"380fa27adc086484927736a39d97743f8714abba77f007afaf4f78a298b3b283"} Jul 24 13:36:48.235929 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.235903 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:36:48.259701 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.259637 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9vnwp" podStartSLOduration=66.579472332 podStartE2EDuration="1m11.259618219s" totalImagesPullingTime="4.680145887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:48.259220177 +0000 UTC m=+71.844823235" watchObservedRunningTime="2026-07-24 13:36:48.259618219 +0000 UTC m=+71.845221272" Jul 24 13:36:48.289346 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.289303 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cvl5r" podStartSLOduration=66.642342753 podStartE2EDuration="1m11.289267027s" totalImagesPullingTime="4.646924274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:36:48.28906789 +0000 UTC m=+71.874670942" watchObservedRunningTime="2026-07-24 13:36:48.289267027 +0000 UTC m=+71.874870078" Jul 24 13:36:48.484101 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.484041 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:48.663060 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.663029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:48.800515 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.800430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:48.901148 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.901118 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:48.973581 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:48.973552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:49.282793 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:49.282762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:49.483265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:49.483232 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:50.105194 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:50.105158 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:50.498061 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:50.498030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:50.881711 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:50.881618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:51.077983 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.077950 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:51.212071 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.211992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:51.272264 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.272230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:51.272264 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.272265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:51.272547 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:51.272388 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 13:36:51.272547 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:36:51.272446 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls podName:82a271ff-6fcc-456e-97e2-d468b389c333 nodeName:}" failed. No retries permitted until 2026-07-24 13:37:07.272430391 +0000 UTC m=+90.858033423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xjvvp" (UID: "82a271ff-6fcc-456e-97e2-d468b389c333") : secret "insights-runtime-extractor-tls" not found Jul 24 13:36:51.272910 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.272886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/82a271ff-6fcc-456e-97e2-d468b389c333-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:36:51.309127 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.309069 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:51.484193 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.484162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:51.894602 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:51.894526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:52.303574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:52.303543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:52.485511 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:52.485467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:56.251683 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:56.251648 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:56.348910 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:56.348875 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:56.519122 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:56.519045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:56.699296 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:56.699252 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:56.802860 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:56.802777 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:57.119516 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:57.119432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:57.209686 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:57.209655 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:57.313342 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:57.313311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:57.740247 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:57.740218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:57.809677 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:57.809646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:57.927126 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:57.927089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:58.111997 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:58.111889 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:58.278702 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:58.278602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:59.901053 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:59.901020 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:36:59.994500 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:36:59.994472 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:02.637615 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:02.637584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:02.754537 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:02.754507 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:03.369509 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:03.369471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:03.370076 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:03.370055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cda31855-c87f-40b6-aeea-62353661b26d-service-ca-bundle\") pod \"router-default-64df8477cf-kqfkq\" (UID: \"cda31855-c87f-40b6-aeea-62353661b26d\") " pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:03.600975 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:03.600942 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ssv4l\"" Jul 24 13:37:03.608510 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:03.608486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:03.737692 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:03.737648 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64df8477cf-kqfkq"] Jul 24 13:37:03.740526 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:03.740493 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda31855_c87f_40b6_aeea_62353661b26d.slice/crio-57ffef0c560a249f308f230cdc140e0bf6c43a65c7696c3c6ecf2875b55d72f6 WatchSource:0}: Error finding container 57ffef0c560a249f308f230cdc140e0bf6c43a65c7696c3c6ecf2875b55d72f6: Status 404 returned error can't find the container with id 57ffef0c560a249f308f230cdc140e0bf6c43a65c7696c3c6ecf2875b55d72f6 Jul 24 13:37:04.287565 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:04.287523 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64df8477cf-kqfkq" event={"ID":"cda31855-c87f-40b6-aeea-62353661b26d","Type":"ContainerStarted","Data":"2958497ed6b2b62c8627c8cd7d072944a21530f44461dec4fe682079a8e7759b"} Jul 24 13:37:04.287565 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:04.287573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64df8477cf-kqfkq" event={"ID":"cda31855-c87f-40b6-aeea-62353661b26d","Type":"ContainerStarted","Data":"57ffef0c560a249f308f230cdc140e0bf6c43a65c7696c3c6ecf2875b55d72f6"} Jul 24 13:37:04.316080 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:04.316028 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64df8477cf-kqfkq" podStartSLOduration=33.316010823 podStartE2EDuration="33.316010823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:04.31420341 +0000 UTC m=+87.899806475" watchObservedRunningTime="2026-07-24 13:37:04.316010823 +0000 UTC m=+87.901613874" Jul 24 13:37:04.609147 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:04.609055 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:04.611665 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:04.611642 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:05.290902 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:05.290868 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:05.292125 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:05.292106 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64df8477cf-kqfkq" Jul 24 13:37:05.743052 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:05.743023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:05.916658 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:05.916626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:06.004520 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.004435 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592"] Jul 24 13:37:06.006593 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.006578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:06.010702 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.010681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 13:37:06.010820 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.010802 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-frdt5\"" Jul 24 13:37:06.027676 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.027652 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592"] Jul 24 13:37:06.041543 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.041519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:06.089881 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.089842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77622544-3d2d-4e98-b174-fe59962f4de8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-7m592\" (UID: \"77622544-3d2d-4e98-b174-fe59962f4de8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:06.190544 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.190509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77622544-3d2d-4e98-b174-fe59962f4de8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-7m592\" (UID: \"77622544-3d2d-4e98-b174-fe59962f4de8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:06.190749 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:37:06.190701 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 24 13:37:06.190817 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:37:06.190789 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77622544-3d2d-4e98-b174-fe59962f4de8-tls-certificates podName:77622544-3d2d-4e98-b174-fe59962f4de8 nodeName:}" failed. No retries permitted until 2026-07-24 13:37:06.690766568 +0000 UTC m=+90.276369604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/77622544-3d2d-4e98-b174-fe59962f4de8-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-7m592" (UID: "77622544-3d2d-4e98-b174-fe59962f4de8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 24 13:37:06.360079 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.359999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:06.694907 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.694820 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77622544-3d2d-4e98-b174-fe59962f4de8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-7m592\" (UID: \"77622544-3d2d-4e98-b174-fe59962f4de8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:06.697202 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.697180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/77622544-3d2d-4e98-b174-fe59962f4de8-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-7m592\" (UID: \"77622544-3d2d-4e98-b174-fe59962f4de8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:06.914733 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:06.914686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:07.036413 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.036368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592"] Jul 24 13:37:07.039132 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:07.039101 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77622544_3d2d_4e98_b174_fe59962f4de8.slice/crio-500c2e857b4f596d18d80041ee5843c966df0ad6b6055f38a1d35d2986d8e364 WatchSource:0}: Error finding container 500c2e857b4f596d18d80041ee5843c966df0ad6b6055f38a1d35d2986d8e364: Status 404 returned error can't find the container with id 500c2e857b4f596d18d80041ee5843c966df0ad6b6055f38a1d35d2986d8e364 Jul 24 13:37:07.298219 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.298184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" event={"ID":"77622544-3d2d-4e98-b174-fe59962f4de8","Type":"ContainerStarted","Data":"500c2e857b4f596d18d80041ee5843c966df0ad6b6055f38a1d35d2986d8e364"} Jul 24 13:37:07.299666 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.299649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:37:07.301937 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.301916 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/82a271ff-6fcc-456e-97e2-d468b389c333-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xjvvp\" (UID: \"82a271ff-6fcc-456e-97e2-d468b389c333\") " pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:37:07.545205 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.545169 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m5bd2\"" Jul 24 13:37:07.553027 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.552957 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xjvvp" Jul 24 13:37:07.696783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:07.696748 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xjvvp"] Jul 24 13:37:07.927572 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:07.927502 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a271ff_6fcc_456e_97e2_d468b389c333.slice/crio-f3500c2c3b94cf505e0a486d552cb1906d21f354b38c5706e91e38e21f7270d5 WatchSource:0}: Error finding container f3500c2c3b94cf505e0a486d552cb1906d21f354b38c5706e91e38e21f7270d5: Status 404 returned error can't find the container with id f3500c2c3b94cf505e0a486d552cb1906d21f354b38c5706e91e38e21f7270d5 Jul 24 13:37:08.302100 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:08.302060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xjvvp" event={"ID":"82a271ff-6fcc-456e-97e2-d468b389c333","Type":"ContainerStarted","Data":"f3500c2c3b94cf505e0a486d552cb1906d21f354b38c5706e91e38e21f7270d5"} Jul 24 13:37:08.303413 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:08.303388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" event={"ID":"77622544-3d2d-4e98-b174-fe59962f4de8","Type":"ContainerStarted","Data":"68955e3f584d8f2147f4efdd7245cfc16d6cb5eb9f5e6f2729c621af789d9378"} Jul 24 13:37:08.303634 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:08.303619 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:08.308218 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:08.308188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" Jul 24 13:37:08.353099 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:08.353043 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-7m592" podStartSLOduration=2.445535783 podStartE2EDuration="3.353022357s" totalImagesPullingTime="907.486574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:08.326374704 +0000 UTC m=+91.911977758" watchObservedRunningTime="2026-07-24 13:37:08.353022357 +0000 UTC m=+91.938625411" Jul 24 13:37:09.074637 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:09.074609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:09.240553 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:09.240512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:09.546773 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:09.546738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:09.630104 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:09.630072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:11.370354 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:11.370322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:11.480958 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:11.480929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:12.494117 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:12.494084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:12.617897 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:12.617864 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:13.168455 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:13.168352 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:13.267547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:13.267503 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:13.326049 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:13.326012 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xjvvp" event={"ID":"82a271ff-6fcc-456e-97e2-d468b389c333","Type":"ContainerStarted","Data":"129331b43ffaf0dc875d970997282a54a2a2a0c4515cc226c9313ca2af839b29"} Jul 24 13:37:14.758724 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:14.758689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:15.584308 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.584203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:15.706047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.706014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:15.754204 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.754162 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d96c9d5b4-t2598"] Jul 24 13:37:15.764122 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.764097 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.767446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.767423 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-59njm\"" Jul 24 13:37:15.768588 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.768566 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 13:37:15.769047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.768872 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 13:37:15.769047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.768902 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 13:37:15.769047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.768924 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 13:37:15.769047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.768961 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 13:37:15.769259 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.769196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 13:37:15.769423 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.769407 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 13:37:15.775460 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.775437 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 13:37:15.779762 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.779742 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d96c9d5b4-t2598"] Jul 24 13:37:15.867983 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.867895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-oauth-config\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.867983 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.867932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-config\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.867983 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.867963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf5vt\" (UniqueName: \"kubernetes.io/projected/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-kube-api-access-tf5vt\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.868245 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.868052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-service-ca\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.868245 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.868098 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-serving-cert\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.868245 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.868121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-trusted-ca-bundle\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.868245 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.868166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-oauth-serving-cert\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969081 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-service-ca\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969081 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-serving-cert\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969351 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-trusted-ca-bundle\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969351 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-oauth-serving-cert\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969477 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-oauth-config\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969477 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-config\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969477 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf5vt\" (UniqueName: \"kubernetes.io/projected/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-kube-api-access-tf5vt\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.969975 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.969927 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-service-ca\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.970139 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.970107 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-trusted-ca-bundle\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.970366 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.970329 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-config\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.970366 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.970358 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-oauth-serving-cert\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.972591 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.972571 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-serving-cert\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.972681 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.972626 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-oauth-config\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:15.981260 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:15.981234 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf5vt\" (UniqueName: \"kubernetes.io/projected/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-kube-api-access-tf5vt\") pod \"console-7d96c9d5b4-t2598\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:16.075454 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.075423 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:16.337962 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.337935 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xjvvp" event={"ID":"82a271ff-6fcc-456e-97e2-d468b389c333","Type":"ContainerStarted","Data":"e743d83fb1c554dfd76f4ff5055419af5fa782493f2f9cbce25f0c647faf0516"} Jul 24 13:37:16.353318 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.353290 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d96c9d5b4-t2598"] Jul 24 13:37:16.359393 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:16.359371 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e30bbf2_88a8_4ae1_b871_1ff914af8be7.slice/crio-ac52c8e96da8e21328ec3f6b48c9ae11680004322a9fc08227f339ba301738d4 WatchSource:0}: Error finding container ac52c8e96da8e21328ec3f6b48c9ae11680004322a9fc08227f339ba301738d4: Status 404 returned error can't find the container with id ac52c8e96da8e21328ec3f6b48c9ae11680004322a9fc08227f339ba301738d4 Jul 24 13:37:16.777360 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.777321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:37:16.779880 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.779852 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66d35e6c-6cab-41ff-8299-62800a776bbf-metrics-tls\") pod \"dns-default-5gf8d\" (UID: \"66d35e6c-6cab-41ff-8299-62800a776bbf\") " pod="openshift-dns/dns-default-5gf8d" Jul 24 13:37:16.799982 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.799952 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8szdn\"" Jul 24 13:37:16.807666 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:16.807635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5gf8d" Jul 24 13:37:17.010703 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.010613 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5gf8d"] Jul 24 13:37:17.015353 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:17.015312 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d35e6c_6cab_41ff_8299_62800a776bbf.slice/crio-4d0184b07ae2a0a89b77a2461c8b3a196daf57e9e6c7dc1bd92602f5fdd55c2d WatchSource:0}: Error finding container 4d0184b07ae2a0a89b77a2461c8b3a196daf57e9e6c7dc1bd92602f5fdd55c2d: Status 404 returned error can't find the container with id 4d0184b07ae2a0a89b77a2461c8b3a196daf57e9e6c7dc1bd92602f5fdd55c2d Jul 24 13:37:17.345788 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.345750 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gf8d" event={"ID":"66d35e6c-6cab-41ff-8299-62800a776bbf","Type":"ContainerStarted","Data":"4d0184b07ae2a0a89b77a2461c8b3a196daf57e9e6c7dc1bd92602f5fdd55c2d"} Jul 24 13:37:17.348349 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.348252 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d96c9d5b4-t2598" event={"ID":"4e30bbf2-88a8-4ae1-b871-1ff914af8be7","Type":"ContainerStarted","Data":"ac52c8e96da8e21328ec3f6b48c9ae11680004322a9fc08227f339ba301738d4"} Jul 24 13:37:17.364321 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.364284 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:17.771971 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.771931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:17.916677 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.915341 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56"] Jul 24 13:37:17.919299 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.918924 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:17.922210 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.922182 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 13:37:17.923110 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.922718 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 13:37:17.923540 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.923365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 13:37:17.924547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.924337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 13:37:17.924547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.924360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-s9mp9\"" Jul 24 13:37:17.930123 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.929694 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 13:37:17.957948 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.957861 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56"] Jul 24 13:37:17.996687 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:17.996593 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:18.017302 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.017053 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hk7gd"] Jul 24 13:37:18.020704 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.020589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.030195 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.029601 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7tl9m\"" Jul 24 13:37:18.030195 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.029601 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 13:37:18.030195 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.029650 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 13:37:18.040863 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.040839 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 13:37:18.088374 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.088329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.088374 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.088377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.088614 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.088407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.088614 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.088474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-226wx\" (UniqueName: \"kubernetes.io/projected/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-kube-api-access-226wx\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.188910 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.188867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.189105 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.188918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-metrics-client-ca\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.189105 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.188946 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-root\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.189105 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-wtmp\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.189105 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.189391 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-sys\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.189391 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.189391 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpt8j\" (UniqueName: \"kubernetes.io/projected/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-kube-api-access-hpt8j\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.190150 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189668 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.190150 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189735 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-textfile\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.190150 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-226wx\" (UniqueName: \"kubernetes.io/projected/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-kube-api-access-226wx\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.190150 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-tls\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.190150 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.189842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.190150 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.190047 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.192590 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.192542 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.194778 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.194738 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.210893 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.210841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-226wx\" (UniqueName: \"kubernetes.io/projected/aeb919a7-9cf3-43b4-87a9-3fbb6306cc80-kube-api-access-226wx\") pod \"openshift-state-metrics-b8f49f5c6-htf56\" (UID: \"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.216947 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.216917 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:18.234043 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.234010 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291101 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-tls\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291182 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291222 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-metrics-client-ca\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-root\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-wtmp\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-sys\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpt8j\" (UniqueName: \"kubernetes.io/projected/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-kube-api-access-hpt8j\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-textfile\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.292068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.291777 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-textfile\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.294398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.292814 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-sys\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.294398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.292945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-wtmp\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.294398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.293985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-accelerators-collector-config\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.294398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.294344 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-root\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.294398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.294378 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-metrics-client-ca\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.297984 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.297917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-tls\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.301536 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.301510 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.328397 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.325705 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpt8j\" (UniqueName: \"kubernetes.io/projected/bef55f5c-fb94-4765-8d8b-1bb48527d0d7-kube-api-access-hpt8j\") pod \"node-exporter-hk7gd\" (UID: \"bef55f5c-fb94-4765-8d8b-1bb48527d0d7\") " pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.336686 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.336430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hk7gd" Jul 24 13:37:18.449673 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.449589 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56"] Jul 24 13:37:18.652916 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.652832 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:18.810190 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.810152 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:18.963030 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:18.962947 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:19.093796 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:19.093762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:19.243129 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:19.243096 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cvl5r" Jul 24 13:37:19.346050 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:19.346017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:19.508830 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:19.508745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:19.705064 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:19.705034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:20.015982 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:20.015951 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:20.296329 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:20.296209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:21.176637 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:21.176604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:21.294141 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:21.294109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:21.799869 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:21.799838 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb919a7_9cf3_43b4_87a9_3fbb6306cc80.slice/crio-0d2100f15a318e3bedd958b5e4cf28f34612d016d0294f1f8a3d7508e8826c28 WatchSource:0}: Error finding container 0d2100f15a318e3bedd958b5e4cf28f34612d016d0294f1f8a3d7508e8826c28: Status 404 returned error can't find the container with id 0d2100f15a318e3bedd958b5e4cf28f34612d016d0294f1f8a3d7508e8826c28 Jul 24 13:37:21.874394 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:21.874361 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.153968 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.153883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.258735 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.258701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.368925 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.368899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" event={"ID":"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80","Type":"ContainerStarted","Data":"0d2100f15a318e3bedd958b5e4cf28f34612d016d0294f1f8a3d7508e8826c28"} Jul 24 13:37:22.392069 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.392034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.419768 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:22.419738 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef55f5c_fb94_4765_8d8b_1bb48527d0d7.slice/crio-17737d3723c8e71947d4174d09edd90ef1a8622fc3931fd471d7286def0359d9 WatchSource:0}: Error finding container 17737d3723c8e71947d4174d09edd90ef1a8622fc3931fd471d7286def0359d9: Status 404 returned error can't find the container with id 17737d3723c8e71947d4174d09edd90ef1a8622fc3931fd471d7286def0359d9 Jul 24 13:37:22.516038 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.516009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.720460 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.720423 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.837456 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.837421 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:22.938359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:22.938262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:23.353677 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.353640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:23.378221 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.378177 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xjvvp" event={"ID":"82a271ff-6fcc-456e-97e2-d468b389c333","Type":"ContainerStarted","Data":"a0516ad5ed04798924466b96ce5932156c2f24f46e8af94c29f4a16a964f4083"} Jul 24 13:37:23.380696 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.380666 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gf8d" event={"ID":"66d35e6c-6cab-41ff-8299-62800a776bbf","Type":"ContainerStarted","Data":"f5e49e4415617fc88aa2cab707e1ec5b1376f46a7bc728681792ac9a0e004639"} Jul 24 13:37:23.380851 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.380717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5gf8d" event={"ID":"66d35e6c-6cab-41ff-8299-62800a776bbf","Type":"ContainerStarted","Data":"3a0f84bdad0cf8afc2cecef43dbe0a2a6645415cbea7be8d16913eeb4cb5e720"} Jul 24 13:37:23.380851 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.380784 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5gf8d" Jul 24 13:37:23.382660 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.382637 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d96c9d5b4-t2598" event={"ID":"4e30bbf2-88a8-4ae1-b871-1ff914af8be7","Type":"ContainerStarted","Data":"57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9"} Jul 24 13:37:23.384534 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.384495 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" event={"ID":"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80","Type":"ContainerStarted","Data":"620cd1ed055c3985e8f1d6749b8fc9285cab69422123d207419a1fe7b11353b0"} Jul 24 13:37:23.384635 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.384563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" event={"ID":"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80","Type":"ContainerStarted","Data":"dcba656972212ac2e11aef4941f41d44acede7f0fb3f5c82984e19d49745af3a"} Jul 24 13:37:23.386002 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.385982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hk7gd" event={"ID":"bef55f5c-fb94-4765-8d8b-1bb48527d0d7","Type":"ContainerStarted","Data":"17737d3723c8e71947d4174d09edd90ef1a8622fc3931fd471d7286def0359d9"} Jul 24 13:37:23.405522 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.405439 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xjvvp" podStartSLOduration=34.04306901 podStartE2EDuration="48.405419447s" totalImagesPullingTime="14.362350437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:36:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:23.403696097 +0000 UTC m=+106.989299154" watchObservedRunningTime="2026-07-24 13:37:23.405419447 +0000 UTC m=+106.991022499" Jul 24 13:37:23.409634 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.409605 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d96c9d5b4-t2598"] Jul 24 13:37:23.434062 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.434009 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d96c9d5b4-t2598" podStartSLOduration=2.375935223 podStartE2EDuration="8.433989481s" totalImagesPullingTime="6.058054258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:23.432151222 +0000 UTC m=+107.017754275" watchObservedRunningTime="2026-07-24 13:37:23.433989481 +0000 UTC m=+107.019592536" Jul 24 13:37:23.463748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.463693 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5gf8d" podStartSLOduration=66.063543004 podStartE2EDuration="1m11.463673464s" totalImagesPullingTime="5.40013046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:23.462987993 +0000 UTC m=+107.048591045" watchObservedRunningTime="2026-07-24 13:37:23.463673464 +0000 UTC m=+107.049276516" Jul 24 13:37:23.467157 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:23.467124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:24.391846 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.391813 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" event={"ID":"aeb919a7-9cf3-43b4-87a9-3fbb6306cc80","Type":"ContainerStarted","Data":"0dba05bbc36cd408f570504c8f7a9d04f2a44e40b647ddf1aecce829655cc261"} Jul 24 13:37:24.393351 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.393323 2579 generic.go:356] "Generic (PLEG): container finished" podID="bef55f5c-fb94-4765-8d8b-1bb48527d0d7" containerID="6a1fb1cc0add55079cdcffa91f5068af56728dc3df06e700a8d006546a92b088" exitCode=0 Jul 24 13:37:24.393486 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.393387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hk7gd" event={"ID":"bef55f5c-fb94-4765-8d8b-1bb48527d0d7","Type":"ContainerDied","Data":"6a1fb1cc0add55079cdcffa91f5068af56728dc3df06e700a8d006546a92b088"} Jul 24 13:37:24.504774 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.504723 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-htf56" podStartSLOduration=6.404589632 podStartE2EDuration="7.504702619s" totalImagesPullingTime="1.100112987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:24.503050246 +0000 UTC m=+108.088653299" watchObservedRunningTime="2026-07-24 13:37:24.504702619 +0000 UTC m=+108.090305672" Jul 24 13:37:24.756083 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.756049 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:37:24.758681 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.758652 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.758681 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.758673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:24.761815 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.761792 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 13:37:24.767131 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.767114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 13:37:24.767131 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.767114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 13:37:24.767340 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.767284 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 13:37:24.767382 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.767371 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 13:37:24.767416 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.767388 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 13:37:24.768210 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 13:37:24.768312 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768208 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 13:37:24.768312 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768241 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 13:37:24.768426 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768328 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g8s8q\"" Jul 24 13:37:24.768426 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768364 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 13:37:24.768426 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768414 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 13:37:24.768767 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768752 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bebfsep115nlm\"" Jul 24 13:37:24.768838 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.768789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 13:37:24.771576 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.771559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 13:37:24.774786 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.774493 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 13:37:24.781830 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.781804 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 13:37:24.792863 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.792843 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:37:24.851665 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851665 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851852 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851852 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851779 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851852 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851949 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851949 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851949 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.851949 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.851941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852033 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xttlb\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-kube-api-access-xttlb\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852162 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852162 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852162 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852162 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.852359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.852319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953518 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953518 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xttlb\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-kube-api-access-xttlb\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953683 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.953758 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953808 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953831 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.953991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954172 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.954016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.954649 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.954619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.956649 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.956621 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.956947 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.956913 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.956947 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.956936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.957130 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.957105 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.957235 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.957215 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.957329 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.957256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.957329 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.957309 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.957589 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.957561 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.957771 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.957749 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.958121 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.958097 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.958423 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.958398 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.958531 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.958511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.958927 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.958903 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.959403 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.959379 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.959488 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.959442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.959744 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.959721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.959822 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.959803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.959870 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.959854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:24.963693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:24.963675 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xttlb\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-kube-api-access-xttlb\") pod \"prometheus-k8s-0\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:25.067110 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:25.067031 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:25.217909 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:25.217884 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:37:25.220376 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:25.220345 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4a0ae0_f7d6_4939_95c2_05f0540ce2a5.slice/crio-e88d173f4dae29cc92cc92f6db55e50680a98e0547f148fab4dfe0914b3aa53f WatchSource:0}: Error finding container e88d173f4dae29cc92cc92f6db55e50680a98e0547f148fab4dfe0914b3aa53f: Status 404 returned error can't find the container with id e88d173f4dae29cc92cc92f6db55e50680a98e0547f148fab4dfe0914b3aa53f Jul 24 13:37:25.399693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:25.399599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hk7gd" event={"ID":"bef55f5c-fb94-4765-8d8b-1bb48527d0d7","Type":"ContainerStarted","Data":"e93ed3d4380019172f52a397a15ac4cc6e2b375a027388c6d8aba59e9fd6fe10"} Jul 24 13:37:25.399693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:25.399664 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hk7gd" event={"ID":"bef55f5c-fb94-4765-8d8b-1bb48527d0d7","Type":"ContainerStarted","Data":"75b8133d306715a9593287b2b5c3c01daa8216153f5f45f04d0c541eb6da59bf"} Jul 24 13:37:25.400979 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:25.400956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"e88d173f4dae29cc92cc92f6db55e50680a98e0547f148fab4dfe0914b3aa53f"} Jul 24 13:37:25.432541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:25.432486 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hk7gd" podStartSLOduration=7.025347908 podStartE2EDuration="8.432469472s" totalImagesPullingTime="1.341113577s" totalInitContainerRuntime="66.007987ms" isStatefulPod=true podCreationTimestamp="2026-07-24 13:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:25.431708412 +0000 UTC m=+109.017311465" watchObservedRunningTime="2026-07-24 13:37:25.432469472 +0000 UTC m=+109.018072525" Jul 24 13:37:26.076629 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:26.076331 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:26.405716 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:26.405634 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" exitCode=0 Jul 24 13:37:26.406055 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:26.405718 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} Jul 24 13:37:28.641501 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:28.641463 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:28.776992 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:28.776959 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:28.905956 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:28.905869 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:29.420088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:29.418891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} Jul 24 13:37:30.424467 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:30.424429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} Jul 24 13:37:31.431724 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:31.431634 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} Jul 24 13:37:31.432147 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:31.431729 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} Jul 24 13:37:31.432147 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:31.431755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} Jul 24 13:37:31.432147 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:31.431779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerStarted","Data":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} Jul 24 13:37:31.475569 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:31.475519 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.129504768 podStartE2EDuration="7.475503643s" totalImagesPullingTime="5.327861414s" totalInitContainerRuntime="18.137461ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:37:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:31.469946944 +0000 UTC m=+115.055549995" watchObservedRunningTime="2026-07-24 13:37:31.475503643 +0000 UTC m=+115.061106696" Jul 24 13:37:33.396117 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:33.396090 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5gf8d" Jul 24 13:37:34.912501 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:34.912457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:35.017309 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:35.017263 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:35.067458 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:35.067419 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:37:35.243602 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:35.243575 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:35.353897 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:35.353857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:36.338886 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:36.338856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:36.499671 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:36.499641 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:37.699455 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:37.699425 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:37.792506 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:37.792466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:45.764376 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:45.764341 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:45.849170 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:45.849138 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:46.635974 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:46.635936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:37:46.638268 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:46.638249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65a8a998-e460-4249-9fb2-a15d80a3cd80-metrics-certs\") pod \"network-metrics-daemon-94n97\" (UID: \"65a8a998-e460-4249-9fb2-a15d80a3cd80\") " pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:37:46.711088 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:46.711055 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:46.819646 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:46.819610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:46.911431 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:46.911365 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w8pjz\"" Jul 24 13:37:46.919389 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:46.919369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-94n97" Jul 24 13:37:47.247642 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:47.247606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-94n97"] Jul 24 13:37:47.248129 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:37:47.248096 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a8a998_e460_4249_9fb2_a15d80a3cd80.slice/crio-cbf0590a6f40ec96fb6965fe79cdf0514ac143e7f96fa4dfd3637106e9f60e58 WatchSource:0}: Error finding container cbf0590a6f40ec96fb6965fe79cdf0514ac143e7f96fa4dfd3637106e9f60e58: Status 404 returned error can't find the container with id cbf0590a6f40ec96fb6965fe79cdf0514ac143e7f96fa4dfd3637106e9f60e58 Jul 24 13:37:47.487767 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:47.487730 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94n97" event={"ID":"65a8a998-e460-4249-9fb2-a15d80a3cd80","Type":"ContainerStarted","Data":"cbf0590a6f40ec96fb6965fe79cdf0514ac143e7f96fa4dfd3637106e9f60e58"} Jul 24 13:37:49.496741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:49.496706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94n97" event={"ID":"65a8a998-e460-4249-9fb2-a15d80a3cd80","Type":"ContainerStarted","Data":"15b61b3c6facc3d4e2fcb2c3bbfccd17bd750d4e7840d7ef4de4f628e912ff98"} Jul 24 13:37:49.497213 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:49.496767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-94n97" event={"ID":"65a8a998-e460-4249-9fb2-a15d80a3cd80","Type":"ContainerStarted","Data":"d32c69616e7505653a2347d88afc86864edd1e60395b05e43d3a199fd09b4789"} Jul 24 13:37:49.523874 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:49.523813 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-94n97" podStartSLOduration=131.111780224 podStartE2EDuration="2m12.523797642s" totalImagesPullingTime="1.412017418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:37:49.52306754 +0000 UTC m=+133.108670592" watchObservedRunningTime="2026-07-24 13:37:49.523797642 +0000 UTC m=+133.109400739" Jul 24 13:37:49.671673 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:49.671636 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:49.815754 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:49.815670 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:50.419508 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.419464 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d96c9d5b4-t2598" podUID="4e30bbf2-88a8-4ae1-b871-1ff914af8be7" containerName="console" containerID="cri-o://57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9" gracePeriod=15 Jul 24 13:37:50.501875 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.501846 2579 generic.go:356] "Generic (PLEG): container finished" podID="a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b" containerID="59a306238c30a2b81a088037082afaddc4de8d7db527c61a3825e7ec8c7205a8" exitCode=0 Jul 24 13:37:50.502225 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.501921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" event={"ID":"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b","Type":"ContainerDied","Data":"59a306238c30a2b81a088037082afaddc4de8d7db527c61a3825e7ec8c7205a8"} Jul 24 13:37:50.502428 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.502414 2579 scope.go:117] "RemoveContainer" containerID="59a306238c30a2b81a088037082afaddc4de8d7db527c61a3825e7ec8c7205a8" Jul 24 13:37:50.717665 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.717630 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:50.772753 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.772717 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-serving-cert\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.772946 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.772765 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-trusted-ca-bundle\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.772946 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.772796 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf5vt\" (UniqueName: \"kubernetes.io/projected/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-kube-api-access-tf5vt\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.773077 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.772969 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-config\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.773077 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773037 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-oauth-serving-cert\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.773077 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773066 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-oauth-config\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.773220 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773156 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-service-ca\") pod \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\" (UID: \"4e30bbf2-88a8-4ae1-b871-1ff914af8be7\") " Jul 24 13:37:50.773296 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773236 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:37:50.773355 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773300 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-config" (OuterVolumeSpecName: "console-config") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:37:50.773498 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773454 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-trusted-ca-bundle\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:50.773498 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773476 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-config\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:50.773619 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773485 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:37:50.773619 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.773514 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:37:50.775081 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.775051 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-kube-api-access-tf5vt" (OuterVolumeSpecName: "kube-api-access-tf5vt") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "kube-api-access-tf5vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:37:50.775081 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.775070 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:37:50.775221 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.775087 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4e30bbf2-88a8-4ae1-b871-1ff914af8be7" (UID: "4e30bbf2-88a8-4ae1-b871-1ff914af8be7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:37:50.874657 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.874626 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-service-ca\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:50.874657 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.874655 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-serving-cert\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:50.874871 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.874665 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf5vt\" (UniqueName: \"kubernetes.io/projected/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-kube-api-access-tf5vt\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:50.874871 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.874675 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-oauth-serving-cert\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:50.874871 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:50.874683 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4e30bbf2-88a8-4ae1-b871-1ff914af8be7-console-oauth-config\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:37:51.268402 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.268373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:51.362343 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.362310 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:37:51.506346 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.506316 2579 generic.go:356] "Generic (PLEG): container finished" podID="4e30bbf2-88a8-4ae1-b871-1ff914af8be7" containerID="57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9" exitCode=0 Jul 24 13:37:51.506828 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.506365 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d96c9d5b4-t2598" Jul 24 13:37:51.506828 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.506396 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d96c9d5b4-t2598" event={"ID":"4e30bbf2-88a8-4ae1-b871-1ff914af8be7","Type":"ContainerDied","Data":"57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9"} Jul 24 13:37:51.506828 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.506455 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d96c9d5b4-t2598" event={"ID":"4e30bbf2-88a8-4ae1-b871-1ff914af8be7","Type":"ContainerDied","Data":"ac52c8e96da8e21328ec3f6b48c9ae11680004322a9fc08227f339ba301738d4"} Jul 24 13:37:51.506828 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.506502 2579 scope.go:117] "RemoveContainer" containerID="57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9" Jul 24 13:37:51.508398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.508376 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-64cht" event={"ID":"a4a3a91c-c1fd-41b3-bb6b-99cd84b3123b","Type":"ContainerStarted","Data":"afd8ddf746d5bdfb0d881523562231be990e0ab55fcfa49b5fc90b52298ba27c"} Jul 24 13:37:51.516055 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.516028 2579 scope.go:117] "RemoveContainer" containerID="57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9" Jul 24 13:37:51.516366 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:37:51.516344 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9\": container with ID starting with 57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9 not found: ID does not exist" containerID="57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9" Jul 24 13:37:51.516460 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.516374 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9"} err="failed to get container status \"57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9\": rpc error: code = NotFound desc = could not find container \"57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9\": container with ID starting with 57082c5f80050cc92f80ed4edd153f3b9af2311352d8179ba8d7139db41311d9 not found: ID does not exist" Jul 24 13:37:51.549872 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.549768 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d96c9d5b4-t2598"] Jul 24 13:37:51.559072 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:51.559041 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d96c9d5b4-t2598"] Jul 24 13:37:52.894242 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:37:52.894208 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e30bbf2-88a8-4ae1-b871-1ff914af8be7" path="/var/lib/kubelet/pods/4e30bbf2-88a8-4ae1-b871-1ff914af8be7/volumes" Jul 24 13:38:00.540902 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:00.540871 2579 generic.go:356] "Generic (PLEG): container finished" podID="fa5e0d2f-290e-48ec-9d19-1aed1244e8b2" containerID="176ae48a9536011efedb3d5cf6d9beed69b2f3f2f8f512be90c2d45d5235d8d6" exitCode=0 Jul 24 13:38:00.541304 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:00.540948 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" event={"ID":"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2","Type":"ContainerDied","Data":"176ae48a9536011efedb3d5cf6d9beed69b2f3f2f8f512be90c2d45d5235d8d6"} Jul 24 13:38:00.541375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:00.541359 2579 scope.go:117] "RemoveContainer" containerID="176ae48a9536011efedb3d5cf6d9beed69b2f3f2f8f512be90c2d45d5235d8d6" Jul 24 13:38:01.546465 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:01.546432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9bqn9" event={"ID":"fa5e0d2f-290e-48ec-9d19-1aed1244e8b2","Type":"ContainerStarted","Data":"fbfc7f9822081134eed64df4203ae5b5d7cfcd972974236c03d6d4da9f84d0ec"} Jul 24 13:38:06.223074 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:06.223034 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:06.302117 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:06.302091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:15.679419 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:15.679386 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:15.771487 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:15.771456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:25.067689 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:25.067649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:25.083024 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:25.082997 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:25.650868 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:25.650842 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:37.552376 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:37.552342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:37.844255 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:37.844173 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:42.953783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.953747 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:38:42.954190 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.954157 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="prometheus" containerID="cri-o://a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" gracePeriod=600 Jul 24 13:38:42.954262 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.954176 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-web" containerID="cri-o://a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" gracePeriod=600 Jul 24 13:38:42.954262 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.954203 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy" containerID="cri-o://c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" gracePeriod=600 Jul 24 13:38:42.954399 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.954175 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="config-reloader" containerID="cri-o://3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" gracePeriod=600 Jul 24 13:38:42.954399 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.954176 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="thanos-sidecar" containerID="cri-o://0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" gracePeriod=600 Jul 24 13:38:42.954399 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:42.954294 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" gracePeriod=600 Jul 24 13:38:43.207508 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.207453 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.393857 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.393824 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-tls-assets\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.393857 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.393856 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xttlb\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-kube-api-access-xttlb\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394099 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.393876 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-1\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394099 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.393911 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394099 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394039 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-metrics-client-certs\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394099 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394089 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-trusted-ca-bundle\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394118 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-thanos-prometheus-http-client-file\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394165 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394193 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-kube-rbac-proxy\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394233 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-db\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394260 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-metrics-client-ca\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394254 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394341 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-web-config\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394424 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config-out\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394452 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-tls\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394480 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-grpc-tls\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394489 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394508 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-serving-certs-ca-bundle\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394539 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394580 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-0\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394611 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-2\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.394741 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394635 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-kubelet-serving-ca-bundle\") pod \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\" (UID: \"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5\") " Jul 24 13:38:43.395608 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394874 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.395608 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.394890 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.395608 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.395237 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.396862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.396833 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config" (OuterVolumeSpecName: "config") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.397110 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.397079 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:38:43.397110 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.397094 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-kube-api-access-xttlb" (OuterVolumeSpecName: "kube-api-access-xttlb") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "kube-api-access-xttlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:38:43.397230 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.397106 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.397964 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.397386 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.397964 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.397417 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.397964 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.397729 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.398777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.398125 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.398777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.398376 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.398777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.398491 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:38:43.398777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.398515 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.398971 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.398887 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.399039 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.399016 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:38:43.399241 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.399220 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config-out" (OuterVolumeSpecName: "config-out") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:38:43.399555 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.399531 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.400023 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.399999 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.406784 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.406757 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-web-config" (OuterVolumeSpecName: "web-config") pod "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" (UID: "ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:38:43.495802 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495774 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-db\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495802 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495802 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-metrics-client-ca\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495812 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-web-config\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495821 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config-out\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495829 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495838 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-grpc-tls\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495846 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495855 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495863 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495871 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495881 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495889 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-tls-assets\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495897 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xttlb\" (UniqueName: \"kubernetes.io/projected/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-kube-api-access-xttlb\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495905 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-config\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495913 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-metrics-client-certs\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495922 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495931 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.495985 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.495940 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5-secret-kube-rbac-proxy\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:38:43.701171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701132 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" exitCode=0 Jul 24 13:38:43.701171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701158 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" exitCode=0 Jul 24 13:38:43.701171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701165 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" exitCode=0 Jul 24 13:38:43.701171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701171 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" exitCode=0 Jul 24 13:38:43.701171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701176 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" exitCode=0 Jul 24 13:38:43.701171 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701181 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" exitCode=0 Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701212 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701216 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701309 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701382 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} Jul 24 13:38:43.701493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} Jul 24 13:38:43.701804 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.701530 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5","Type":"ContainerDied","Data":"e88d173f4dae29cc92cc92f6db55e50680a98e0547f148fab4dfe0914b3aa53f"} Jul 24 13:38:43.709157 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.709051 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.716011 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.715992 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.722687 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.722670 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.728880 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.728866 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.735086 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.735069 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.737358 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.737340 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:38:43.742326 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.742304 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.744339 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.744323 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:38:43.748989 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.748972 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.749242 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.749217 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.749306 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749243 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} err="failed to get container status \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" Jul 24 13:38:43.749306 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749260 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.749507 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.749491 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.749547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749512 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} err="failed to get container status \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" Jul 24 13:38:43.749547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749527 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.749717 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.749702 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.749755 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749721 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} err="failed to get container status \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" Jul 24 13:38:43.749755 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749734 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.749925 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.749911 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.749963 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749929 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} err="failed to get container status \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" Jul 24 13:38:43.749963 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.749941 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.750115 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.750101 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.750155 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750118 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} err="failed to get container status \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" Jul 24 13:38:43.750155 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750129 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.750336 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.750318 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.750387 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750344 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} err="failed to get container status \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" Jul 24 13:38:43.750387 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750365 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.750578 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:38:43.750563 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.750617 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750580 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} err="failed to get container status \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" Jul 24 13:38:43.750617 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750591 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.750781 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750761 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} err="failed to get container status \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" Jul 24 13:38:43.750848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750784 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.750980 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750965 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} err="failed to get container status \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" Jul 24 13:38:43.751027 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.750981 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.751149 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751135 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} err="failed to get container status \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" Jul 24 13:38:43.751199 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751149 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.751362 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751345 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} err="failed to get container status \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" Jul 24 13:38:43.751440 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751364 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.751540 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751524 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} err="failed to get container status \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" Jul 24 13:38:43.751583 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751542 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.751749 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751731 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} err="failed to get container status \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" Jul 24 13:38:43.751790 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751750 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.751967 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751949 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} err="failed to get container status \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" Jul 24 13:38:43.752031 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.751968 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.752189 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752170 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} err="failed to get container status \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" Jul 24 13:38:43.752228 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752189 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.752405 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752384 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} err="failed to get container status \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" Jul 24 13:38:43.752457 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752408 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.752614 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752597 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} err="failed to get container status \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" Jul 24 13:38:43.752683 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752616 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.752824 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752808 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} err="failed to get container status \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" Jul 24 13:38:43.752890 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.752825 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.753028 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753009 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} err="failed to get container status \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" Jul 24 13:38:43.753069 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753029 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.753208 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753192 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} err="failed to get container status \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" Jul 24 13:38:43.753266 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753209 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.753431 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753416 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} err="failed to get container status \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" Jul 24 13:38:43.753478 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753431 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.753638 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753620 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} err="failed to get container status \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" Jul 24 13:38:43.753676 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753638 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.753838 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753821 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} err="failed to get container status \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" Jul 24 13:38:43.753896 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.753839 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.754068 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754053 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} err="failed to get container status \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" Jul 24 13:38:43.754113 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754068 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.754264 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754247 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} err="failed to get container status \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" Jul 24 13:38:43.754324 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754264 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.754496 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754478 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} err="failed to get container status \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" Jul 24 13:38:43.754555 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754497 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.754686 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754668 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} err="failed to get container status \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" Jul 24 13:38:43.754736 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754689 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.754852 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754839 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} err="failed to get container status \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" Jul 24 13:38:43.754895 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754852 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.755015 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.754995 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} err="failed to get container status \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" Jul 24 13:38:43.755015 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755008 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.755191 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755175 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} err="failed to get container status \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" Jul 24 13:38:43.755228 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755193 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.755414 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755398 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} err="failed to get container status \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" Jul 24 13:38:43.755457 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755415 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.755630 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755614 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} err="failed to get container status \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" Jul 24 13:38:43.755668 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755631 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.755843 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755820 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} err="failed to get container status \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" Jul 24 13:38:43.755843 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.755840 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.756044 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756028 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} err="failed to get container status \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" Jul 24 13:38:43.756097 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756045 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.756199 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756182 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} err="failed to get container status \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" Jul 24 13:38:43.756254 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756200 2579 scope.go:117] "RemoveContainer" containerID="bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7" Jul 24 13:38:43.756387 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756371 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7"} err="failed to get container status \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": rpc error: code = NotFound desc = could not find container \"bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7\": container with ID starting with bfa0e9d9511fc42aa07ddbca75c1b37db341e76194a8181f577c86ef6e4b24d7 not found: ID does not exist" Jul 24 13:38:43.756445 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756386 2579 scope.go:117] "RemoveContainer" containerID="c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d" Jul 24 13:38:43.756564 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756549 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d"} err="failed to get container status \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": rpc error: code = NotFound desc = could not find container \"c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d\": container with ID starting with c5aa3538c87567bf76d105bd7a3a0c6ede65860bd943cf185d2bdc2b3d39733d not found: ID does not exist" Jul 24 13:38:43.756617 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756564 2579 scope.go:117] "RemoveContainer" containerID="a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b" Jul 24 13:38:43.756745 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756726 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b"} err="failed to get container status \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": rpc error: code = NotFound desc = could not find container \"a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b\": container with ID starting with a9c63c88d48adb969690fb851973273616be648f03d4f5753aa075debc6ed18b not found: ID does not exist" Jul 24 13:38:43.756813 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756746 2579 scope.go:117] "RemoveContainer" containerID="0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106" Jul 24 13:38:43.756938 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756923 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106"} err="failed to get container status \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": rpc error: code = NotFound desc = could not find container \"0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106\": container with ID starting with 0f885af51df0679315bda40362e7c612d2e71166a581fc473eaeb9a10fa69106 not found: ID does not exist" Jul 24 13:38:43.756986 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.756938 2579 scope.go:117] "RemoveContainer" containerID="3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066" Jul 24 13:38:43.757166 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.757111 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066"} err="failed to get container status \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": rpc error: code = NotFound desc = could not find container \"3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066\": container with ID starting with 3d02cd10c11ca665e3ed9b066f6c1dab19ea14bb2311f20a6678f9adc4191066 not found: ID does not exist" Jul 24 13:38:43.757208 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.757175 2579 scope.go:117] "RemoveContainer" containerID="a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c" Jul 24 13:38:43.757429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.757408 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c"} err="failed to get container status \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": rpc error: code = NotFound desc = could not find container \"a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c\": container with ID starting with a5e293b53045f5e5e5c9b816f5255ca4db572d579433c59d648b0fa845834f8c not found: ID does not exist" Jul 24 13:38:43.757429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.757428 2579 scope.go:117] "RemoveContainer" containerID="d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d" Jul 24 13:38:43.757622 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.757604 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d"} err="failed to get container status \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": rpc error: code = NotFound desc = could not find container \"d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d\": container with ID starting with d481a5f9169309706f7924a04f65cf28799946914d29f1483ff2a619b9f15d6d not found: ID does not exist" Jul 24 13:38:43.788186 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788160 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:38:43.788437 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788424 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e30bbf2-88a8-4ae1-b871-1ff914af8be7" containerName="console" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788438 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e30bbf2-88a8-4ae1-b871-1ff914af8be7" containerName="console" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788448 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-thanos" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788454 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-thanos" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788460 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-web" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788466 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-web" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788474 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="thanos-sidecar" Jul 24 13:38:43.788483 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788479 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="thanos-sidecar" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788488 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="init-config-reloader" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788494 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="init-config-reloader" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788517 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788522 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788529 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="prometheus" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788533 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="prometheus" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788539 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="config-reloader" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788543 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="config-reloader" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788583 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="prometheus" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788590 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="config-reloader" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788596 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="thanos-sidecar" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788601 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788607 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e30bbf2-88a8-4ae1-b871-1ff914af8be7" containerName="console" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788611 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-web" Jul 24 13:38:43.788693 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.788617 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" containerName="kube-rbac-proxy-thanos" Jul 24 13:38:43.793796 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.793782 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.796612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.796585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 24 13:38:43.796612 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.796585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 24 13:38:43.796781 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.796616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 24 13:38:43.796781 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.796688 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 24 13:38:43.796875 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.796836 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 24 13:38:43.797120 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bebfsep115nlm\"" Jul 24 13:38:43.797228 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797131 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 13:38:43.797360 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797345 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 24 13:38:43.797479 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797467 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 24 13:38:43.797590 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 24 13:38:43.797879 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.797931 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.797931 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.797931 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad916930-391a-4f7b-9b01-13d33fdfa356-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798094 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.797981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798094 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798094 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad916930-391a-4f7b-9b01-13d33fdfa356-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798094 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798058 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798219 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798305 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798305 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798305 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-config\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798459 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798507 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798535 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qzg6\" (UniqueName: \"kubernetes.io/projected/ad916930-391a-4f7b-9b01-13d33fdfa356-kube-api-access-6qzg6\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798561 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.798776 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.798631 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 24 13:38:43.799321 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.799297 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 24 13:38:43.799416 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.799328 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 24 13:38:43.799416 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.799340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 24 13:38:43.799616 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.799596 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-g8s8q\"" Jul 24 13:38:43.802598 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.802580 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 24 13:38:43.804385 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.804370 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 24 13:38:43.809785 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.809768 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:38:43.899229 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899601 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899601 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-config\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899601 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899752 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899752 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899752 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899752 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899717 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qzg6\" (UniqueName: \"kubernetes.io/projected/ad916930-391a-4f7b-9b01-13d33fdfa356-kube-api-access-6qzg6\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899795 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad916930-391a-4f7b-9b01-13d33fdfa356-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.899940 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.900265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad916930-391a-4f7b-9b01-13d33fdfa356-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.900265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899964 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.900265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.899989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.900265 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.900029 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.900515 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.900392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.900907 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.900600 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.901596 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.901560 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.902678 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.902654 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.902870 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.902847 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.902960 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.902945 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.903347 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.903322 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.903347 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.903339 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-config\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.903597 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.903565 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.903674 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.903655 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.903963 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.903939 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ad916930-391a-4f7b-9b01-13d33fdfa356-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.904042 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.903974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ad916930-391a-4f7b-9b01-13d33fdfa356-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.904446 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.904426 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.905187 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.905162 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.905232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.905215 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.905499 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.905482 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ad916930-391a-4f7b-9b01-13d33fdfa356-web-config\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.905547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.905531 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ad916930-391a-4f7b-9b01-13d33fdfa356-config-out\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:43.910353 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:43.910334 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qzg6\" (UniqueName: \"kubernetes.io/projected/ad916930-391a-4f7b-9b01-13d33fdfa356-kube-api-access-6qzg6\") pod \"prometheus-k8s-0\" (UID: \"ad916930-391a-4f7b-9b01-13d33fdfa356\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:44.103031 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:44.102944 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:44.246240 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:44.246218 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 24 13:38:44.248479 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:38:44.248451 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad916930_391a_4f7b_9b01_13d33fdfa356.slice/crio-a83f9c9ad3b968c780f139605cc4b2b7e80403c973ffc4109e5a8c0824dc8c23 WatchSource:0}: Error finding container a83f9c9ad3b968c780f139605cc4b2b7e80403c973ffc4109e5a8c0824dc8c23: Status 404 returned error can't find the container with id a83f9c9ad3b968c780f139605cc4b2b7e80403c973ffc4109e5a8c0824dc8c23 Jul 24 13:38:44.706529 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:44.706498 2579 generic.go:356] "Generic (PLEG): container finished" podID="ad916930-391a-4f7b-9b01-13d33fdfa356" containerID="a0543a4b43e861aab1431c1ad8ef6cee04b4981c939d5d6ac8df11f5a7c9edd0" exitCode=0 Jul 24 13:38:44.706702 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:44.706582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerDied","Data":"a0543a4b43e861aab1431c1ad8ef6cee04b4981c939d5d6ac8df11f5a7c9edd0"} Jul 24 13:38:44.706702 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:44.706658 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"a83f9c9ad3b968c780f139605cc4b2b7e80403c973ffc4109e5a8c0824dc8c23"} Jul 24 13:38:44.905350 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:44.905316 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5" path="/var/lib/kubelet/pods/ee4a0ae0-f7d6-4939-95c2-05f0540ce2a5/volumes" Jul 24 13:38:45.714879 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.714848 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"00d7fbdfc79ae4779df9e5ec2dd1a68d3d6c35f1ab82708c1ff059bd45eccb6c"} Jul 24 13:38:45.715226 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.714907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"7ea8d6bb80b1cf9ca7612750da879edecd7c6f8c741e45caf3dde20354bae70d"} Jul 24 13:38:45.715226 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.714934 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"b98d8bf3a0ef1808549eaed68ca78a3ce462759d05c273b0f394a1b9515f7c9b"} Jul 24 13:38:45.715226 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.714983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"ffe5c9b62c9e921d6f3a213d424512df59d80d991d51af92a89c59581aa90ec1"} Jul 24 13:38:45.715226 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.715008 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"ed660c67a283d0e7cf60d5e0ca907d385b5f8e5dd509eaf8b1af52f723112f1c"} Jul 24 13:38:45.715226 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.715030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ad916930-391a-4f7b-9b01-13d33fdfa356","Type":"ContainerStarted","Data":"b3805135ec93c8fc8dce32797730500896f3c754adb55b6c6c10137e7969d65e"} Jul 24 13:38:45.750021 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:45.749952 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.731294894 podStartE2EDuration="2.749925192s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.630298ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:45.746571774 +0000 UTC m=+189.332174825" watchObservedRunningTime="2026-07-24 13:38:45.749925192 +0000 UTC m=+189.335528243" Jul 24 13:38:46.841019 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:46.840985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:46.920059 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:46.920029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:49.103126 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:49.103086 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:38:58.035876 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:58.035843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:58.137221 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:58.137194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:38:58.207214 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:38:58.207187 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:31.511994 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:31.511958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:31.573397 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:31.573363 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:42.853541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:42.853505 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:42.927080 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:42.927048 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:44.103430 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:44.103388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:39:44.118388 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:44.118364 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:39:44.945254 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:44.945227 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 24 13:39:48.280213 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:48.280179 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:52.880377 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:52.880344 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:53.054101 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:53.054064 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:56.316047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:56.316015 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:56.378203 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:56.378172 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:56.630864 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:56.630786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:56.731213 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:56.731185 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:57.430713 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:57.430680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:39:57.491293 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:39:57.491251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:04.854732 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:04.854653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:04.931018 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:04.930986 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:07.325363 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:07.325332 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:07.425255 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:07.425219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:07.545988 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:07.545958 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:17.806589 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:17.806547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:21.216290 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:21.216254 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:21.318694 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:21.318662 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:21.449615 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:21.449588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:24.197293 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:24.197240 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:24.395561 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:24.395532 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:36.795909 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:36.795880 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 13:40:42.584595 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:42.584561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:42.678002 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:42.677968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:42.744488 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:42.744448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:51.304037 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:51.304000 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:56.009027 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:56.008996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:40:56.106293 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:40:56.106255 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:23.158720 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:23.158688 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:24.773114 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:24.773074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:27.172677 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:27.172616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:27.251017 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:27.250984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:32.016125 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:32.016050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:32.087092 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:32.087059 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:33.679956 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:33.679929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:33.780116 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:33.780087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:36.084621 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:36.084590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:36.492234 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:36.492205 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:43.429236 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:43.429203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:45.835726 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.835692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m52xx"] Jul 24 13:41:45.838761 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.838745 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:45.842132 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.842114 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vfksn\"" Jul 24 13:41:45.842515 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.842491 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 13:41:45.843341 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.843326 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 13:41:45.850384 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.850365 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m52xx"] Jul 24 13:41:45.874111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.874072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8672b869-c568-44a8-b731-073ccb8749ab-bound-sa-token\") pod \"cert-manager-55b4d954d5-m52xx\" (UID: \"8672b869-c568-44a8-b731-073ccb8749ab\") " pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:45.874111 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.874126 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7hwq\" (UniqueName: \"kubernetes.io/projected/8672b869-c568-44a8-b731-073ccb8749ab-kube-api-access-k7hwq\") pod \"cert-manager-55b4d954d5-m52xx\" (UID: \"8672b869-c568-44a8-b731-073ccb8749ab\") " pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:45.975407 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.975367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8672b869-c568-44a8-b731-073ccb8749ab-bound-sa-token\") pod \"cert-manager-55b4d954d5-m52xx\" (UID: \"8672b869-c568-44a8-b731-073ccb8749ab\") " pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:45.975575 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.975419 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7hwq\" (UniqueName: \"kubernetes.io/projected/8672b869-c568-44a8-b731-073ccb8749ab-kube-api-access-k7hwq\") pod \"cert-manager-55b4d954d5-m52xx\" (UID: \"8672b869-c568-44a8-b731-073ccb8749ab\") " pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:45.986244 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.986216 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8672b869-c568-44a8-b731-073ccb8749ab-bound-sa-token\") pod \"cert-manager-55b4d954d5-m52xx\" (UID: \"8672b869-c568-44a8-b731-073ccb8749ab\") " pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:45.986411 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:45.986395 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7hwq\" (UniqueName: \"kubernetes.io/projected/8672b869-c568-44a8-b731-073ccb8749ab-kube-api-access-k7hwq\") pod \"cert-manager-55b4d954d5-m52xx\" (UID: \"8672b869-c568-44a8-b731-073ccb8749ab\") " pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:46.159677 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:46.159581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m52xx" Jul 24 13:41:46.285626 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:46.285603 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m52xx"] Jul 24 13:41:46.288072 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:41:46.288044 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8672b869_c568_44a8_b731_073ccb8749ab.slice/crio-8eb7433fc380bfc63e3c6e73fde1b1b854a9d93b2e1a10ad3bb582bef7a6d2d0 WatchSource:0}: Error finding container 8eb7433fc380bfc63e3c6e73fde1b1b854a9d93b2e1a10ad3bb582bef7a6d2d0: Status 404 returned error can't find the container with id 8eb7433fc380bfc63e3c6e73fde1b1b854a9d93b2e1a10ad3bb582bef7a6d2d0 Jul 24 13:41:46.289951 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:46.289936 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 13:41:46.347381 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:46.347340 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m52xx" event={"ID":"8672b869-c568-44a8-b731-073ccb8749ab","Type":"ContainerStarted","Data":"8eb7433fc380bfc63e3c6e73fde1b1b854a9d93b2e1a10ad3bb582bef7a6d2d0"} Jul 24 13:41:50.365429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:50.365387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m52xx" event={"ID":"8672b869-c568-44a8-b731-073ccb8749ab","Type":"ContainerStarted","Data":"6bf52ff7e3961530f9a4793db6e4ef52c523f501347c936848ed8f2c78eace18"} Jul 24 13:41:50.390736 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:50.390685 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m52xx" podStartSLOduration=2.3095576700000002 podStartE2EDuration="5.390668101s" totalImagesPullingTime="3.081110431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:41:50.389023546 +0000 UTC m=+373.974626597" watchObservedRunningTime="2026-07-24 13:41:50.390668101 +0000 UTC m=+373.976271153" Jul 24 13:41:50.608161 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:50.608131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:41:50.713429 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:41:50.713342 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:05.336299 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:05.336250 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:05.409225 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:05.409193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:05.997660 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:05.997626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:06.136493 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:06.136465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:11.961703 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:11.961660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:13.442811 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:13.442775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:19.829877 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:19.829848 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:42:19.935185 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:42:19.935146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:14.174463 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:14.174384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:14.269436 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:14.269405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:14.351215 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:14.351183 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:24.015014 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:24.014982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:24.104989 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:24.104955 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:47.811492 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:47.811459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:47.871930 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:47.871897 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:49.854495 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:49.852977 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:49.908047 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:49.908019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:57.134894 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:57.134863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:57.202136 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:57.202101 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:57.271297 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:57.271245 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:43:58.058343 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:43:58.058311 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:03.961963 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:03.961933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:08.330229 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:08.330169 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:08.431575 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:08.431545 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:08.533532 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:08.533506 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:08.632679 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:08.632602 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:08.935126 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:08.935057 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:09.032008 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:09.031976 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:11.217629 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.217593 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7"] Jul 24 13:44:11.220936 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.220916 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.223666 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.223646 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 13:44:11.224680 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.224630 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:11.224860 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.224842 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 13:44:11.224936 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.224858 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 24 13:44:11.224936 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.224894 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-wfpjf\"" Jul 24 13:44:11.225097 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.225084 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 24 13:44:11.233375 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.233358 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7"] Jul 24 13:44:11.310595 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.310565 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgr2f\" (UniqueName: \"kubernetes.io/projected/f3e2d76f-11cb-419b-aeda-14264a22563f-kube-api-access-fgr2f\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.310727 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.310631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f3e2d76f-11cb-419b-aeda-14264a22563f-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.310727 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.310669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3e2d76f-11cb-419b-aeda-14264a22563f-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.411220 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.411190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3e2d76f-11cb-419b-aeda-14264a22563f-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.411393 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.411236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgr2f\" (UniqueName: \"kubernetes.io/projected/f3e2d76f-11cb-419b-aeda-14264a22563f-kube-api-access-fgr2f\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.411393 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.411300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f3e2d76f-11cb-419b-aeda-14264a22563f-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.411938 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.411917 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f3e2d76f-11cb-419b-aeda-14264a22563f-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.413602 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.413583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3e2d76f-11cb-419b-aeda-14264a22563f-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.421062 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.421042 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgr2f\" (UniqueName: \"kubernetes.io/projected/f3e2d76f-11cb-419b-aeda-14264a22563f-kube-api-access-fgr2f\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.530318 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.530203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:11.654973 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.654946 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7"] Jul 24 13:44:11.657759 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:44:11.657731 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3e2d76f_11cb_419b_aeda_14264a22563f.slice/crio-3e951e9b79cf90586e6601e0bb358dde501a8fe07214d15c3a0550672a867c13 WatchSource:0}: Error finding container 3e951e9b79cf90586e6601e0bb358dde501a8fe07214d15c3a0550672a867c13: Status 404 returned error can't find the container with id 3e951e9b79cf90586e6601e0bb358dde501a8fe07214d15c3a0550672a867c13 Jul 24 13:44:11.852357 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.852255 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:11.865921 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:11.865895 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" event={"ID":"f3e2d76f-11cb-419b-aeda-14264a22563f","Type":"ContainerStarted","Data":"3e951e9b79cf90586e6601e0bb358dde501a8fe07214d15c3a0550672a867c13"} Jul 24 13:44:14.883296 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:14.883244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" event={"ID":"f3e2d76f-11cb-419b-aeda-14264a22563f","Type":"ContainerStarted","Data":"366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e"} Jul 24 13:44:14.883738 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:14.883381 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:14.902777 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:14.902728 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" podStartSLOduration=1.244636401 podStartE2EDuration="3.902711693s" totalImagesPullingTime="2.658075292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:14.901575927 +0000 UTC m=+518.487178981" watchObservedRunningTime="2026-07-24 13:44:14.902711693 +0000 UTC m=+518.488314744" Jul 24 13:44:14.910449 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:14.910418 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:44:30.894260 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:30.894188 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:44:33.002522 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:44:33.002487 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:16.981762 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:16.981707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.354407 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.354373 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.456563 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.456521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.479046 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.479013 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7"] Jul 24 13:45:46.479243 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.479219 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" podUID="f3e2d76f-11cb-419b-aeda-14264a22563f" containerName="manager" containerID="cri-o://366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e" gracePeriod=30 Jul 24 13:45:46.560058 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.560019 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.664853 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.664820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.731289 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.731253 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s8fbw/must-gather-z4xnh"] Jul 24 13:45:46.732771 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.732754 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:45:46.734222 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.734205 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:46.736910 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.736889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8fbw\"/\"kube-root-ca.crt\"" Jul 24 13:45:46.737005 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.736913 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s8fbw\"/\"openshift-service-ca.crt\"" Jul 24 13:45:46.737005 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.736970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s8fbw\"/\"default-dockercfg-vd2rp\"" Jul 24 13:45:46.748134 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.748107 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8fbw/must-gather-z4xnh"] Jul 24 13:45:46.751391 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.751362 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.821104 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.821074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:45:46.884500 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.884469 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgr2f\" (UniqueName: \"kubernetes.io/projected/f3e2d76f-11cb-419b-aeda-14264a22563f-kube-api-access-fgr2f\") pod \"f3e2d76f-11cb-419b-aeda-14264a22563f\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " Jul 24 13:45:46.884655 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.884574 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3e2d76f-11cb-419b-aeda-14264a22563f-cert\") pod \"f3e2d76f-11cb-419b-aeda-14264a22563f\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " Jul 24 13:45:46.884655 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.884604 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f3e2d76f-11cb-419b-aeda-14264a22563f-kubeflow-trainer-config\") pod \"f3e2d76f-11cb-419b-aeda-14264a22563f\" (UID: \"f3e2d76f-11cb-419b-aeda-14264a22563f\") " Jul 24 13:45:46.884763 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.884726 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d1ab707-84b8-4757-9317-35b82b9a74db-must-gather-output\") pod \"must-gather-z4xnh\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:46.884816 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.884794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp2d7\" (UniqueName: \"kubernetes.io/projected/9d1ab707-84b8-4757-9317-35b82b9a74db-kube-api-access-vp2d7\") pod \"must-gather-z4xnh\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:46.886930 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.886902 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e2d76f-11cb-419b-aeda-14264a22563f-kube-api-access-fgr2f" (OuterVolumeSpecName: "kube-api-access-fgr2f") pod "f3e2d76f-11cb-419b-aeda-14264a22563f" (UID: "f3e2d76f-11cb-419b-aeda-14264a22563f"). InnerVolumeSpecName "kube-api-access-fgr2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:45:46.887045 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.886964 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3e2d76f-11cb-419b-aeda-14264a22563f-cert" (OuterVolumeSpecName: "cert") pod "f3e2d76f-11cb-419b-aeda-14264a22563f" (UID: "f3e2d76f-11cb-419b-aeda-14264a22563f"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 13:45:46.888878 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.888856 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e2d76f-11cb-419b-aeda-14264a22563f-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "f3e2d76f-11cb-419b-aeda-14264a22563f" (UID: "f3e2d76f-11cb-419b-aeda-14264a22563f"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 13:45:46.985340 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.985308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d1ab707-84b8-4757-9317-35b82b9a74db-must-gather-output\") pod \"must-gather-z4xnh\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:46.985567 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.985378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp2d7\" (UniqueName: \"kubernetes.io/projected/9d1ab707-84b8-4757-9317-35b82b9a74db-kube-api-access-vp2d7\") pod \"must-gather-z4xnh\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:46.985567 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.985448 2579 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3e2d76f-11cb-419b-aeda-14264a22563f-cert\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:45:46.985567 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.985464 2579 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/f3e2d76f-11cb-419b-aeda-14264a22563f-kubeflow-trainer-config\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:45:46.985567 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.985481 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgr2f\" (UniqueName: \"kubernetes.io/projected/f3e2d76f-11cb-419b-aeda-14264a22563f-kube-api-access-fgr2f\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:45:46.985755 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.985644 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d1ab707-84b8-4757-9317-35b82b9a74db-must-gather-output\") pod \"must-gather-z4xnh\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:46.994479 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:46.994454 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp2d7\" (UniqueName: \"kubernetes.io/projected/9d1ab707-84b8-4757-9317-35b82b9a74db-kube-api-access-vp2d7\") pod \"must-gather-z4xnh\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:47.043233 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.043197 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:45:47.172574 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.172498 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s8fbw/must-gather-z4xnh"] Jul 24 13:45:47.175487 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:45:47.175457 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d1ab707_84b8_4757_9317_35b82b9a74db.slice/crio-0e2fd07ec5850b52adb520b734ea2a6398efff672594cca2353dc6bc4086b433 WatchSource:0}: Error finding container 0e2fd07ec5850b52adb520b734ea2a6398efff672594cca2353dc6bc4086b433: Status 404 returned error can't find the container with id 0e2fd07ec5850b52adb520b734ea2a6398efff672594cca2353dc6bc4086b433 Jul 24 13:45:47.218908 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.218873 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3e2d76f-11cb-419b-aeda-14264a22563f" containerID="366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e" exitCode=0 Jul 24 13:45:47.219106 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.218925 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" Jul 24 13:45:47.219106 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.218947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" event={"ID":"f3e2d76f-11cb-419b-aeda-14264a22563f","Type":"ContainerDied","Data":"366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e"} Jul 24 13:45:47.219106 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.218985 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7" event={"ID":"f3e2d76f-11cb-419b-aeda-14264a22563f","Type":"ContainerDied","Data":"3e951e9b79cf90586e6601e0bb358dde501a8fe07214d15c3a0550672a867c13"} Jul 24 13:45:47.219106 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.219006 2579 scope.go:117] "RemoveContainer" containerID="366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e" Jul 24 13:45:47.220398 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.220361 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" event={"ID":"9d1ab707-84b8-4757-9317-35b82b9a74db","Type":"ContainerStarted","Data":"0e2fd07ec5850b52adb520b734ea2a6398efff672594cca2353dc6bc4086b433"} Jul 24 13:45:47.227154 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.227129 2579 scope.go:117] "RemoveContainer" containerID="366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e" Jul 24 13:45:47.227469 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:45:47.227452 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e\": container with ID starting with 366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e not found: ID does not exist" containerID="366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e" Jul 24 13:45:47.227534 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.227480 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e"} err="failed to get container status \"366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e\": rpc error: code = NotFound desc = could not find container \"366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e\": container with ID starting with 366fa0923e69c67ee807bf9c433b7a284ae78bd03985625f897a6a6e8741e11e not found: ID does not exist" Jul 24 13:45:47.236990 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.236962 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7"] Jul 24 13:45:47.241013 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:47.240988 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-v5rw7"] Jul 24 13:45:48.896980 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:48.896645 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e2d76f-11cb-419b-aeda-14264a22563f" path="/var/lib/kubelet/pods/f3e2d76f-11cb-419b-aeda-14264a22563f/volumes" Jul 24 13:45:54.258062 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:54.258033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" event={"ID":"9d1ab707-84b8-4757-9317-35b82b9a74db","Type":"ContainerStarted","Data":"39c892b68041b4cf479d627e57c7d0dea3526b9a8516510b40be95001dedd144"} Jul 24 13:45:54.258538 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:54.258072 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" event={"ID":"9d1ab707-84b8-4757-9317-35b82b9a74db","Type":"ContainerStarted","Data":"7111eb0773d4fab3fc7f4848d312a91275c71354180ddeb020b8329c66e65f0c"} Jul 24 13:45:54.275917 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:45:54.275862 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" podStartSLOduration=2.112468092 podStartE2EDuration="8.275844341s" totalImagesPullingTime="6.163376249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:54.275073232 +0000 UTC m=+617.860676285" watchObservedRunningTime="2026-07-24 13:45:54.275844341 +0000 UTC m=+617.861447397" Jul 24 13:46:39.450668 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:39.450630 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerID="7111eb0773d4fab3fc7f4848d312a91275c71354180ddeb020b8329c66e65f0c" exitCode=0 Jul 24 13:46:39.451087 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:39.450703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" event={"ID":"9d1ab707-84b8-4757-9317-35b82b9a74db","Type":"ContainerDied","Data":"7111eb0773d4fab3fc7f4848d312a91275c71354180ddeb020b8329c66e65f0c"} Jul 24 13:46:39.451087 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:39.451040 2579 scope.go:117] "RemoveContainer" containerID="7111eb0773d4fab3fc7f4848d312a91275c71354180ddeb020b8329c66e65f0c" Jul 24 13:46:39.935955 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:39.935929 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s8fbw_must-gather-z4xnh_9d1ab707-84b8-4757-9317-35b82b9a74db/gather/0.log" Jul 24 13:46:40.328783 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:40.328750 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:46:41.553076 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:41.553045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:46:43.358164 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:43.358132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9vnwp_aa3ea906-be99-40aa-944d-a38f2665910d/global-pull-secret-syncer/0.log" Jul 24 13:46:43.501705 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:43.501673 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" Jul 24 13:46:43.633419 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:43.633335 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-191.ec2.internal_e33b40bd57bdc85611250cbc4f13a08e/haproxy/0.log" Jul 24 13:46:45.303292 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.303240 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-s8fbw/must-gather-z4xnh"] Jul 24 13:46:45.303715 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.303469 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="copy" containerID="cri-o://39c892b68041b4cf479d627e57c7d0dea3526b9a8516510b40be95001dedd144" gracePeriod=2 Jul 24 13:46:45.307818 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.307789 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-s8fbw/must-gather-z4xnh"] Jul 24 13:46:45.474728 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.474708 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s8fbw_must-gather-z4xnh_9d1ab707-84b8-4757-9317-35b82b9a74db/copy/0.log" Jul 24 13:46:45.475144 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.475121 2579 generic.go:356] "Generic (PLEG): container finished" podID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerID="39c892b68041b4cf479d627e57c7d0dea3526b9a8516510b40be95001dedd144" exitCode=143 Jul 24 13:46:45.546534 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.546512 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s8fbw_must-gather-z4xnh_9d1ab707-84b8-4757-9317-35b82b9a74db/copy/0.log" Jul 24 13:46:45.548993 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.548977 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:46:45.551516 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:46:45.551492 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-z4xnh\" is forbidden: User \"system:node:ip-10-0-138-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s8fbw\": no relationship found between node 'ip-10-0-138-191.ec2.internal' and this object" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:46:45.676590 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.676494 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp2d7\" (UniqueName: \"kubernetes.io/projected/9d1ab707-84b8-4757-9317-35b82b9a74db-kube-api-access-vp2d7\") pod \"9d1ab707-84b8-4757-9317-35b82b9a74db\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " Jul 24 13:46:45.676590 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.676570 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d1ab707-84b8-4757-9317-35b82b9a74db-must-gather-output\") pod \"9d1ab707-84b8-4757-9317-35b82b9a74db\" (UID: \"9d1ab707-84b8-4757-9317-35b82b9a74db\") " Jul 24 13:46:45.677901 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.677875 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1ab707-84b8-4757-9317-35b82b9a74db-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9d1ab707-84b8-4757-9317-35b82b9a74db" (UID: "9d1ab707-84b8-4757-9317-35b82b9a74db"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 13:46:45.678748 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.678727 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d1ab707-84b8-4757-9317-35b82b9a74db-kube-api-access-vp2d7" (OuterVolumeSpecName: "kube-api-access-vp2d7") pod "9d1ab707-84b8-4757-9317-35b82b9a74db" (UID: "9d1ab707-84b8-4757-9317-35b82b9a74db"). InnerVolumeSpecName "kube-api-access-vp2d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 13:46:45.777657 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.777620 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp2d7\" (UniqueName: \"kubernetes.io/projected/9d1ab707-84b8-4757-9317-35b82b9a74db-kube-api-access-vp2d7\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:46:45.777657 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:45.777650 2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9d1ab707-84b8-4757-9317-35b82b9a74db-must-gather-output\") on node \"ip-10-0-138-191.ec2.internal\" DevicePath \"\"" Jul 24 13:46:46.358956 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.358924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:46:46.440950 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.440922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bgmf8_d2dd32a5-5ef7-40ff-9dd2-e8113010c18c/konnectivity-agent/0.log" limit=1024 Jul 24 13:46:46.479976 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.479955 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s8fbw_must-gather-z4xnh_9d1ab707-84b8-4757-9317-35b82b9a74db/copy/0.log" Jul 24 13:46:46.480338 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.480326 2579 scope.go:117] "RemoveContainer" containerID="39c892b68041b4cf479d627e57c7d0dea3526b9a8516510b40be95001dedd144" Jul 24 13:46:46.480418 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.480404 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:46:46.483328 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:46:46.483300 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-z4xnh\" is forbidden: User \"system:node:ip-10-0-138-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s8fbw\": no relationship found between node 'ip-10-0-138-191.ec2.internal' and this object" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:46:46.487851 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.487827 2579 scope.go:117] "RemoveContainer" containerID="7111eb0773d4fab3fc7f4848d312a91275c71354180ddeb020b8329c66e65f0c" Jul 24 13:46:46.491298 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:46:46.491261 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-z4xnh\" is forbidden: User \"system:node:ip-10-0-138-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s8fbw\": no relationship found between node 'ip-10-0-138-191.ec2.internal' and this object" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:46:46.894351 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:46.894320 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" path="/var/lib/kubelet/pods/9d1ab707-84b8-4757-9317-35b82b9a74db/volumes" Jul 24 13:46:46.894783 ip-10-0-138-191 kubenswrapper[2579]: E0724 13:46:46.894763 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-z4xnh\" is forbidden: User \"system:node:ip-10-0-138-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s8fbw\": no relationship found between node 'ip-10-0-138-191.ec2.internal' and this object" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" pod="openshift-must-gather-s8fbw/must-gather-z4xnh" Jul 24 13:46:47.906091 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:47.906062 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hk7gd_bef55f5c-fb94-4765-8d8b-1bb48527d0d7/node-exporter/0.log" Jul 24 13:46:47.943411 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:47.943383 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hk7gd_bef55f5c-fb94-4765-8d8b-1bb48527d0d7/kube-rbac-proxy/0.log" Jul 24 13:46:47.972729 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:47.972701 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hk7gd_bef55f5c-fb94-4765-8d8b-1bb48527d0d7/init-textfile/0.log" Jul 24 13:46:48.282948 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.282917 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-htf56_aeb919a7-9cf3-43b4-87a9-3fbb6306cc80/kube-rbac-proxy-main/0.log" Jul 24 13:46:48.324770 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.324742 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-htf56_aeb919a7-9cf3-43b4-87a9-3fbb6306cc80/kube-rbac-proxy-self/0.log" Jul 24 13:46:48.380107 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.380073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-htf56_aeb919a7-9cf3-43b4-87a9-3fbb6306cc80/openshift-state-metrics/0.log" Jul 24 13:46:48.452468 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.452441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/prometheus/0.log" Jul 24 13:46:48.500288 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.500177 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/config-reloader/0.log" Jul 24 13:46:48.539377 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.539341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/thanos-sidecar/0.log" Jul 24 13:46:48.583737 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.583713 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/kube-rbac-proxy-web/0.log" Jul 24 13:46:48.614894 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.614873 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/kube-rbac-proxy/0.log" Jul 24 13:46:48.648301 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.648262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/kube-rbac-proxy-thanos/0.log" Jul 24 13:46:48.690745 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.690710 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ad916930-391a-4f7b-9b01-13d33fdfa356/init-config-reloader/0.log" Jul 24 13:46:48.788963 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:48.788929 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-7m592_77622544-3d2d-4e98-b174-fe59962f4de8/prometheus-operator-admission-webhook/0.log" Jul 24 13:46:50.355449 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355423 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97"] Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355685 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="copy" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355695 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="copy" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355709 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="gather" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355714 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="gather" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355732 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e2d76f-11cb-419b-aeda-14264a22563f" containerName="manager" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355738 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e2d76f-11cb-419b-aeda-14264a22563f" containerName="manager" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355784 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3e2d76f-11cb-419b-aeda-14264a22563f" containerName="manager" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355791 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="copy" Jul 24 13:46:50.355862 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.355799 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d1ab707-84b8-4757-9317-35b82b9a74db" containerName="gather" Jul 24 13:46:50.360671 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.360648 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.365976 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.365946 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqt25\"/\"kube-root-ca.crt\"" Jul 24 13:46:50.366138 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.366120 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqt25\"/\"openshift-service-ca.crt\"" Jul 24 13:46:50.367163 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.367141 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tqt25\"/\"default-dockercfg-kg9l2\"" Jul 24 13:46:50.374953 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.374921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97"] Jul 24 13:46:50.517359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.517326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-podres\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.517541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.517368 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdwjr\" (UniqueName: \"kubernetes.io/projected/ea4206c5-6883-41df-881c-7eec1dc81622-kube-api-access-jdwjr\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.517541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.517394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-sys\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.517541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.517413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-proc\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.517541 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.517428 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-lib-modules\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618576 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-podres\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618576 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdwjr\" (UniqueName: \"kubernetes.io/projected/ea4206c5-6883-41df-881c-7eec1dc81622-kube-api-access-jdwjr\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618576 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-sys\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-sys\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-proc\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618662 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-podres\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618682 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-lib-modules\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.618848 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-proc\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.619053 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.618857 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea4206c5-6883-41df-881c-7eec1dc81622-lib-modules\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.630189 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.630158 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdwjr\" (UniqueName: \"kubernetes.io/projected/ea4206c5-6883-41df-881c-7eec1dc81622-kube-api-access-jdwjr\") pod \"perf-node-gather-daemonset-bgp97\" (UID: \"ea4206c5-6883-41df-881c-7eec1dc81622\") " pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.670252 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.670217 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:50.805533 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:50.805501 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97"] Jul 24 13:46:50.809160 ip-10-0-138-191 kubenswrapper[2579]: W0724 13:46:50.809135 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea4206c5_6883_41df_881c_7eec1dc81622.slice/crio-2346557ac0b65703bcb6024fb0b169ba3e14914f65d7f999b2177a284da0dba7 WatchSource:0}: Error finding container 2346557ac0b65703bcb6024fb0b169ba3e14914f65d7f999b2177a284da0dba7: Status 404 returned error can't find the container with id 2346557ac0b65703bcb6024fb0b169ba3e14914f65d7f999b2177a284da0dba7 Jul 24 13:46:51.502155 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:51.502117 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" event={"ID":"ea4206c5-6883-41df-881c-7eec1dc81622","Type":"ContainerStarted","Data":"2996b0fa38adeb2a415b3f4983cc372dc3ffbe50b72e513b576d2bf84a5e98ae"} Jul 24 13:46:51.502588 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:51.502168 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" event={"ID":"ea4206c5-6883-41df-881c-7eec1dc81622","Type":"ContainerStarted","Data":"2346557ac0b65703bcb6024fb0b169ba3e14914f65d7f999b2177a284da0dba7"} Jul 24 13:46:51.502588 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:51.502229 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:46:51.530155 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:51.530036 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" podStartSLOduration=1.530016963 podStartE2EDuration="1.530016963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:46:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:46:51.528546214 +0000 UTC m=+675.114149266" watchObservedRunningTime="2026-07-24 13:46:51.530016963 +0000 UTC m=+675.115620015" Jul 24 13:46:52.666797 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:52.666769 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gf8d_66d35e6c-6cab-41ff-8299-62800a776bbf/dns/0.log" Jul 24 13:46:52.717073 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:52.717042 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5gf8d_66d35e6c-6cab-41ff-8299-62800a776bbf/kube-rbac-proxy/0.log" Jul 24 13:46:53.048357 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:53.048337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sc54w_65787285-0f43-4ecc-9487-ed2044a70ea9/dns-node-resolver/0.log" Jul 24 13:46:53.582958 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:53.582935 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ts5qc_b6179e1d-c181-4b39-92ba-8287e0b3843f/node-ca/0.log" Jul 24 13:46:54.492249 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:54.492221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64df8477cf-kqfkq_cda31855-c87f-40b6-aeea-62353661b26d/router/0.log" Jul 24 13:46:55.013847 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:55.013823 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n4h99_49ac5e95-afe2-4c2d-90a4-fd837b438c1e/serve-healthcheck-canary/0.log" Jul 24 13:46:55.482709 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:55.482677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9bqn9_fa5e0d2f-290e-48ec-9d19-1aed1244e8b2/insights-operator/0.log" Jul 24 13:46:55.482869 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:55.482713 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9bqn9_fa5e0d2f-290e-48ec-9d19-1aed1244e8b2/insights-operator/1.log" Jul 24 13:46:55.760435 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:55.760349 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xjvvp_82a271ff-6fcc-456e-97e2-d468b389c333/kube-rbac-proxy/0.log" Jul 24 13:46:55.800774 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:55.800744 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xjvvp_82a271ff-6fcc-456e-97e2-d468b389c333/exporter/0.log" Jul 24 13:46:55.851160 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:55.851136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xjvvp_82a271ff-6fcc-456e-97e2-d468b389c333/extractor/0.log" Jul 24 13:46:57.515144 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:46:57.515115 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tqt25/perf-node-gather-daemonset-bgp97" Jul 24 13:47:02.020176 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:02.020145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-w7nng_790bb256-dc5f-4007-9e7f-716b8b70cd45/migrator/0.log" Jul 24 13:47:02.044858 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:02.044823 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-w7nng_790bb256-dc5f-4007-9e7f-716b8b70cd45/graceful-termination/0.log" Jul 24 13:47:03.739989 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:03.739964 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/kube-multus-additional-cni-plugins/0.log" Jul 24 13:47:03.822705 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:03.822677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/egress-router-binary-copy/0.log" Jul 24 13:47:03.867512 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:03.867484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/cni-plugins/0.log" Jul 24 13:47:03.911966 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:03.911937 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/bond-cni-plugin/0.log" Jul 24 13:47:03.944829 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:03.944802 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/routeoverride-cni/0.log" Jul 24 13:47:03.980167 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:03.980139 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/whereabouts-cni-bincopy/0.log" Jul 24 13:47:04.007577 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:04.007493 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gvb2c_c484f13e-5565-408d-a98c-226f5680525f/whereabouts-cni/0.log" Jul 24 13:47:04.343611 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:04.343542 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-znqm4_3d9a4584-97d4-48e1-992e-26c98459b163/kube-multus/0.log" Jul 24 13:47:04.373293 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:04.373246 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94n97_65a8a998-e460-4249-9fb2-a15d80a3cd80/network-metrics-daemon/0.log" Jul 24 13:47:04.397845 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:04.397821 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-94n97_65a8a998-e460-4249-9fb2-a15d80a3cd80/kube-rbac-proxy/0.log" Jul 24 13:47:06.092359 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.092324 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/ovn-controller/0.log" Jul 24 13:47:06.155439 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.155408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/ovn-acl-logging/0.log" Jul 24 13:47:06.188057 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.188030 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/kube-rbac-proxy-node/0.log" Jul 24 13:47:06.219232 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.219205 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 13:47:06.254318 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.254293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/northd/0.log" Jul 24 13:47:06.296547 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.296517 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/nbdb/0.log" Jul 24 13:47:06.358971 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.358900 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/sbdb/0.log" Jul 24 13:47:06.407017 ip-10-0-138-191 kubenswrapper[2579]: I0724 13:47:06.406993 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j7z6j_6ce5a025-3559-497f-9fbf-546dd3301fb7/ovnkube-controller/0.log"