Jul 02 18:28:35.357069 ip-10-0-136-219 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 02 18:28:35.357077 ip-10-0-136-219 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 02 18:28:35.357084 ip-10-0-136-219 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 02 18:28:35.357307 ip-10-0-136-219 systemd[1]: Failed to start Kubernetes Kubelet. Jul 02 18:28:45.583271 ip-10-0-136-219 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 02 18:28:45.583289 ip-10-0-136-219 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6c543bbad4e3467bbf1548e0b67d5b23 -- Jul 02 18:30:43.896191 ip-10-0-136-219 systemd[1]: Starting Kubernetes Kubelet... Jul 02 18:30:44.247739 ip-10-0-136-219 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 18:30:44.247739 ip-10-0-136-219 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 18:30:44.247739 ip-10-0-136-219 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 18:30:44.247739 ip-10-0-136-219 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 18:30:44.247739 ip-10-0-136-219 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 18:30:44.249554 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.249412 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 18:30:44.254961 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254941 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 18:30:44.254961 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254958 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 18:30:44.254961 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254962 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 18:30:44.254961 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254965 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 18:30:44.254961 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254968 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254971 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254974 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254977 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254982 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254985 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254987 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254990 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254993 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254996 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.254998 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255001 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255004 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255006 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255009 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255012 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255014 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255017 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255019 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255021 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 18:30:44.255147 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255024 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255027 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255029 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255031 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255034 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255037 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255040 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255042 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255048 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255051 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255053 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255056 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255058 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255061 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255064 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255067 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255070 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255073 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255077 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255079 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 18:30:44.255615 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255082 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255085 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255087 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255090 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255093 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255095 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255098 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255101 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255104 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255108 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255112 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255115 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255118 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255121 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255124 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255126 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255130 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255133 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255135 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 18:30:44.256105 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255138 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255140 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255143 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255145 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255148 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255151 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255157 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255160 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255163 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255166 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255168 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255171 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255173 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255176 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255184 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255188 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255191 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255194 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 18:30:44.256582 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255196 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255200 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255203 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255206 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255208 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255211 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255214 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255216 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255219 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255221 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255224 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255226 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255229 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255231 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255235 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255238 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255241 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255958 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255966 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255969 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 02 18:30:44.257044 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255972 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255975 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255977 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255980 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255985 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255990 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255992 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255996 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.255998 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256001 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256004 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256007 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256010 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256012 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256016 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256019 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256021 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256023 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256026 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 18:30:44.257517 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256028 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256031 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256034 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256036 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256039 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256043 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256046 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256049 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256051 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256053 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256056 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256059 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256061 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256065 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256068 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256071 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256073 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256076 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256078 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256081 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 18:30:44.258002 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256083 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256086 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256088 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256091 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256094 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256096 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256099 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256102 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256105 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256109 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256112 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256115 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256118 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256121 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256124 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256127 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256130 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256133 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256136 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 18:30:44.258496 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256139 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256142 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256145 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256147 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256150 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256152 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256155 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256158 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256161 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256163 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256167 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256169 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256172 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256174 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256177 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256180 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256182 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256185 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256187 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256190 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 18:30:44.258979 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256192 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256195 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256197 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256200 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256202 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256205 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256207 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256210 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256212 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256215 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256218 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256220 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256223 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256225 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256228 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256231 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256234 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256237 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256621 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256627 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 18:30:44.259468 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256630 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256632 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256635 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256638 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256640 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256643 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256645 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256648 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256650 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256653 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256655 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256659 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256661 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256664 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256667 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256670 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256672 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256676 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256680 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 18:30:44.259950 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256683 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256686 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256689 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256692 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256695 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256697 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256700 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256703 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256706 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256709 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256712 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256714 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256717 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256720 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256723 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256727 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256730 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256733 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256736 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 18:30:44.260427 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256738 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256741 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256743 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256746 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256748 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256751 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256753 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256756 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256758 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256761 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256764 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256766 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256769 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256771 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256774 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256794 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256799 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256823 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256829 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256831 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 18:30:44.260905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256834 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256837 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256841 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256843 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256846 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256848 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256851 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256854 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256856 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256859 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256861 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256864 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256869 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256872 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256874 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256877 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256879 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256882 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256885 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256888 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 18:30:44.261389 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256890 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256893 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256896 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256899 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256901 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256904 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256906 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256908 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256911 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256913 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256916 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256919 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256921 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256925 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256928 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256931 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256934 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256937 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.256939 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257011 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 18:30:44.261928 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257019 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257026 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257031 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257035 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257038 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257043 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257047 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257050 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257054 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257060 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257063 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257067 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257070 2579 flags.go:64] FLAG: --cgroup-root="" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257073 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257076 2579 flags.go:64] FLAG: --client-ca-file="" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257079 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257082 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257086 2579 flags.go:64] FLAG: --cluster-domain="" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257089 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257093 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257096 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257099 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257103 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 18:30:44.262406 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257106 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257109 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257113 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257116 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257119 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257122 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257125 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257128 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257132 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257135 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257138 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257141 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257144 2579 flags.go:64] FLAG: --enable-server="true" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257147 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257151 2579 flags.go:64] FLAG: --event-burst="100" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257155 2579 flags.go:64] FLAG: --event-qps="50" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257158 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257162 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257166 2579 flags.go:64] FLAG: --eviction-hard="" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257170 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257172 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257176 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257179 2579 flags.go:64] FLAG: --eviction-soft="" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257182 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257185 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 18:30:44.262999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257188 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257191 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257194 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257197 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257200 2579 flags.go:64] FLAG: --feature-gates="" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257203 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257208 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257211 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257215 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257218 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257221 2579 flags.go:64] FLAG: --help="false" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257223 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257227 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257230 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257233 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257236 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257240 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257243 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257246 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257248 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257251 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257254 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257257 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257260 2579 flags.go:64] FLAG: --kube-reserved="" Jul 02 18:30:44.263648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257263 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257267 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257270 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257273 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257276 2579 flags.go:64] FLAG: --lock-file="" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257279 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257282 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257285 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257290 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257295 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257298 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257301 2579 flags.go:64] FLAG: --logging-format="text" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257304 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257307 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257311 2579 flags.go:64] FLAG: --manifest-url="" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257314 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257318 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257321 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257326 2579 flags.go:64] FLAG: --max-pods="110" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257329 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257332 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257335 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257338 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257341 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257344 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 18:30:44.264259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257347 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257354 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257357 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257360 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257363 2579 flags.go:64] FLAG: --pod-cidr="" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257366 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257371 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257374 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257382 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257385 2579 flags.go:64] FLAG: --port="10250" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257388 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257392 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c19b75f3a9467948" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257395 2579 flags.go:64] FLAG: --qos-reserved="" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257398 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257401 2579 flags.go:64] FLAG: --register-node="true" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257404 2579 flags.go:64] FLAG: --register-with-taints="" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257408 2579 flags.go:64] FLAG: --registry-burst="10" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257411 2579 flags.go:64] FLAG: --registry-qps="5" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257414 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257417 2579 flags.go:64] FLAG: --reserved-memory="" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257421 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257424 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257428 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257431 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257434 2579 flags.go:64] FLAG: --runonce="false" Jul 02 18:30:44.264871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257437 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257440 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257443 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257446 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257449 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257452 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257455 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257458 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257460 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257463 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257466 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257470 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257473 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257476 2579 flags.go:64] FLAG: --system-cgroups="" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257479 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257485 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257488 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257491 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257495 2579 flags.go:64] FLAG: --tls-min-version="" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257498 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257501 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257504 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257507 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257509 2579 flags.go:64] FLAG: --v="2" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257513 2579 flags.go:64] FLAG: --version="false" Jul 02 18:30:44.265586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257518 2579 flags.go:64] FLAG: --vmodule="" Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257522 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.257526 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257667 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257672 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257675 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257678 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257681 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257683 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257686 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257688 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257691 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257694 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257696 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257699 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257701 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257704 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257706 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257709 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257712 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 18:30:44.266262 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257714 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257717 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257720 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257723 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257726 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257728 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257731 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257733 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257736 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257739 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257742 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257744 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257747 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257750 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257753 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257755 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257759 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257764 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257768 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257771 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 18:30:44.266787 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257774 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257793 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257797 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257800 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257802 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257805 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257807 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257810 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257812 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257815 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257818 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257820 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257823 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257825 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257830 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257833 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257835 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257838 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257841 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257844 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 18:30:44.267304 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257846 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257849 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257852 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257854 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257857 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257860 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257869 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257871 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257875 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257878 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257880 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257883 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257885 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257888 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257890 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257893 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257895 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257898 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257901 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 18:30:44.267806 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257903 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257907 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257911 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257914 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257917 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257920 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257923 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257928 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257931 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257934 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257937 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257940 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257942 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257945 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257948 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257950 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257953 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257955 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257958 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 18:30:44.268277 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257960 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257963 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257969 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.257972 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.258466 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.265332 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.265347 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.265365 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.265371 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265429 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265434 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265437 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265441 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265443 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 18:30:44.268748 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265447 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265449 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265452 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265455 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265457 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265460 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265463 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265465 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265468 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265471 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265474 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265476 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265479 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265482 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265484 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265487 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265489 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265492 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265495 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 18:30:44.269130 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265498 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265501 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265503 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265506 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265509 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265512 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265514 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265517 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265519 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265522 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265525 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265527 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265530 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265532 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265535 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265537 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265540 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265543 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265545 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265548 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 18:30:44.269586 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265550 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265553 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265557 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265561 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265564 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265568 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265572 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265575 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265578 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265580 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265583 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265585 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265588 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265591 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265594 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265596 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265600 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265603 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265606 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 18:30:44.270157 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265608 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265611 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265613 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265616 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265619 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265621 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265624 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265626 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265629 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265632 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265635 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265637 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265641 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265644 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265647 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265650 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265654 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265657 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265660 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265663 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 18:30:44.270612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265665 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265668 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265671 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265673 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265676 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265678 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265681 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265684 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265686 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265689 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265692 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265695 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265697 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265700 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265703 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 18:30:44.271115 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265705 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.265710 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265875 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265879 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265883 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265886 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265889 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265892 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265895 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265897 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265900 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265902 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265905 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265908 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265911 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 18:30:44.271499 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265913 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265916 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265919 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265922 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265924 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265927 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265930 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265932 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265935 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265938 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265941 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265943 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265946 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265949 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265951 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265954 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265956 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265959 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265961 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265964 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 18:30:44.271905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265966 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265969 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265971 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265974 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265976 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265978 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265981 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265983 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265986 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265988 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265991 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265993 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265996 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.265998 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266000 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266003 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266006 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266008 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266011 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266013 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 18:30:44.272398 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266015 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266019 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266022 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266026 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266029 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266031 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266034 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266037 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266039 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266042 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266044 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266047 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266049 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266052 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266054 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266057 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266059 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266062 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266064 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 18:30:44.272905 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266066 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266069 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266071 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266074 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266076 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266080 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266084 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266086 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266089 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266092 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266094 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266097 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266100 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266102 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266104 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266107 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266109 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266113 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266117 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 18:30:44.273366 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266119 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266122 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266125 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266127 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266130 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266132 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266134 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:44.266137 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.266145 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.266241 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.268178 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.269327 2579 server.go:1019] "Starting client certificate rotation" Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.269430 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.269466 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 18:30:44.273872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.271464 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 18:30:44.275987 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.275972 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 18:30:44.286328 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.286309 2579 log.go:25] "Validated CRI v1 runtime API" Jul 02 18:30:44.288839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.288823 2579 log.go:25] "Validated CRI v1 image API" Jul 02 18:30:44.290748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.290733 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 18:30:44.292918 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.292899 2579 fs.go:135] Filesystem UUIDs: map[4acd8af8-a283-4252-b749-70ab8a60462b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ea14a3a5-81a4-4495-9a7b-a9cc56c83638:/dev/nvme0n1p3] Jul 02 18:30:44.292977 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.292920 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 18:30:44.294688 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.294674 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 18:30:44.298912 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.298803 2579 manager.go:216] Machine: {Timestamp:2026-07-02 18:30:44.297526542 +0000 UTC m=+0.294555045 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099810 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f58437f33e74cfa853ba4074ae92 SystemUUID:ec24f584-37f3-3e74-cfa8-53ba4074ae92 BootID:6c543bba-d4e3-467b-bf15-48e0b67d5b23 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:87:64:ae:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:87:64:ae:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:34:65:3e:3b:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 18:30:44.298912 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.298908 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 18:30:44.299014 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.298982 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 18:30:44.301542 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.301522 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 18:30:44.301674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.301545 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-219.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 18:30:44.302141 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.302131 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 18:30:44.302177 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.302142 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 18:30:44.302177 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.302153 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 18:30:44.302708 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.302698 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 18:30:44.303805 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.303795 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 18:30:44.306514 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306503 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 02 18:30:44.306640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306631 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 18:30:44.306670 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306662 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 02 18:30:44.306700 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306672 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 18:30:44.306700 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306690 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 18:30:44.306700 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306699 2579 kubelet.go:398] "Adding apiserver pod source" Jul 02 18:30:44.306787 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.306706 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 18:30:44.307038 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.307024 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 18:30:44.307079 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.307047 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 18:30:44.308789 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.308757 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 18:30:44.310420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.310407 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 18:30:44.310475 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.310436 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 18:30:44.311427 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311413 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 18:30:44.311427 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311430 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311435 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311442 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311451 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311456 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311477 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311485 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311492 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311497 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311509 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 18:30:44.311540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.311515 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 18:30:44.312086 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.312077 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 18:30:44.312086 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.312086 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 18:30:44.315113 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.315097 2579 server.go:1268] "Started kubelet" Jul 02 18:30:44.315233 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.315189 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 18:30:44.315320 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.315233 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 18:30:44.315376 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.315320 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 18:30:44.317767 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.317739 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 18:30:44.318077 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.318059 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-219.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 18:30:44.318069 ip-10-0-136-219 systemd[1]: Started Kubernetes Kubelet. Jul 02 18:30:44.318337 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.318310 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 18:30:44.319646 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.318521 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 18:30:44.319646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.319179 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngwxw" Jul 02 18:30:44.320946 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.320166 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 18:30:44.320946 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.320260 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 02 18:30:44.324611 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.323765 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-219.ec2.internal.18be8c8e12dddaf5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-219.ec2.internal,UID:ip-10-0-136-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-219.ec2.internal,},FirstTimestamp:2026-07-02 18:30:44.315069173 +0000 UTC m=+0.312097675,LastTimestamp:2026-07-02 18:30:44.315069173 +0000 UTC m=+0.312097675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-219.ec2.internal,}" Jul 02 18:30:44.326583 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.326559 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 18:30:44.326583 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.326573 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 18:30:44.326739 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.326672 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.327117 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327098 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ngwxw" Jul 02 18:30:44.327208 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327148 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 18:30:44.327276 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327228 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 18:30:44.327276 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327242 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 18:30:44.327371 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327349 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 02 18:30:44.327371 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327355 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 02 18:30:44.327646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327631 2579 factory.go:55] Registering systemd factory Jul 02 18:30:44.327646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327648 2579 factory.go:223] Registration of the systemd container factory successfully Jul 02 18:30:44.327917 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327895 2579 factory.go:153] Registering CRI-O factory Jul 02 18:30:44.327917 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327914 2579 factory.go:223] Registration of the crio container factory successfully Jul 02 18:30:44.328099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327953 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 18:30:44.328099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327975 2579 factory.go:103] Registering Raw factory Jul 02 18:30:44.328099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.327988 2579 manager.go:1196] Started watching for new ooms in manager Jul 02 18:30:44.328407 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.328392 2579 manager.go:349] Starting recovery of all containers Jul 02 18:30:44.337336 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.337313 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 18:30:44.338011 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.337991 2579 manager.go:354] Recovery completed Jul 02 18:30:44.340553 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.340535 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-219.ec2.internal\" not found" node="ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.342655 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.342642 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.344362 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344343 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.344414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344375 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.344414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344386 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.344856 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344841 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 18:30:44.344856 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344852 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.344856 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344856 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 18:30:44.344966 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.344875 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 02 18:30:44.345478 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.345464 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.345525 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.345491 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.345525 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.345504 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.345899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.345886 2579 policy_none.go:49] "None policy: Start" Jul 02 18:30:44.345899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.345901 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 18:30:44.345988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.345913 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 18:30:44.346867 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.346856 2579 policy_none.go:47] "Start" Jul 02 18:30:44.382423 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382305 2579 manager.go:337] "Starting Device Plugin manager" Jul 02 18:30:44.382519 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.382464 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 18:30:44.382519 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382478 2579 server.go:87] "Starting device plugin registration server" Jul 02 18:30:44.382716 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382702 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 18:30:44.382795 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382717 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 18:30:44.382851 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382812 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 18:30:44.382933 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382916 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 18:30:44.382933 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.382930 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 18:30:44.383463 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.383447 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 18:30:44.383535 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.383495 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.483437 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.483401 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.485275 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.484379 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.485275 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.484406 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.485275 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.484417 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.485275 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.484447 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.488513 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.488489 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 18:30:44.489655 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.489628 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 18:30:44.489729 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.489671 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 18:30:44.489729 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.489694 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 18:30:44.489823 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.489734 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 18:30:44.492173 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.492153 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 18:30:44.493129 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.493115 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.493184 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.493136 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-219.ec2.internal\": node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.525098 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.525073 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.590861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.590814 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal"] Jul 02 18:30:44.590984 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.590921 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.592479 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.592463 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.592563 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.592491 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.592563 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.592501 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.594812 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.594782 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.594924 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.594907 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.594992 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.594940 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.595893 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.595874 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.595985 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.595907 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.595985 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.595918 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.595985 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.595876 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.595985 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.595961 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.595985 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.595978 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.598148 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.598129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.598221 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.598165 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 18:30:44.598875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.598848 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientMemory" Jul 02 18:30:44.598967 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.598878 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 18:30:44.598967 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.598889 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeHasSufficientPID" Jul 02 18:30:44.625596 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.625576 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.628545 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.628527 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-219.ec2.internal\" not found" node="ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.629271 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.629254 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/130b89a92b4c7dd39a4bd94714e902bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal\" (UID: \"130b89a92b4c7dd39a4bd94714e902bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.629339 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.629278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130b89a92b4c7dd39a4bd94714e902bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal\" (UID: \"130b89a92b4c7dd39a4bd94714e902bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.629339 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.629298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4a2b1f1ab3d3c828e793f3e77e1a6f7-config\") pod \"kube-apiserver-proxy-ip-10-0-136-219.ec2.internal\" (UID: \"b4a2b1f1ab3d3c828e793f3e77e1a6f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.633283 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.633265 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-219.ec2.internal\" not found" node="ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.726130 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.726103 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.729613 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.729597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/130b89a92b4c7dd39a4bd94714e902bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal\" (UID: \"130b89a92b4c7dd39a4bd94714e902bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.729674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.729624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130b89a92b4c7dd39a4bd94714e902bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal\" (UID: \"130b89a92b4c7dd39a4bd94714e902bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.729674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.729648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4a2b1f1ab3d3c828e793f3e77e1a6f7-config\") pod \"kube-apiserver-proxy-ip-10-0-136-219.ec2.internal\" (UID: \"b4a2b1f1ab3d3c828e793f3e77e1a6f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.729777 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.729705 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4a2b1f1ab3d3c828e793f3e77e1a6f7-config\") pod \"kube-apiserver-proxy-ip-10-0-136-219.ec2.internal\" (UID: \"b4a2b1f1ab3d3c828e793f3e77e1a6f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.729777 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.729706 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/130b89a92b4c7dd39a4bd94714e902bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal\" (UID: \"130b89a92b4c7dd39a4bd94714e902bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.729777 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.729739 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/130b89a92b4c7dd39a4bd94714e902bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal\" (UID: \"130b89a92b4c7dd39a4bd94714e902bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.826981 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.826904 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.934575 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:44.934544 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:44.934575 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.934562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:44.938071 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:44.938054 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" Jul 02 18:30:45.034788 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:45.034753 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:45.135431 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:45.135353 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:45.235565 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:45.235534 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:45.269507 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.269479 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 18:30:45.269937 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.269617 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 18:30:45.269937 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.269648 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 18:30:45.328943 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.328901 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:25:44 +0000 UTC" deadline="2028-01-17 02:47:16.579183893 +0000 UTC" Jul 02 18:30:45.328943 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.328939 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13520h16m31.250249468s" Jul 02 18:30:45.336360 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:45.336336 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-219.ec2.internal\" not found" Jul 02 18:30:45.352614 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.352597 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 18:30:45.426726 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.426701 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" Jul 02 18:30:45.438350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.438327 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 18:30:45.440157 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.440138 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" Jul 02 18:30:45.441403 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.441387 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 18:30:45.447068 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.447052 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 18:30:45.559923 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:45.559891 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a2b1f1ab3d3c828e793f3e77e1a6f7.slice/crio-e88c87876f2f7c2f7979072cde3e26a59c69685c6da6103fd0cef1994906901b WatchSource:0}: Error finding container e88c87876f2f7c2f7979072cde3e26a59c69685c6da6103fd0cef1994906901b: Status 404 returned error can't find the container with id e88c87876f2f7c2f7979072cde3e26a59c69685c6da6103fd0cef1994906901b Jul 02 18:30:45.560485 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:45.560469 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130b89a92b4c7dd39a4bd94714e902bb.slice/crio-9850258624e4634433bc8f96c390f2277b9a1f02f91ab9e8d5a2301af5fbf382 WatchSource:0}: Error finding container 9850258624e4634433bc8f96c390f2277b9a1f02f91ab9e8d5a2301af5fbf382: Status 404 returned error can't find the container with id 9850258624e4634433bc8f96c390f2277b9a1f02f91ab9e8d5a2301af5fbf382 Jul 02 18:30:45.566559 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:45.566544 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 18:30:46.309752 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.309717 2579 apiserver.go:52] "Watching apiserver" Jul 02 18:30:46.315547 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.315517 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 18:30:46.316947 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.316880 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-27zfs","openshift-cluster-node-tuning-operator/tuned-hjk6k","openshift-image-registry/node-ca-4v9fw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal","openshift-multus/multus-sdc2q","openshift-ovn-kubernetes/ovnkube-node-cftkj","kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x","openshift-dns/node-resolver-w4tfr","openshift-multus/multus-additional-cni-plugins-s4hnp","openshift-multus/network-metrics-daemon-gm98z","openshift-network-diagnostics/network-check-target-bgr8t","openshift-network-operator/iptables-alerter-5fr7t","kube-system/global-pull-secret-syncer-zx6n4"] Jul 02 18:30:46.320107 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.319600 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.323075 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.321971 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 18:30:46.323075 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.322146 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gx7v9\"" Jul 02 18:30:46.323075 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.322240 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 18:30:46.323075 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.322403 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.324320 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.324298 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kvmkg\"" Jul 02 18:30:46.324540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.324522 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.325015 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.324708 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.325169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.324783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.326936 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.326749 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.327049 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.326988 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mrffm\"" Jul 02 18:30:46.327113 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.327083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.327518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.327499 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 18:30:46.327619 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.327589 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.327765 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.327751 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 18:30:46.328657 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.328636 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.329241 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.329218 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8jzq6\"" Jul 02 18:30:46.329333 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.329279 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.329491 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.329459 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 18:30:46.329491 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.329478 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 18:30:46.329856 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.329824 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.332674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.332188 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.332674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.332344 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.332674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.332368 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 18:30:46.332939 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.332747 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.332939 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.332772 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 18:30:46.332939 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.332852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7whtg\"" Jul 02 18:30:46.333203 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.333177 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 18:30:46.333203 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.333190 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 18:30:46.333962 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.333940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 18:30:46.334342 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.334324 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.334879 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.334610 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-75ksx\"" Jul 02 18:30:46.334879 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.334641 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.334879 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.334827 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.337981 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.337894 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.338605 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.338520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.338996 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.338976 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h8bq9\"" Jul 02 18:30:46.339712 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.339690 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 18:30:46.340291 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.340261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.343072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.342977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-kubernetes\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.343072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-systemd\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.343246 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343111 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 18:30:46.343246 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343111 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 18:30:46.343351 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-cni-binary-copy\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.343351 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wkj8f\"" Jul 02 18:30:46.343351 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg7tr\" (UniqueName: \"kubernetes.io/projected/e43d40e2-8f1b-4115-95e2-610f903982af-kube-api-access-hg7tr\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.343503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-system-cni-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.343503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343447 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.343503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqpzz\" (UniqueName: \"kubernetes.io/projected/61588f28-f089-43dc-8a25-11d0cfbe8c10-kube-api-access-lqpzz\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.343659 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8388090f-d725-4d3d-996b-0981a649b5d8-konnectivity-ca\") pod \"konnectivity-agent-27zfs\" (UID: \"8388090f-d725-4d3d-996b-0981a649b5d8\") " pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.343659 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343597 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysctl-conf\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.343659 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:46.343659 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-cni-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.343875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-conf-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.343875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343751 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-slash\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.343875 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.343721 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:46.343875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysconfig\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.344085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-run-ovn-kubernetes\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e43d40e2-8f1b-4115-95e2-610f903982af-host\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.344085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.343992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-hostroot\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.344085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-node-log\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344073 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-cni-bin\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344138 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-env-overrides\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-lib-modules\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.344493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344198 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8388090f-d725-4d3d-996b-0981a649b5d8-agent-certs\") pod \"konnectivity-agent-27zfs\" (UID: \"8388090f-d725-4d3d-996b-0981a649b5d8\") " pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.344493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-modprobe-d\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.344493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlsxp\" (UniqueName: \"kubernetes.io/projected/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-kube-api-access-xlsxp\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.344748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-kubelet\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.344748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-ovn\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovnkube-script-lib\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-tmp\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.344982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-systemd\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-log-socket\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344887 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovn-node-metrics-cert\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.344982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-cnibin\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.344982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-k8s-cni-cncf-io\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.344995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-netns\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-daemon-config\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysctl-d\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-socket-dir-parent\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-etc-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-sys\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.345229 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-multus-certs\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.345583 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345260 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-etc-kubernetes\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.345583 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-cni-netd\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.345719 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-run\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.345775 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-var-lib-kubelet\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.345875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-host\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.345942 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-os-release\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.346001 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-var-lib-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.346001 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.345996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovnkube-config\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.346104 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346015 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-tuned\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.346104 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e43d40e2-8f1b-4115-95e2-610f903982af-serviceca\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.346204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqslp\" (UniqueName: \"kubernetes.io/projected/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-kube-api-access-rqslp\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.346204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-systemd-units\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.346204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-cni-bin\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.346354 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-kubelet\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.346354 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-run-netns\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.346354 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-cni-multus\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.346607 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.346579 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:46.346696 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.346673 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:46.349277 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.349253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.351169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.351151 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f6zrh\"" Jul 02 18:30:46.351312 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.351284 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 18:30:46.351438 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.351423 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 18:30:46.351575 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.351560 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 18:30:46.352013 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.351920 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.352013 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.351988 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:46.366111 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.366086 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dlnxt" Jul 02 18:30:46.374396 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.374372 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dlnxt" Jul 02 18:30:46.428798 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.428778 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 18:30:46.446991 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.446960 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447127 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.447127 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-tmp-dir\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.447127 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpv2d\" (UniqueName: \"kubernetes.io/projected/3955805c-5724-40a1-9a69-a5dd9d0d5f00-kube-api-access-lpv2d\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e43d40e2-8f1b-4115-95e2-610f903982af-host\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447174 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-hostroot\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447193 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447203 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-node-log\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447255 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-node-log\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-cni-bin\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-env-overrides\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447304 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-cni-bin\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.447758 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-socket-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.447758 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-lib-modules\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.447758 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e43d40e2-8f1b-4115-95e2-610f903982af-host\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.447758 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-system-cni-dir\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.447758 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:46.447758 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-hostroot\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.448089 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-lib-modules\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.448089 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh7lr\" (UniqueName: \"kubernetes.io/projected/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-kube-api-access-fh7lr\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:46.448089 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8388090f-d725-4d3d-996b-0981a649b5d8-agent-certs\") pod \"konnectivity-agent-27zfs\" (UID: \"8388090f-d725-4d3d-996b-0981a649b5d8\") " pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.448089 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.447987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-modprobe-d\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.448089 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448064 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlsxp\" (UniqueName: \"kubernetes.io/projected/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-kube-api-access-xlsxp\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.448341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-kubelet\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.448341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-ovn\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448163 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-env-overrides\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovnkube-script-lib\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-ovn\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-sys-fs\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.448646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-kubelet\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.448646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-tmp\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.448646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-modprobe-d\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.448646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448635 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-systemd\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-log-socket\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448660 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovn-node-metrics-cert\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-systemd\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448754 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-log-socket\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-cnibin\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-cnibin\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-k8s-cni-cncf-io\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.448875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448836 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovnkube-script-lib\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-netns\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-netns\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-daemon-config\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.448977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbznh\" (UniqueName: \"kubernetes.io/projected/faf56aa4-efb9-4af2-98be-fd3068a9e215-kube-api-access-nbznh\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74c57049-22b3-42e7-9ed8-8e3257057143-dbus\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-k8s-cni-cncf-io\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449029 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysctl-d\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449038 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-cnibin\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449056 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-socket-dir-parent\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-etc-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnwkq\" (UniqueName: \"kubernetes.io/projected/12538438-5c29-4987-bd41-b0dfa2f3bd59-kube-api-access-fnwkq\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-sys\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-multus-certs\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysctl-d\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-etc-kubernetes\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-cni-netd\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.449380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449217 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-socket-dir-parent\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-registration-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449247 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-etc-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449266 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-run-multus-certs\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-hosts-file\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449312 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-etc-kubernetes\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449317 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-sys\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74c57049-22b3-42e7-9ed8-8e3257057143-kubelet-config\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449358 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-cni-netd\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449390 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-os-release\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449425 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-run\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-var-lib-kubelet\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-var-lib-kubelet\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-host\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-run\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449516 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-os-release\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449539 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-host\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-daemon-config\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.450262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449562 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-var-lib-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-os-release\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovnkube-config\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449648 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-device-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449635 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-var-lib-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449677 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-tuned\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e43d40e2-8f1b-4115-95e2-610f903982af-serviceca\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqslp\" (UniqueName: \"kubernetes.io/projected/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-kube-api-access-rqslp\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-systemd-units\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-cni-bin\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-kubelet\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449874 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-run-netns\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-etc-selinux\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3955805c-5724-40a1-9a69-a5dd9d0d5f00-host-slash\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.449989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-cni-multus\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.451196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-kubernetes\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-systemd\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-cni-binary-copy\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg7ww\" (UniqueName: \"kubernetes.io/projected/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-kube-api-access-dg7ww\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3955805c-5724-40a1-9a69-a5dd9d0d5f00-iptables-alerter-script\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg7tr\" (UniqueName: \"kubernetes.io/projected/e43d40e2-8f1b-4115-95e2-610f903982af-kube-api-access-hg7tr\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-system-cni-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450214 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovnkube-config\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e43d40e2-8f1b-4115-95e2-610f903982af-serviceca\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450235 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450263 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqpzz\" (UniqueName: \"kubernetes.io/projected/61588f28-f089-43dc-8a25-11d0cfbe8c10-kube-api-access-lqpzz\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450292 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-cni-multus\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8388090f-d725-4d3d-996b-0981a649b5d8-konnectivity-ca\") pod \"konnectivity-agent-27zfs\" (UID: \"8388090f-d725-4d3d-996b-0981a649b5d8\") " pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysctl-conf\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450397 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-kubernetes\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.452031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450409 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-cni-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-conf-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450488 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-systemd-units\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-host-var-lib-cni-bin\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-kubelet\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450638 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-run-netns\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450639 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-systemd\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450699 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-conf-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450743 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-system-cni-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.450925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-cni-binary-copy\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.452965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.451016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-run-openvswitch\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.453467 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8388090f-d725-4d3d-996b-0981a649b5d8-konnectivity-ca\") pod \"konnectivity-agent-27zfs\" (UID: \"8388090f-d725-4d3d-996b-0981a649b5d8\") " pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.453526 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453462 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-tmp\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.453648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-tuned\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.453819 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453780 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-slash\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.453910 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.453971 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysconfig\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.454028 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.453973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61588f28-f089-43dc-8a25-11d0cfbe8c10-ovn-node-metrics-cert\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.454028 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-run-ovn-kubernetes\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.454131 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454119 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-run-ovn-kubernetes\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.454131 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454123 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysctl-conf\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.454254 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-etc-sysconfig\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.454254 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454233 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61588f28-f089-43dc-8a25-11d0cfbe8c10-host-slash\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.454358 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454255 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-multus-cni-dir\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.454861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.454839 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8388090f-d725-4d3d-996b-0981a649b5d8-agent-certs\") pod \"konnectivity-agent-27zfs\" (UID: \"8388090f-d725-4d3d-996b-0981a649b5d8\") " pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.457665 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.457643 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg7tr\" (UniqueName: \"kubernetes.io/projected/e43d40e2-8f1b-4115-95e2-610f903982af-kube-api-access-hg7tr\") pod \"node-ca-4v9fw\" (UID: \"e43d40e2-8f1b-4115-95e2-610f903982af\") " pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.460947 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.460926 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlsxp\" (UniqueName: \"kubernetes.io/projected/cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9-kube-api-access-xlsxp\") pod \"tuned-hjk6k\" (UID: \"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9\") " pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.462014 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.461985 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqpzz\" (UniqueName: \"kubernetes.io/projected/61588f28-f089-43dc-8a25-11d0cfbe8c10-kube-api-access-lqpzz\") pod \"ovnkube-node-cftkj\" (UID: \"61588f28-f089-43dc-8a25-11d0cfbe8c10\") " pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.462604 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.462563 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqslp\" (UniqueName: \"kubernetes.io/projected/39c18308-c3bd-4112-9e5d-7fcc6a91a68d-kube-api-access-rqslp\") pod \"multus-sdc2q\" (UID: \"39c18308-c3bd-4112-9e5d-7fcc6a91a68d\") " pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.494942 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.494885 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" event={"ID":"b4a2b1f1ab3d3c828e793f3e77e1a6f7","Type":"ContainerStarted","Data":"e88c87876f2f7c2f7979072cde3e26a59c69685c6da6103fd0cef1994906901b"} Jul 02 18:30:46.496194 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.496165 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" event={"ID":"130b89a92b4c7dd39a4bd94714e902bb","Type":"ContainerStarted","Data":"9850258624e4634433bc8f96c390f2277b9a1f02f91ab9e8d5a2301af5fbf382"} Jul 02 18:30:46.555313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-device-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.555476 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.555476 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-etc-selinux\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.555670 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555534 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-device-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.555670 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:46.555670 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3955805c-5724-40a1-9a69-a5dd9d0d5f00-host-slash\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.555670 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg7ww\" (UniqueName: \"kubernetes.io/projected/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-kube-api-access-dg7ww\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.555889 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.555889 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3955805c-5724-40a1-9a69-a5dd9d0d5f00-iptables-alerter-script\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.555889 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555736 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.555889 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556080 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.555906 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:46.556080 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3955805c-5724-40a1-9a69-a5dd9d0d5f00-host-slash\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.556080 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.555959 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-etc-selinux\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.556080 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.555990 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:47.05596594 +0000 UTC m=+3.052994457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:46.556080 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-cni-binary-copy\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556185 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-tmp-dir\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.556341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpv2d\" (UniqueName: \"kubernetes.io/projected/3955805c-5724-40a1-9a69-a5dd9d0d5f00-kube-api-access-lpv2d\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.556341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556293 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-socket-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.556341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556337 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-system-cni-dir\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh7lr\" (UniqueName: \"kubernetes.io/projected/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-kube-api-access-fh7lr\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-sys-fs\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556479 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556481 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-system-cni-dir\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-tmp-dir\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-cnibin\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556547 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-cnibin\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbznh\" (UniqueName: \"kubernetes.io/projected/faf56aa4-efb9-4af2-98be-fd3068a9e215-kube-api-access-nbznh\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556589 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74c57049-22b3-42e7-9ed8-8e3257057143-dbus\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnwkq\" (UniqueName: \"kubernetes.io/projected/12538438-5c29-4987-bd41-b0dfa2f3bd59-kube-api-access-fnwkq\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.556636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556633 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-socket-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-registration-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556666 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-sys-fs\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556683 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/74c57049-22b3-42e7-9ed8-8e3257057143-dbus\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-hosts-file\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/12538438-5c29-4987-bd41-b0dfa2f3bd59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556717 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3955805c-5724-40a1-9a69-a5dd9d0d5f00-iptables-alerter-script\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.556740 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.556789 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:47.056772203 +0000 UTC m=+3.053800709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556784 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74c57049-22b3-42e7-9ed8-8e3257057143-kubelet-config\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/74c57049-22b3-42e7-9ed8-8e3257057143-kubelet-config\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556847 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/faf56aa4-efb9-4af2-98be-fd3068a9e215-registration-dir\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-os-release\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-hosts-file\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.557313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.556924 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/12538438-5c29-4987-bd41-b0dfa2f3bd59-os-release\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.565570 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.565464 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:30:46.565570 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.565492 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:30:46.565570 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.565506 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:46.565806 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:46.565577 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:30:47.06555915 +0000 UTC m=+3.062587658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:46.569071 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.568644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnwkq\" (UniqueName: \"kubernetes.io/projected/12538438-5c29-4987-bd41-b0dfa2f3bd59-kube-api-access-fnwkq\") pod \"multus-additional-cni-plugins-s4hnp\" (UID: \"12538438-5c29-4987-bd41-b0dfa2f3bd59\") " pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.569071 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.568861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh7lr\" (UniqueName: \"kubernetes.io/projected/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-kube-api-access-fh7lr\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:46.569071 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.569053 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpv2d\" (UniqueName: \"kubernetes.io/projected/3955805c-5724-40a1-9a69-a5dd9d0d5f00-kube-api-access-lpv2d\") pod \"iptables-alerter-5fr7t\" (UID: \"3955805c-5724-40a1-9a69-a5dd9d0d5f00\") " pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.570472 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.570449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg7ww\" (UniqueName: \"kubernetes.io/projected/fb1140e8-6d0a-412f-90f9-a10dc88b32b8-kube-api-access-dg7ww\") pod \"node-resolver-w4tfr\" (UID: \"fb1140e8-6d0a-412f-90f9-a10dc88b32b8\") " pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.571706 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.571684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbznh\" (UniqueName: \"kubernetes.io/projected/faf56aa4-efb9-4af2-98be-fd3068a9e215-kube-api-access-nbznh\") pod \"aws-ebs-csi-driver-node-ggz7x\" (UID: \"faf56aa4-efb9-4af2-98be-fd3068a9e215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.635012 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.634980 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:30:46.648220 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.648200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" Jul 02 18:30:46.660487 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.660463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4v9fw" Jul 02 18:30:46.665369 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.665350 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sdc2q" Jul 02 18:30:46.675510 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.675485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:30:46.683331 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.683312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" Jul 02 18:30:46.699135 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.699104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4tfr" Jul 02 18:30:46.707132 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.707107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" Jul 02 18:30:46.713973 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.713954 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5fr7t" Jul 02 18:30:46.743056 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.743035 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 18:30:46.867863 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:46.867778 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 18:30:47.060695 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:47.060658 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:47.060917 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:47.060706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:47.060917 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.060829 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:47.060917 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.060866 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:47.060917 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.060900 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:48.060874795 +0000 UTC m=+4.057903287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:47.061160 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.060933 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:48.060917355 +0000 UTC m=+4.057945852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:47.161542 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:47.161455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:47.161719 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.161660 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:30:47.161719 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.161690 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:30:47.161719 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.161707 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:47.161920 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.161769 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:30:48.161751411 +0000 UTC m=+4.158779931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:47.377966 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:47.377923 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:25:46 +0000 UTC" deadline="2028-03-08 17:54:55.975059034 +0000 UTC" Jul 02 18:30:47.377966 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:47.377961 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14759h24m8.597102925s" Jul 02 18:30:47.490693 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:47.490578 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:47.490859 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:47.490726 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:47.595342 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.595295 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c18308_c3bd_4112_9e5d_7fcc6a91a68d.slice/crio-13150cc399491450958c2c0566d6325b21a752571ab496b097f434bf44d579ca WatchSource:0}: Error finding container 13150cc399491450958c2c0566d6325b21a752571ab496b097f434bf44d579ca: Status 404 returned error can't find the container with id 13150cc399491450958c2c0566d6325b21a752571ab496b097f434bf44d579ca Jul 02 18:30:47.598117 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.598091 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbac3ee6_b584_49eb_8cb8_fab4f7cbb4d9.slice/crio-8487bca878c04e70828ce9512f3007717b81c0a2114d025e69459310131f8600 WatchSource:0}: Error finding container 8487bca878c04e70828ce9512f3007717b81c0a2114d025e69459310131f8600: Status 404 returned error can't find the container with id 8487bca878c04e70828ce9512f3007717b81c0a2114d025e69459310131f8600 Jul 02 18:30:47.601906 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.601884 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12538438_5c29_4987_bd41_b0dfa2f3bd59.slice/crio-704fddeae30363bd890b4c86186ad4ceb7825a756ca6645e0ccb2024e98d29d4 WatchSource:0}: Error finding container 704fddeae30363bd890b4c86186ad4ceb7825a756ca6645e0ccb2024e98d29d4: Status 404 returned error can't find the container with id 704fddeae30363bd890b4c86186ad4ceb7825a756ca6645e0ccb2024e98d29d4 Jul 02 18:30:47.602675 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.602599 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3955805c_5724_40a1_9a69_a5dd9d0d5f00.slice/crio-1170ec81cf168588941d31f6dcb351fba85ae413463b86a4543678fc4b60044b WatchSource:0}: Error finding container 1170ec81cf168588941d31f6dcb351fba85ae413463b86a4543678fc4b60044b: Status 404 returned error can't find the container with id 1170ec81cf168588941d31f6dcb351fba85ae413463b86a4543678fc4b60044b Jul 02 18:30:47.627087 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.627064 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43d40e2_8f1b_4115_95e2_610f903982af.slice/crio-bcf349a84813b2867f36722fa44a0ab56af33ff71322118a064179e655f2a43d WatchSource:0}: Error finding container bcf349a84813b2867f36722fa44a0ab56af33ff71322118a064179e655f2a43d: Status 404 returned error can't find the container with id bcf349a84813b2867f36722fa44a0ab56af33ff71322118a064179e655f2a43d Jul 02 18:30:47.628104 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.628077 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf56aa4_efb9_4af2_98be_fd3068a9e215.slice/crio-1c138445f7a006a57a9360e69ce5c00e77648fc828f39b35e16b67f621d01995 WatchSource:0}: Error finding container 1c138445f7a006a57a9360e69ce5c00e77648fc828f39b35e16b67f621d01995: Status 404 returned error can't find the container with id 1c138445f7a006a57a9360e69ce5c00e77648fc828f39b35e16b67f621d01995 Jul 02 18:30:47.628612 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.628520 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61588f28_f089_43dc_8a25_11d0cfbe8c10.slice/crio-ad1045eaee98af1d4ef4916b761355b00c569e0ec76e35a776c924fd6829c8c3 WatchSource:0}: Error finding container ad1045eaee98af1d4ef4916b761355b00c569e0ec76e35a776c924fd6829c8c3: Status 404 returned error can't find the container with id ad1045eaee98af1d4ef4916b761355b00c569e0ec76e35a776c924fd6829c8c3 Jul 02 18:30:47.629492 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.629435 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8388090f_d725_4d3d_996b_0981a649b5d8.slice/crio-600780ac7c54d535e95eced5aec951d0c0995fe47c821cca1e3cd820585d2fd6 WatchSource:0}: Error finding container 600780ac7c54d535e95eced5aec951d0c0995fe47c821cca1e3cd820585d2fd6: Status 404 returned error can't find the container with id 600780ac7c54d535e95eced5aec951d0c0995fe47c821cca1e3cd820585d2fd6 Jul 02 18:30:47.631162 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:30:47.631143 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1140e8_6d0a_412f_90f9_a10dc88b32b8.slice/crio-1160a07fcaf59d1caa3d06452a09da47e5f1c4e269a0071bbb2bc74ef9513ae8 WatchSource:0}: Error finding container 1160a07fcaf59d1caa3d06452a09da47e5f1c4e269a0071bbb2bc74ef9513ae8: Status 404 returned error can't find the container with id 1160a07fcaf59d1caa3d06452a09da47e5f1c4e269a0071bbb2bc74ef9513ae8 Jul 02 18:30:48.068742 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.068418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:48.068742 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.068730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:48.068742 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.068595 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:48.069059 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.068847 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:50.068820248 +0000 UTC m=+6.065848754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:48.069059 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.068943 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:48.069059 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.068992 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:50.068979726 +0000 UTC m=+6.066008239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:48.170946 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.170162 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:48.170946 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.170380 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:30:48.170946 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.170404 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:30:48.170946 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.170417 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:48.170946 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.170477 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:30:50.170457816 +0000 UTC m=+6.167486322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:48.378786 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.378715 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:25:46 +0000 UTC" deadline="2028-01-16 08:27:54.804586472 +0000 UTC" Jul 02 18:30:48.379468 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.378784 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13501h57m6.425807366s" Jul 02 18:30:48.493743 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.492982 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:48.493743 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.493116 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:48.493743 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.493526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:48.493743 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:48.493619 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:48.515714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.515428 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4tfr" event={"ID":"fb1140e8-6d0a-412f-90f9-a10dc88b32b8","Type":"ContainerStarted","Data":"1160a07fcaf59d1caa3d06452a09da47e5f1c4e269a0071bbb2bc74ef9513ae8"} Jul 02 18:30:48.538350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.538271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" event={"ID":"faf56aa4-efb9-4af2-98be-fd3068a9e215","Type":"ContainerStarted","Data":"1c138445f7a006a57a9360e69ce5c00e77648fc828f39b35e16b67f621d01995"} Jul 02 18:30:48.555964 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.554756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerStarted","Data":"704fddeae30363bd890b4c86186ad4ceb7825a756ca6645e0ccb2024e98d29d4"} Jul 02 18:30:48.565877 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.565163 2579 generic.go:356] "Generic (PLEG): container finished" podID="130b89a92b4c7dd39a4bd94714e902bb" containerID="897164df1bb55b6b3a060eb85d5ab7eda760ee4f468f9636f502bab968451d16" exitCode=0 Jul 02 18:30:48.565877 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.565248 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" event={"ID":"130b89a92b4c7dd39a4bd94714e902bb","Type":"ContainerDied","Data":"897164df1bb55b6b3a060eb85d5ab7eda760ee4f468f9636f502bab968451d16"} Jul 02 18:30:48.579043 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.578739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" event={"ID":"b4a2b1f1ab3d3c828e793f3e77e1a6f7","Type":"ContainerStarted","Data":"c8d0463229aefccb24bf0ba71ca2791a9d3f819607cd094ad92e2df014e8d43d"} Jul 02 18:30:48.583990 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.583931 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-27zfs" event={"ID":"8388090f-d725-4d3d-996b-0981a649b5d8","Type":"ContainerStarted","Data":"600780ac7c54d535e95eced5aec951d0c0995fe47c821cca1e3cd820585d2fd6"} Jul 02 18:30:48.590117 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.590088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"ad1045eaee98af1d4ef4916b761355b00c569e0ec76e35a776c924fd6829c8c3"} Jul 02 18:30:48.615940 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.615910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4v9fw" event={"ID":"e43d40e2-8f1b-4115-95e2-610f903982af","Type":"ContainerStarted","Data":"bcf349a84813b2867f36722fa44a0ab56af33ff71322118a064179e655f2a43d"} Jul 02 18:30:48.628349 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.628318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fr7t" event={"ID":"3955805c-5724-40a1-9a69-a5dd9d0d5f00","Type":"ContainerStarted","Data":"1170ec81cf168588941d31f6dcb351fba85ae413463b86a4543678fc4b60044b"} Jul 02 18:30:48.644555 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.644456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" event={"ID":"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9","Type":"ContainerStarted","Data":"8487bca878c04e70828ce9512f3007717b81c0a2114d025e69459310131f8600"} Jul 02 18:30:48.654524 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:48.654496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sdc2q" event={"ID":"39c18308-c3bd-4112-9e5d-7fcc6a91a68d","Type":"ContainerStarted","Data":"13150cc399491450958c2c0566d6325b21a752571ab496b097f434bf44d579ca"} Jul 02 18:30:49.490043 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:49.490007 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:49.490551 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:49.490165 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:49.692916 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:49.692839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" event={"ID":"130b89a92b4c7dd39a4bd94714e902bb","Type":"ContainerStarted","Data":"2a74fcd60db863047d2744b23d2022866bf7bd004a3e88209a9ee983e5880055"} Jul 02 18:30:49.710103 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:49.710031 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-219.ec2.internal" podStartSLOduration=4.709982206 podStartE2EDuration="4.709982206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:30:48.59813175 +0000 UTC m=+4.595160266" watchObservedRunningTime="2026-07-02 18:30:49.709982206 +0000 UTC m=+5.707010720" Jul 02 18:30:50.088067 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:50.086464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:50.088067 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:50.086534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:50.088067 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.086685 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:50.088067 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.086754 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:54.086732389 +0000 UTC m=+10.083760906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:50.088067 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.087221 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:50.088067 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.087279 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:30:54.087262356 +0000 UTC m=+10.084290853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:50.188218 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:50.187537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:50.188218 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.187722 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:30:50.188218 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.187745 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:30:50.188218 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.187758 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:50.188218 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.187839 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:30:54.187802188 +0000 UTC m=+10.184830701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:50.493166 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:50.493082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:50.493883 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.493231 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:50.493883 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:50.493636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:50.493883 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:50.493727 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:51.490464 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:51.490431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:51.490658 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:51.490571 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:52.490269 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:52.490009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:52.490269 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:52.490150 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:52.490803 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:52.490621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:52.490803 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:52.490722 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:53.491434 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:53.490899 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:53.491434 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:53.491053 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:54.119564 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:54.119485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:54.119564 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:54.119543 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:54.119815 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.119651 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:54.119815 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.119654 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:54.119815 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.119716 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:02.119696302 +0000 UTC m=+18.116724794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:30:54.119815 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.119734 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:02.119725041 +0000 UTC m=+18.116753531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:30:54.220484 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:54.220450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:54.220680 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.220658 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:30:54.220752 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.220685 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:30:54.220752 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.220695 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:54.220752 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.220752 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:31:02.220733161 +0000 UTC m=+18.217761663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:30:54.491880 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:54.491847 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:54.492333 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:54.492015 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:54.492333 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.492126 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:54.492333 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:54.492005 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:55.490181 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:55.490147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:55.490355 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:55.490305 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:56.490766 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:56.490689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:56.491221 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:56.490825 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:56.491221 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:56.491211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:56.491354 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:56.491304 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:57.490473 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:57.490442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:57.490636 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:57.490585 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:30:58.490385 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:58.490358 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:30:58.490738 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:58.490366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:30:58.490738 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:58.490463 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:30:58.490738 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:58.490556 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:30:59.490912 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:30:59.490868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:30:59.491363 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:30:59.491012 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:00.490702 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:00.490619 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:00.490909 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:00.490755 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:00.490909 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:00.490805 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:00.490909 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:00.490887 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:01.490276 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:01.490244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:01.490498 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:01.490363 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:02.189891 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:02.189857 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:02.190321 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:02.189911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:02.190321 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.190027 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:31:02.190321 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.190035 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:31:02.190321 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.190077 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:18.190063072 +0000 UTC m=+34.187091562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:31:02.190321 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.190091 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:18.190084655 +0000 UTC m=+34.187113144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:31:02.290884 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:02.290846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:02.291035 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.291011 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:31:02.291035 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.291034 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:31:02.291098 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.291044 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:31:02.291098 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.291093 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:31:18.291079987 +0000 UTC m=+34.288108477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:31:02.490313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:02.490211 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:02.490462 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.490331 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:02.490462 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:02.490397 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:02.490552 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:02.490484 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:03.489958 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:03.489921 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:03.490412 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:03.490046 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:04.490773 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:04.490735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:04.491254 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:04.490898 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:04.491254 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:04.490942 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:04.491254 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:04.491017 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:05.490262 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:05.490230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:05.490426 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:05.490357 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:06.490642 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.490406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:06.490642 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:06.490519 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:06.490642 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.490411 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:06.490642 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:06.490614 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:06.729568 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.729532 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"fa9f2f08a168420e63bcfe404d495ba221902ded148ecc1b015e17b931ecab34"} Jul 02 18:31:06.729707 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.729680 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"b283d86944055d78d32fb7eb3ce2300d6d4ac259187a1e6cc548564e7fefab57"} Jul 02 18:31:06.730951 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.730927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4v9fw" event={"ID":"e43d40e2-8f1b-4115-95e2-610f903982af","Type":"ContainerStarted","Data":"4e18f097f3fccaccdf7698b0c6ee11111e28ffc0afa9cfe8a56de68f8a4bb062"} Jul 02 18:31:06.733550 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.733093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" event={"ID":"cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9","Type":"ContainerStarted","Data":"f7f49c03a0f2a6dd59ae93aaf7b0a4db1a9158369825657b7fdcf0366423939d"} Jul 02 18:31:06.734832 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.734805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sdc2q" event={"ID":"39c18308-c3bd-4112-9e5d-7fcc6a91a68d","Type":"ContainerStarted","Data":"7375ecb447640a0f6924d3daeec9127507df3562e7c9e95ff044940451b5ef78"} Jul 02 18:31:06.736248 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.736219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4tfr" event={"ID":"fb1140e8-6d0a-412f-90f9-a10dc88b32b8","Type":"ContainerStarted","Data":"1cd711f36e8408dc5d802219ae2360c5f5ab55df008e679a1571501ca606493d"} Jul 02 18:31:06.737871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.737824 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" event={"ID":"faf56aa4-efb9-4af2-98be-fd3068a9e215","Type":"ContainerStarted","Data":"927b9c40cb35cf9950ba5604f62f0aa9fc711fbfdd8f77ca9702b5df8b0e8a8b"} Jul 02 18:31:06.740062 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.739971 2579 generic.go:356] "Generic (PLEG): container finished" podID="12538438-5c29-4987-bd41-b0dfa2f3bd59" containerID="99279ddb3897b88a3fd5d449539adad10cb01a44cd4b0274d6a927467fb24b5e" exitCode=0 Jul 02 18:31:06.740157 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.740063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerDied","Data":"99279ddb3897b88a3fd5d449539adad10cb01a44cd4b0274d6a927467fb24b5e"} Jul 02 18:31:06.742295 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.742155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-27zfs" event={"ID":"8388090f-d725-4d3d-996b-0981a649b5d8","Type":"ContainerStarted","Data":"20915afb867ff198c75b551d09256f83cebb7bca603557bfa3b1575c069e183e"} Jul 02 18:31:06.755640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.755498 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-219.ec2.internal" podStartSLOduration=21.755484066 podStartE2EDuration="21.755484066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:30:49.71163755 +0000 UTC m=+5.708666068" watchObservedRunningTime="2026-07-02 18:31:06.755484066 +0000 UTC m=+22.752512579" Jul 02 18:31:06.755795 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.755684 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sdc2q" podStartSLOduration=2.882844264 podStartE2EDuration="21.755676335s" totalImagesPullingTime="18.872832071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:06.755007621 +0000 UTC m=+22.752036158" watchObservedRunningTime="2026-07-02 18:31:06.755676335 +0000 UTC m=+22.752704849" Jul 02 18:31:06.788254 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.788211 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-27zfs" podStartSLOduration=3.034302469 podStartE2EDuration="21.788194094s" totalImagesPullingTime="18.753891625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:06.787625036 +0000 UTC m=+22.784653551" watchObservedRunningTime="2026-07-02 18:31:06.788194094 +0000 UTC m=+22.785222606" Jul 02 18:31:06.800708 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.800641 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4v9fw" podStartSLOduration=3.013123415 podStartE2EDuration="21.800622211s" totalImagesPullingTime="18.787498796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:06.800260349 +0000 UTC m=+22.797288862" watchObservedRunningTime="2026-07-02 18:31:06.800622211 +0000 UTC m=+22.797650724" Jul 02 18:31:06.817843 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.817801 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w4tfr" podStartSLOduration=3.030056161 podStartE2EDuration="21.817763329s" totalImagesPullingTime="18.787707168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:06.817649563 +0000 UTC m=+22.814678076" watchObservedRunningTime="2026-07-02 18:31:06.817763329 +0000 UTC m=+22.814791841" Jul 02 18:31:06.900546 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.900501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:06.975419 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:06.975393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:07.490070 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.490039 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:07.490243 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:07.490180 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:07.748149 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748121 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:31:07.748993 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748485 2579 generic.go:356] "Generic (PLEG): container finished" podID="61588f28-f089-43dc-8a25-11d0cfbe8c10" containerID="fa9f2f08a168420e63bcfe404d495ba221902ded148ecc1b015e17b931ecab34" exitCode=1 Jul 02 18:31:07.748993 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerDied","Data":"fa9f2f08a168420e63bcfe404d495ba221902ded148ecc1b015e17b931ecab34"} Jul 02 18:31:07.748993 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748663 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"c86057bc3c93fc26563d103b844caa337893e09352dd9899e8c69bf605f6bf4b"} Jul 02 18:31:07.748993 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"f21e2c4b7e431fad5039894cf3dbefe14c46033997017bb8c06f047444881da7"} Jul 02 18:31:07.748993 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"0963429864f8dffca3e05c20770f0f0e8c829c18face4710db034888e145614c"} Jul 02 18:31:07.748993 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.748800 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"b9bf2c4c08d2eb02126f581fe228ddcb06c878e7b8b9669b06b7933cebca2283"} Jul 02 18:31:07.976911 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:07.976887 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 18:31:08.397270 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.397133 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T18:31:07.976905961Z","UUID":"9ed98941-073e-4c1e-9bf7-a8e84eca2c75","Handler":null,"Name":"","Endpoint":""} Jul 02 18:31:08.399043 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.399011 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 18:31:08.399164 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.399053 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 18:31:08.490352 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.490012 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:08.490352 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.490056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:08.490352 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:08.490165 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:08.490644 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:08.490562 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:08.754306 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.754271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" event={"ID":"faf56aa4-efb9-4af2-98be-fd3068a9e215","Type":"ContainerStarted","Data":"ee2136df95a544ed168d06a4c40a3d03d0a3929739e226c131d23d6400616317"} Jul 02 18:31:08.756140 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.756113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5fr7t" event={"ID":"3955805c-5724-40a1-9a69-a5dd9d0d5f00","Type":"ContainerStarted","Data":"5264f57dbd16ae47d26c98858267da65b9deabd900d3c2e2e33f193de5351176"} Jul 02 18:31:08.771809 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.771742 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5fr7t" podStartSLOduration=4.983865625 podStartE2EDuration="23.771722567s" totalImagesPullingTime="18.787856942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:08.771682848 +0000 UTC m=+24.768711365" watchObservedRunningTime="2026-07-02 18:31:08.771722567 +0000 UTC m=+24.768751083" Jul 02 18:31:08.771952 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.771920 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hjk6k" podStartSLOduration=4.937177688 podStartE2EDuration="23.771911413s" totalImagesPullingTime="18.834733725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:06.843698674 +0000 UTC m=+22.840727186" watchObservedRunningTime="2026-07-02 18:31:08.771911413 +0000 UTC m=+24.768939951" Jul 02 18:31:08.908041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:08.907996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:09.002996 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:09.002956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:09.490987 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:09.490802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:09.491155 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:09.491080 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:09.760351 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:09.760273 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" event={"ID":"faf56aa4-efb9-4af2-98be-fd3068a9e215","Type":"ContainerStarted","Data":"2bf0f0fe4e7c316b24783ef5359419c03a9e6ee4190ac81b27afc513e7567864"} Jul 02 18:31:09.779429 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:09.779373 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ggz7x" podStartSLOduration=3.615321693 podStartE2EDuration="24.779358635s" totalImagesPullingTime="21.164036942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:09.778699808 +0000 UTC m=+25.775728319" watchObservedRunningTime="2026-07-02 18:31:09.779358635 +0000 UTC m=+25.776387145" Jul 02 18:31:09.886345 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:09.886310 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:09.988245 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:09.988210 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:10.081573 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.081496 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:10.283081 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.283045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:10.345085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.345006 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:10.481165 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.481128 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:31:10.481756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.481739 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:31:10.494243 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.494223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:10.494398 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.494223 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:10.494398 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:10.494330 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:10.494525 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:10.494434 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:10.762750 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.762716 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:31:10.763172 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.763122 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-27zfs" Jul 02 18:31:10.855005 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:10.854970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:11.333365 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:11.333339 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4tfr_fb1140e8-6d0a-412f-90f9-a10dc88b32b8/dns-node-resolver/0.log" Jul 02 18:31:11.490764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:11.490736 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:11.490920 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:11.490853 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:11.766227 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:11.766154 2579 generic.go:356] "Generic (PLEG): container finished" podID="12538438-5c29-4987-bd41-b0dfa2f3bd59" containerID="4bd203101d9da3b884c9072e315ccfa6d97576bdb8868f07afbcafd409d7b5a8" exitCode=0 Jul 02 18:31:11.766917 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:11.766230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerDied","Data":"4bd203101d9da3b884c9072e315ccfa6d97576bdb8868f07afbcafd409d7b5a8"} Jul 02 18:31:11.769254 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:11.769239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:31:11.769581 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:11.769558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"db11ab4acfeba5ff3d9555875934f912249779107d134e85d56b1529d6d26a30"} Jul 02 18:31:12.134213 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:12.134143 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v9fw_e43d40e2-8f1b-4115-95e2-610f903982af/node-ca/0.log" Jul 02 18:31:12.490610 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:12.490570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:12.490812 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:12.490625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:12.490812 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:12.490713 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:12.490943 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:12.490855 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:12.773424 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:12.773399 2579 generic.go:356] "Generic (PLEG): container finished" podID="12538438-5c29-4987-bd41-b0dfa2f3bd59" containerID="a8b3f84059c4a676e66766259370c2959f57dd0e401675b5ce380051475dd371" exitCode=0 Jul 02 18:31:12.773831 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:12.773427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerDied","Data":"a8b3f84059c4a676e66766259370c2959f57dd0e401675b5ce380051475dd371"} Jul 02 18:31:13.414933 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.414673 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:13.490138 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.490111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:13.490294 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:13.490222 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:13.778586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.778558 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:31:13.779058 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.778886 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"f7b667c33584dcc4e6b473caecc6f05e1c709c57aec9e66158f120d9573f1ed2"} Jul 02 18:31:13.779291 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.779264 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:31:13.779404 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.779390 2579 scope.go:117] "RemoveContainer" containerID="fa9f2f08a168420e63bcfe404d495ba221902ded148ecc1b015e17b931ecab34" Jul 02 18:31:13.794526 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.794505 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:31:13.848977 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.848945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:13.949007 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:13.948973 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:14.133041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.132955 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:14.235558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.235521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:14.490875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.490838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:14.491133 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:14.490943 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:14.491133 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.490979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:14.491133 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:14.491044 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:14.783607 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.783528 2579 generic.go:356] "Generic (PLEG): container finished" podID="12538438-5c29-4987-bd41-b0dfa2f3bd59" containerID="e17944dbb43ed88acaf45f83334231f62245995879da8b4f88be62a26e6f3f31" exitCode=0 Jul 02 18:31:14.784042 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.783632 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerDied","Data":"e17944dbb43ed88acaf45f83334231f62245995879da8b4f88be62a26e6f3f31"} Jul 02 18:31:14.788681 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.788662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:31:14.789424 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.789281 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" event={"ID":"61588f28-f089-43dc-8a25-11d0cfbe8c10","Type":"ContainerStarted","Data":"6520bf27dbd57e51016d4a017f3add2d9c25fc572378af23b023d1039d186650"} Jul 02 18:31:14.789631 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.789591 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:31:14.789717 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.789672 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:31:14.807415 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.807388 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:31:14.828861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.828802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" podStartSLOduration=10.978965611 podStartE2EDuration="29.828764976s" totalImagesPullingTime="18.849799365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:14.828452703 +0000 UTC m=+30.825481230" watchObservedRunningTime="2026-07-02 18:31:14.828764976 +0000 UTC m=+30.825793534" Jul 02 18:31:14.866156 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:14.866126 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:15.071163 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.070920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zx6n4"] Jul 02 18:31:15.071315 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.071242 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:15.071366 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:15.071339 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:15.075723 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.075297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bgr8t"] Jul 02 18:31:15.075723 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.075489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:15.075723 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:15.075627 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:15.078255 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.076840 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gm98z"] Jul 02 18:31:15.078255 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.077029 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:15.078255 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:15.077180 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:15.754610 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.754560 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:15.960841 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:15.960768 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:16.490925 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:16.490892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:16.491118 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:16.491040 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:16.643964 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:16.643928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:16.744136 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:16.744047 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:16.831859 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:16.831805 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:17.269982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.269943 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:17.370524 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.370482 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:17.470433 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.470398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:17.490617 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.490591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:17.490617 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.490611 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:17.490860 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:17.490718 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:17.490928 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:17.490859 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:17.598677 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.598598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:17.677884 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.677839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:17.773123 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:17.773076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:18.201756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:18.201727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:18.201943 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:18.201816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:18.201943 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.201918 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:31:18.202053 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.201996 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs podName:a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:50.201971504 +0000 UTC m=+66.199000000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs") pod "network-metrics-daemon-gm98z" (UID: "a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 18:31:18.202053 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.201925 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 18:31:18.202148 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.202073 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret podName:74c57049-22b3-42e7-9ed8-8e3257057143 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:50.202054726 +0000 UTC m=+66.199083218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret") pod "global-pull-secret-syncer-zx6n4" (UID: "74c57049-22b3-42e7-9ed8-8e3257057143") : object "kube-system"/"original-pull-secret" not registered Jul 02 18:31:18.267534 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:18.267501 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:18.302666 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:18.302634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:18.303209 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.302845 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 18:31:18.303209 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.302864 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 18:31:18.303209 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.302874 2579 projected.go:196] Error preparing data for projected volume kube-api-access-4btws for pod openshift-network-diagnostics/network-check-target-bgr8t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:31:18.303209 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.302934 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws podName:fd000e81-7047-4324-a533-2424973d8b1e nodeName:}" failed. No retries permitted until 2026-07-02 18:31:50.302919648 +0000 UTC m=+66.299948138 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4btws" (UniqueName: "kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws") pod "network-check-target-bgr8t" (UID: "fd000e81-7047-4324-a533-2424973d8b1e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 18:31:18.490098 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:18.490010 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:18.490258 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:18.490157 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:18.894420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:18.894339 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:19.482330 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.482296 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:19.490081 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.490058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:19.490227 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.490059 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:19.490227 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:19.490154 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:19.490227 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:19.490211 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:19.656713 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.656633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:19.761226 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.761192 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:19.803880 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.803845 2579 generic.go:356] "Generic (PLEG): container finished" podID="12538438-5c29-4987-bd41-b0dfa2f3bd59" containerID="a83e3d3908f3f5b6b5c8a892c570c96fa9f045ec219a9e4814fb48aa37e75669" exitCode=0 Jul 02 18:31:19.804039 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.803907 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerDied","Data":"a83e3d3908f3f5b6b5c8a892c570c96fa9f045ec219a9e4814fb48aa37e75669"} Jul 02 18:31:19.879043 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:19.879010 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:20.081408 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:20.081381 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:20.490240 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:20.490209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:20.490605 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:20.490349 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:20.670746 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:20.670701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:20.809214 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:20.809112 2579 generic.go:356] "Generic (PLEG): container finished" podID="12538438-5c29-4987-bd41-b0dfa2f3bd59" containerID="3735a67ef09686c4ad38b96f7b09c5aa376e519190ff6c55d588a8c390fb5cc2" exitCode=0 Jul 02 18:31:20.809214 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:20.809167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerDied","Data":"3735a67ef09686c4ad38b96f7b09c5aa376e519190ff6c55d588a8c390fb5cc2"} Jul 02 18:31:20.875158 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:20.875124 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:21.126110 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.126023 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:21.265318 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.265287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:21.463678 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.463648 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:21.490332 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.490309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:21.490728 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:21.490399 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:21.490728 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.490452 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:21.490728 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:21.490532 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:21.665486 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.665455 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:21.814688 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.814608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" event={"ID":"12538438-5c29-4987-bd41-b0dfa2f3bd59","Type":"ContainerStarted","Data":"98e37549f72e69dcadd332e452e8cd0525fe97d58bad449e296043ac5b6ca1de"} Jul 02 18:31:21.837021 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.836971 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s4hnp" podStartSLOduration=7.257701658 podStartE2EDuration="36.83695106s" totalImagesPullingTime="29.579249402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:21.836188923 +0000 UTC m=+37.833217447" watchObservedRunningTime="2026-07-02 18:31:21.83695106 +0000 UTC m=+37.833979573" Jul 02 18:31:21.868012 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.867984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:21.927438 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:21.927399 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:22.088953 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:22.088866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:22.490207 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:22.490021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:22.490395 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:22.490286 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:23.072042 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.072009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:23.175665 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.175621 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:23.277128 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.277088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:23.472572 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.472547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:23.490450 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.490427 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:23.490872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.490430 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:23.490872 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:23.490517 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:23.490872 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:23.490630 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:23.672326 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.672293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:23.776014 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.775928 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:23.871535 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:23.871502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:24.062796 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:24.062696 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:24.296230 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:24.296193 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:24.490708 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:24.490683 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:24.491094 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:24.490772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:25.263022 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:25.262992 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:25.459927 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:25.459885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:25.490576 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:25.490548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:25.490701 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:25.490555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:25.490701 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:25.490639 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:25.491012 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:25.490700 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:25.664861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:25.664758 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:25.859564 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:25.859533 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:26.064767 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:26.064730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:26.490283 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:26.490253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:26.490437 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:26.490390 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:27.068492 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:27.068459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:27.467013 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:27.466979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:27.489990 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:27.489967 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:27.490095 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:27.490077 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:27.490155 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:27.490138 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:27.490249 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:27.490231 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:27.665120 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:27.665089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:27.867797 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:27.867693 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:28.067688 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:28.067654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:28.490794 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:28.490764 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:28.491176 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:28.490879 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:29.490692 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:29.490663 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:29.490878 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:29.490665 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:29.490878 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:29.490763 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:29.490878 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:29.490843 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:30.490119 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:30.490090 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:30.490336 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:30.490197 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:31.490201 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:31.490166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:31.490640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:31.490166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:31.490640 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:31.490292 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:31.490640 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:31.490331 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:31.708499 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:31.708430 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:31.764032 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:31.763965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:32.490548 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:32.490515 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:32.490933 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:32.490652 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:33.490273 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:33.490245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:33.490439 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:33.490245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:33.490439 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:33.490337 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:33.490439 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:33.490412 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:34.490747 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:34.490716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:34.491121 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:34.490830 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gm98z" podUID="a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0" Jul 02 18:31:35.490554 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:35.490522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:35.490554 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:35.490542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:35.490824 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:35.490632 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bgr8t" podUID="fd000e81-7047-4324-a533-2424973d8b1e" Jul 02 18:31:35.490824 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:35.490737 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zx6n4" podUID="74c57049-22b3-42e7-9ed8-8e3257057143" Jul 02 18:31:35.708615 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:35.708582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:35.807521 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:35.807438 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:35.924855 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:35.924823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:36.050018 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.049980 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:36.277204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.277183 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-219.ec2.internal" event="NodeReady" Jul 02 18:31:36.277369 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.277307 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 18:31:36.328705 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.328680 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-czxh9"] Jul 02 18:31:36.349829 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.349802 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z27rs"] Jul 02 18:31:36.350000 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.349878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.351926 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.351904 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 18:31:36.352035 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.351905 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 18:31:36.352035 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.351906 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xnjsw\"" Jul 02 18:31:36.369992 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.369972 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-czxh9"] Jul 02 18:31:36.370099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.370010 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z27rs"] Jul 02 18:31:36.370164 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.370118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.372036 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.372012 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 18:31:36.372036 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.372032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 18:31:36.372184 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.372056 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5tcqj\"" Jul 02 18:31:36.372324 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.372310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 18:31:36.372393 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.372373 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 18:31:36.436246 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.436215 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ks472"] Jul 02 18:31:36.440720 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.440859 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440730 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz4gs\" (UniqueName: \"kubernetes.io/projected/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-kube-api-access-gz4gs\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.440859 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440752 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-crio-socket\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.440859 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-data-volume\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.441025 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-tmp-dir\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.441025 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7rnp\" (UniqueName: \"kubernetes.io/projected/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-kube-api-access-f7rnp\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.441025 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.440972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-metrics-tls\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.441142 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.441038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-config-volume\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.441142 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.441084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.453877 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.453857 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ks472"] Jul 02 18:31:36.453972 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.453943 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.457590 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.456453 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 18:31:36.457590 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.456669 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 18:31:36.457590 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.456840 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 18:31:36.457590 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.456925 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-82lp6\"" Jul 02 18:31:36.478792 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.478741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:36.489962 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.489940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:36.492655 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.492634 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86j9v\"" Jul 02 18:31:36.492999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.492744 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 18:31:36.541951 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.541884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd384d57-9fbc-4b80-b662-d8c8732ad4d5-cert\") pod \"ingress-canary-ks472\" (UID: \"fd384d57-9fbc-4b80-b662-d8c8732ad4d5\") " pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.541951 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.541929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.541956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl92x\" (UniqueName: \"kubernetes.io/projected/fd384d57-9fbc-4b80-b662-d8c8732ad4d5-kube-api-access-dl92x\") pod \"ingress-canary-ks472\" (UID: \"fd384d57-9fbc-4b80-b662-d8c8732ad4d5\") " pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.542154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542134 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz4gs\" (UniqueName: \"kubernetes.io/projected/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-kube-api-access-gz4gs\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.542299 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-crio-socket\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542299 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-data-volume\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542299 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542266 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-tmp-dir\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.542442 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7rnp\" (UniqueName: \"kubernetes.io/projected/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-kube-api-access-f7rnp\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542442 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-metrics-tls\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.542442 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542369 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-crio-socket\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542442 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542392 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-config-volume\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.542639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-data-volume\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.542639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-tmp-dir\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.542936 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.543015 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.542944 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-config-volume\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.546158 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.546139 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-metrics-tls\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.546244 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.546206 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.546657 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.546633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:36.549013 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.548989 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7rnp\" (UniqueName: \"kubernetes.io/projected/ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428-kube-api-access-f7rnp\") pod \"insights-runtime-extractor-z27rs\" (UID: \"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428\") " pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.549295 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.549280 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz4gs\" (UniqueName: \"kubernetes.io/projected/0bd8cbe5-fd87-4dc6-a247-d052bcb199b6-kube-api-access-gz4gs\") pod \"dns-default-czxh9\" (UID: \"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6\") " pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.643498 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.643463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd384d57-9fbc-4b80-b662-d8c8732ad4d5-cert\") pod \"ingress-canary-ks472\" (UID: \"fd384d57-9fbc-4b80-b662-d8c8732ad4d5\") " pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.643627 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.643513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl92x\" (UniqueName: \"kubernetes.io/projected/fd384d57-9fbc-4b80-b662-d8c8732ad4d5-kube-api-access-dl92x\") pod \"ingress-canary-ks472\" (UID: \"fd384d57-9fbc-4b80-b662-d8c8732ad4d5\") " pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.645798 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.645763 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd384d57-9fbc-4b80-b662-d8c8732ad4d5-cert\") pod \"ingress-canary-ks472\" (UID: \"fd384d57-9fbc-4b80-b662-d8c8732ad4d5\") " pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.651576 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.651555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl92x\" (UniqueName: \"kubernetes.io/projected/fd384d57-9fbc-4b80-b662-d8c8732ad4d5-kube-api-access-dl92x\") pod \"ingress-canary-ks472\" (UID: \"fd384d57-9fbc-4b80-b662-d8c8732ad4d5\") " pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.659417 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.659396 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:36.678546 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.678527 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z27rs" Jul 02 18:31:36.769899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.766388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ks472" Jul 02 18:31:36.845003 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.844545 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-czxh9"] Jul 02 18:31:36.850380 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:36.850352 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd8cbe5_fd87_4dc6_a247_d052bcb199b6.slice/crio-ca2886486cd4197e71a05559f712b3e8b8cf683cfb5f17d4449517b689e469f3 WatchSource:0}: Error finding container ca2886486cd4197e71a05559f712b3e8b8cf683cfb5f17d4449517b689e469f3: Status 404 returned error can't find the container with id ca2886486cd4197e71a05559f712b3e8b8cf683cfb5f17d4449517b689e469f3 Jul 02 18:31:36.858157 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.858095 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z27rs"] Jul 02 18:31:36.862514 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:36.862492 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8ba670_3b2a_4dd6_800f_3f6ce9bbe428.slice/crio-6821632924bce6d93945626200561c37299af9d088d244f59251071246a866d4 WatchSource:0}: Error finding container 6821632924bce6d93945626200561c37299af9d088d244f59251071246a866d4: Status 404 returned error can't find the container with id 6821632924bce6d93945626200561c37299af9d088d244f59251071246a866d4 Jul 02 18:31:36.914504 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:36.914457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ks472"] Jul 02 18:31:36.918035 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:36.918005 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd384d57_9fbc_4b80_b662_d8c8732ad4d5.slice/crio-58c7e77292b1ecc55445aa35b3932c3f179cd0c4ad00a343f8757f7c0c81b535 WatchSource:0}: Error finding container 58c7e77292b1ecc55445aa35b3932c3f179cd0c4ad00a343f8757f7c0c81b535: Status 404 returned error can't find the container with id 58c7e77292b1ecc55445aa35b3932c3f179cd0c4ad00a343f8757f7c0c81b535 Jul 02 18:31:37.490401 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.490227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:37.490401 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.490264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:37.492334 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.492310 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvptw\"" Jul 02 18:31:37.492602 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.492586 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 18:31:37.492966 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.492947 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 18:31:37.493733 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.493714 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 18:31:37.855060 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.854971 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ks472" event={"ID":"fd384d57-9fbc-4b80-b662-d8c8732ad4d5","Type":"ContainerStarted","Data":"58c7e77292b1ecc55445aa35b3932c3f179cd0c4ad00a343f8757f7c0c81b535"} Jul 02 18:31:37.858151 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.858121 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z27rs" event={"ID":"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428","Type":"ContainerStarted","Data":"6821632924bce6d93945626200561c37299af9d088d244f59251071246a866d4"} Jul 02 18:31:37.860390 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:37.860295 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czxh9" event={"ID":"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6","Type":"ContainerStarted","Data":"ca2886486cd4197e71a05559f712b3e8b8cf683cfb5f17d4449517b689e469f3"} Jul 02 18:31:38.186186 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.186109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:38.286658 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.286623 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:38.308871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.308833 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n"] Jul 02 18:31:38.323751 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.323723 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n"] Jul 02 18:31:38.323923 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.323863 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:38.326668 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.326506 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-c5mz6\"" Jul 02 18:31:38.326849 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.326724 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 18:31:38.348769 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.348736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:38.358938 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.358903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b2ba0a4-5655-44dc-bef5-df9e45f7d12c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r6j9n\" (UID: \"1b2ba0a4-5655-44dc-bef5-df9e45f7d12c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:38.459357 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.459323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b2ba0a4-5655-44dc-bef5-df9e45f7d12c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r6j9n\" (UID: \"1b2ba0a4-5655-44dc-bef5-df9e45f7d12c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:38.459518 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:38.459481 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 18:31:38.459593 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:38.459545 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2ba0a4-5655-44dc-bef5-df9e45f7d12c-tls-certificates podName:1b2ba0a4-5655-44dc-bef5-df9e45f7d12c nodeName:}" failed. No retries permitted until 2026-07-02 18:31:38.959526103 +0000 UTC m=+54.956554597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1b2ba0a4-5655-44dc-bef5-df9e45f7d12c-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-r6j9n" (UID: "1b2ba0a4-5655-44dc-bef5-df9e45f7d12c") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 18:31:38.735764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.735659 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:38.963141 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.963107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b2ba0a4-5655-44dc-bef5-df9e45f7d12c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r6j9n\" (UID: \"1b2ba0a4-5655-44dc-bef5-df9e45f7d12c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:38.965995 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:38.965970 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b2ba0a4-5655-44dc-bef5-df9e45f7d12c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-r6j9n\" (UID: \"1b2ba0a4-5655-44dc-bef5-df9e45f7d12c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:39.236850 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:39.236814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:41.258686 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:41.258644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:41.360190 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:41.360159 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:42.683200 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:42.683150 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:42.756305 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:42.756266 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:42.910668 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:42.910598 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n"] Jul 02 18:31:43.881042 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.881012 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ks472" event={"ID":"fd384d57-9fbc-4b80-b662-d8c8732ad4d5","Type":"ContainerStarted","Data":"f1170a881e58e0b67e7909a7edaad690e5c1cb0d9a4e8b30d1de2419d226ff9a"} Jul 02 18:31:43.882808 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.882769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czxh9" event={"ID":"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6","Type":"ContainerStarted","Data":"e7cef7251919f0312e10dbd565a60ff85c0cae9370b6fce751e0c838067e2dd3"} Jul 02 18:31:43.882932 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.882831 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:43.882932 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.882850 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-czxh9" event={"ID":"0bd8cbe5-fd87-4dc6-a247-d052bcb199b6","Type":"ContainerStarted","Data":"f2cae26261714c2a29e77433ccdabffcc1874810d2ad507160f313d08348b789"} Jul 02 18:31:43.884633 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.884608 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z27rs" event={"ID":"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428","Type":"ContainerStarted","Data":"880b476461f52b9a5898af5001f7758bfe3d5bcc93072910e90143c53dc87b92"} Jul 02 18:31:43.884724 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.884665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z27rs" event={"ID":"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428","Type":"ContainerStarted","Data":"011122c9746ccf1907b7278c5c918195e3de98983e4cb2a611e688e03667a7c8"} Jul 02 18:31:43.889928 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.889670 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" event={"ID":"1b2ba0a4-5655-44dc-bef5-df9e45f7d12c","Type":"ContainerStarted","Data":"71f589e4199b72e00d63bfbcbe74b3be28d71c347c4c50354f88b6dc5fdc3baa"} Jul 02 18:31:43.889928 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.889753 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" event={"ID":"1b2ba0a4-5655-44dc-bef5-df9e45f7d12c","Type":"ContainerStarted","Data":"acdc228c13664fa4e5cb09f404f7a24a405e0ad7b274c6acfc922231a81aedcf"} Jul 02 18:31:43.890090 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.890047 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:43.891547 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.891524 2579 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-d559d66d5-r6j9n container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.9:8443/healthz\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 02 18:31:43.891661 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.891579 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" podUID="1b2ba0a4-5655-44dc-bef5-df9e45f7d12c" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.134.0.9:8443/healthz\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 02 18:31:43.898706 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.898654 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ks472" podStartSLOduration=2.066004059 podStartE2EDuration="7.898636138s" totalImagesPullingTime="5.832632079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:43.897956664 +0000 UTC m=+59.894985177" watchObservedRunningTime="2026-07-02 18:31:43.898636138 +0000 UTC m=+59.895664652" Jul 02 18:31:43.917103 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.917055 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-czxh9" podStartSLOduration=2.019285179 podStartE2EDuration="7.917035837s" totalImagesPullingTime="5.897750658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:43.916240858 +0000 UTC m=+59.913269383" watchObservedRunningTime="2026-07-02 18:31:43.917035837 +0000 UTC m=+59.914064352" Jul 02 18:31:43.937459 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:43.936999 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" podStartSLOduration=5.022748298 podStartE2EDuration="5.936977586s" totalImagesPullingTime="914.229288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:43.9364498 +0000 UTC m=+59.933478313" watchObservedRunningTime="2026-07-02 18:31:43.936977586 +0000 UTC m=+59.934006100" Jul 02 18:31:44.897625 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:44.897593 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-r6j9n" Jul 02 18:31:45.349247 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.349213 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:45.392688 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.392649 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd"] Jul 02 18:31:45.398099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.398078 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.400407 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.400380 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 18:31:45.400407 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.400402 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6hpkw\"" Jul 02 18:31:45.400598 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.400432 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 18:31:45.401011 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.400869 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 18:31:45.401011 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.400898 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 18:31:45.401011 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.400906 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 18:31:45.404954 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.404859 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd"] Jul 02 18:31:45.450530 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.450494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:45.513448 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.513418 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.513448 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.513452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e2a212-ef5f-409a-a3d1-4918e28180c6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.513674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.513539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmgj\" (UniqueName: \"kubernetes.io/projected/82e2a212-ef5f-409a-a3d1-4918e28180c6-kube-api-access-ddmgj\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.513674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.513567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.614337 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.614251 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmgj\" (UniqueName: \"kubernetes.io/projected/82e2a212-ef5f-409a-a3d1-4918e28180c6-kube-api-access-ddmgj\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.614337 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.614294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.614621 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.614464 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.614621 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.614493 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e2a212-ef5f-409a-a3d1-4918e28180c6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.614750 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:45.614639 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 02 18:31:45.614750 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:45.614737 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-tls podName:82e2a212-ef5f-409a-a3d1-4918e28180c6 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:46.114713139 +0000 UTC m=+62.111741632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-g2wqd" (UID: "82e2a212-ef5f-409a-a3d1-4918e28180c6") : secret "prometheus-operator-tls" not found Jul 02 18:31:45.615272 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.615249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82e2a212-ef5f-409a-a3d1-4918e28180c6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.617063 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.617040 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.626743 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.626722 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmgj\" (UniqueName: \"kubernetes.io/projected/82e2a212-ef5f-409a-a3d1-4918e28180c6-kube-api-access-ddmgj\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:45.713411 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.713382 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:45.812771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.812729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:45.912929 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:45.912830 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:46.117836 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.117801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:46.120100 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.120083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/82e2a212-ef5f-409a-a3d1-4918e28180c6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-g2wqd\" (UID: \"82e2a212-ef5f-409a-a3d1-4918e28180c6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:46.309527 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.309495 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" Jul 02 18:31:46.426706 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.426677 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd"] Jul 02 18:31:46.429623 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:46.429602 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e2a212_ef5f_409a_a3d1_4918e28180c6.slice/crio-878d1ed7efda6a96fdf848a3703969097c16e9d38e7258cf15314addf2e79a07 WatchSource:0}: Error finding container 878d1ed7efda6a96fdf848a3703969097c16e9d38e7258cf15314addf2e79a07: Status 404 returned error can't find the container with id 878d1ed7efda6a96fdf848a3703969097c16e9d38e7258cf15314addf2e79a07 Jul 02 18:31:46.766537 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.766511 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:46.804006 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.803986 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cftkj" Jul 02 18:31:46.869489 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.869458 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:46.902028 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.901989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z27rs" event={"ID":"ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428","Type":"ContainerStarted","Data":"366618be0176049673ee452998308da44fd3ad870018cec722a8e782a22658e2"} Jul 02 18:31:46.903618 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.903594 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" event={"ID":"82e2a212-ef5f-409a-a3d1-4918e28180c6","Type":"ContainerStarted","Data":"878d1ed7efda6a96fdf848a3703969097c16e9d38e7258cf15314addf2e79a07"} Jul 02 18:31:46.928152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.928101 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z27rs" podStartSLOduration=2.033423267 podStartE2EDuration="10.928081779s" totalImagesPullingTime="8.894658512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:31:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:46.927885639 +0000 UTC m=+62.924914165" watchObservedRunningTime="2026-07-02 18:31:46.928081779 +0000 UTC m=+62.925110292" Jul 02 18:31:46.970698 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:46.970667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:47.075026 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:47.074942 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:47.791999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:47.791914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:47.890951 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:47.890919 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:47.908839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:47.908805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" event={"ID":"82e2a212-ef5f-409a-a3d1-4918e28180c6","Type":"ContainerStarted","Data":"be741b4500cf377166ec484426de30ba0cb3e161113eb1e4effcc1cfe9ebee97"} Jul 02 18:31:47.908983 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:47.908899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" event={"ID":"82e2a212-ef5f-409a-a3d1-4918e28180c6","Type":"ContainerStarted","Data":"ef94d28b9b619ee28bdf939af686f1e12361c485743c15ff9ccf3f15c45c9b32"} Jul 02 18:31:47.928357 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:47.928308 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-g2wqd" podStartSLOduration=1.8494215870000001 podStartE2EDuration="2.92829518s" totalImagesPullingTime="1.078873593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:47.928152543 +0000 UTC m=+63.925181077" watchObservedRunningTime="2026-07-02 18:31:47.92829518 +0000 UTC m=+63.925323692" Jul 02 18:31:49.495464 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.495427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:49.684924 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.684890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:49.821668 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.821586 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:49.858286 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.858254 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jf5gb"] Jul 02 18:31:49.870390 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.870367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.872697 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.872673 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 18:31:49.872805 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.872748 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 18:31:49.872884 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.872814 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vjlgr\"" Jul 02 18:31:49.872945 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.872924 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 18:31:49.874316 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.874297 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl"] Jul 02 18:31:49.876226 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.876208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.877886 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.877868 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 18:31:49.878150 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.878135 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 18:31:49.878232 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.878151 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-qlnzg\"" Jul 02 18:31:49.878704 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.878686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 18:31:49.890682 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.890663 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl"] Jul 02 18:31:49.924367 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.924337 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:49.949313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.949402 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp7r8\" (UniqueName: \"kubernetes.io/projected/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-kube-api-access-bp7r8\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949402 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949341 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.949402 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-wtmp\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949533 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46chq\" (UniqueName: \"kubernetes.io/projected/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-api-access-46chq\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.949533 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.949533 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949650 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.949650 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-textfile\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949650 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-root\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949650 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949620 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:49.949817 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-metrics-client-ca\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949817 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949691 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-sys\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949817 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949758 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-tls\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:49.949817 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:49.949795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050130 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.050130 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp7r8\" (UniqueName: \"kubernetes.io/projected/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-kube-api-access-bp7r8\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050327 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050156 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.050327 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-wtmp\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050327 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46chq\" (UniqueName: \"kubernetes.io/projected/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-api-access-46chq\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.050507 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.050507 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050507 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.050507 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-wtmp\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050507 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-textfile\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-root\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:50.050548 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050573 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:50.050620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls podName:09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b nodeName:}" failed. No retries permitted until 2026-07-02 18:31:50.550599577 +0000 UTC m=+66.547628084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-cwnnl" (UID: "09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b") : secret "kube-state-metrics-tls" not found Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-metrics-client-ca\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050648 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-root\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.050724 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-sys\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.051109 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050772 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-tls\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.051109 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.051109 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.051109 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-textfile\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.051109 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.050993 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-sys\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.051307 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.051259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.051358 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.051338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.051714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.051668 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-accelerators-collector-config\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.051850 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.051758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-metrics-client-ca\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.052803 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.052754 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.052955 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.052938 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.053637 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.053621 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-node-exporter-tls\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.057314 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.057288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.057663 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.057642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp7r8\" (UniqueName: \"kubernetes.io/projected/30271745-5c2c-4ad3-82ec-7d7322ddf9b6-kube-api-access-bp7r8\") pod \"node-exporter-jf5gb\" (UID: \"30271745-5c2c-4ad3-82ec-7d7322ddf9b6\") " pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.058503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.058487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46chq\" (UniqueName: \"kubernetes.io/projected/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-api-access-46chq\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.159558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.159481 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.179392 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.179369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jf5gb" Jul 02 18:31:50.192287 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:50.192262 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30271745_5c2c_4ad3_82ec_7d7322ddf9b6.slice/crio-53d3e0371c58ce8ebac92e557f96fb16843899859308ae8918e473d50aaa4cb1 WatchSource:0}: Error finding container 53d3e0371c58ce8ebac92e557f96fb16843899859308ae8918e473d50aaa4cb1: Status 404 returned error can't find the container with id 53d3e0371c58ce8ebac92e557f96fb16843899859308ae8918e473d50aaa4cb1 Jul 02 18:31:50.252390 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.252362 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:50.252553 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.252427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:50.255150 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.255129 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 18:31:50.255252 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.255131 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 18:31:50.264890 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.264861 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/74c57049-22b3-42e7-9ed8-8e3257057143-original-pull-secret\") pod \"global-pull-secret-syncer-zx6n4\" (UID: \"74c57049-22b3-42e7-9ed8-8e3257057143\") " pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:50.264973 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.264954 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0-metrics-certs\") pod \"network-metrics-daemon-gm98z\" (UID: \"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0\") " pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:50.300033 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.300011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-86j9v\"" Jul 02 18:31:50.308510 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.308489 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gm98z" Jul 02 18:31:50.327233 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.327208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.353813 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.353769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:50.355963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.355942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 18:31:50.365958 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.365939 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 18:31:50.376912 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.376886 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4btws\" (UniqueName: \"kubernetes.io/projected/fd000e81-7047-4324-a533-2424973d8b1e-kube-api-access-4btws\") pod \"network-check-target-bgr8t\" (UID: \"fd000e81-7047-4324-a533-2424973d8b1e\") " pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:50.409381 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.409359 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvptw\"" Jul 02 18:31:50.417084 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.417034 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zx6n4" Jul 02 18:31:50.418096 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.418080 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:50.427982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.427952 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.434227 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.434203 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gm98z"] Jul 02 18:31:50.437446 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:50.437425 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1dc4c7e_dbbf_43a7_a9aa_d2afd05bb6f0.slice/crio-c013d1642bed18814d1d7f9d5e71e8d1a860aafcfa3acd0acb070a506d2ccdbb WatchSource:0}: Error finding container c013d1642bed18814d1d7f9d5e71e8d1a860aafcfa3acd0acb070a506d2ccdbb: Status 404 returned error can't find the container with id c013d1642bed18814d1d7f9d5e71e8d1a860aafcfa3acd0acb070a506d2ccdbb Jul 02 18:31:50.545815 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.545756 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bgr8t"] Jul 02 18:31:50.549285 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:50.549250 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd000e81_7047_4324_a533_2424973d8b1e.slice/crio-da974cb748b3bb14d40fb3e95b95bb7c7da486b0405d95f5b950ece1601def0c WatchSource:0}: Error finding container da974cb748b3bb14d40fb3e95b95bb7c7da486b0405d95f5b950ece1601def0c: Status 404 returned error can't find the container with id da974cb748b3bb14d40fb3e95b95bb7c7da486b0405d95f5b950ece1601def0c Jul 02 18:31:50.555895 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.555871 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:50.555998 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:50.555987 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 18:31:50.556039 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:50.556033 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls podName:09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b nodeName:}" failed. No retries permitted until 2026-07-02 18:31:51.556019882 +0000 UTC m=+67.553048386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-cwnnl" (UID: "09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b") : secret "kube-state-metrics-tls" not found Jul 02 18:31:50.564825 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.564805 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zx6n4"] Jul 02 18:31:50.567733 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:50.567708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c57049_22b3_42e7_9ed8_8e3257057143.slice/crio-bbfb62ac6a6868acd124c00058ca6ef5314f39f505f1ce89c1d17185dbd67c39 WatchSource:0}: Error finding container bbfb62ac6a6868acd124c00058ca6ef5314f39f505f1ce89c1d17185dbd67c39: Status 404 returned error can't find the container with id bbfb62ac6a6868acd124c00058ca6ef5314f39f505f1ce89c1d17185dbd67c39 Jul 02 18:31:50.601314 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.601289 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.741458 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.741420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.821912 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.821879 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:31:50.824970 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.824950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828435 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828489 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828759 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-br5mq\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828851 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828880 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.829077 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.829563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 18:31:50.830041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.828640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 18:31:50.831570 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.831519 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.851108 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.851080 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:31:50.920527 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.920493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zx6n4" event={"ID":"74c57049-22b3-42e7-9ed8-8e3257057143","Type":"ContainerStarted","Data":"bbfb62ac6a6868acd124c00058ca6ef5314f39f505f1ce89c1d17185dbd67c39"} Jul 02 18:31:50.922060 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.921993 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jf5gb" event={"ID":"30271745-5c2c-4ad3-82ec-7d7322ddf9b6","Type":"ContainerStarted","Data":"53d3e0371c58ce8ebac92e557f96fb16843899859308ae8918e473d50aaa4cb1"} Jul 02 18:31:50.923418 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.923369 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gm98z" event={"ID":"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0","Type":"ContainerStarted","Data":"c013d1642bed18814d1d7f9d5e71e8d1a860aafcfa3acd0acb070a506d2ccdbb"} Jul 02 18:31:50.924686 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.924661 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bgr8t" event={"ID":"fd000e81-7047-4324-a533-2424973d8b1e","Type":"ContainerStarted","Data":"da974cb748b3bb14d40fb3e95b95bb7c7da486b0405d95f5b950ece1601def0c"} Jul 02 18:31:50.953143 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.953105 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:50.959672 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959672 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959672 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959929 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959929 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959761 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959929 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959929 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hnhs\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-kube-api-access-6hnhs\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.959929 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959877 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-web-config\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.960169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.959972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.960169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.960008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.960169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.960037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.960169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.960067 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:50.960169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:50.960094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-out\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hnhs\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-kube-api-access-6hnhs\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-web-config\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061294 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-out\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061453 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061508 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.061963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.061608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.062833 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.062807 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.063760 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:51.063553 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle podName:5c9575ae-e6c8-474b-9baf-dd9ffebbe841 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:51.563533525 +0000 UTC m=+67.560562029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841") : configmap references non-existent config key: ca-bundle.crt Jul 02 18:31:51.067678 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.067630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.070088 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.070064 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.070380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.070359 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-out\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.070530 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.070516 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-volume\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.070845 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.070763 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.070988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.070966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.071053 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.070992 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.071959 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.071938 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.071959 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.071954 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-web-config\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.072147 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.072111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hnhs\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-kube-api-access-6hnhs\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.272013 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.271970 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:51.565809 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.565766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.566195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.565858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:51.566714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.566688 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.571789 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.571730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-cwnnl\" (UID: \"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:51.687054 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.686693 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" Jul 02 18:31:51.737624 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.737405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:31:51.851144 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.850831 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl"] Jul 02 18:31:51.925492 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.923594 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:31:51.931728 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:51.931699 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9575ae_e6c8_474b_9baf_dd9ffebbe841.slice/crio-3b7d976208942c6c4f1ef73792a8fd33803f6d84258c87fc57ddd2be178bf1b6 WatchSource:0}: Error finding container 3b7d976208942c6c4f1ef73792a8fd33803f6d84258c87fc57ddd2be178bf1b6: Status 404 returned error can't find the container with id 3b7d976208942c6c4f1ef73792a8fd33803f6d84258c87fc57ddd2be178bf1b6 Jul 02 18:31:51.934287 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.934231 2579 generic.go:356] "Generic (PLEG): container finished" podID="30271745-5c2c-4ad3-82ec-7d7322ddf9b6" containerID="44b2d43cf85e29157496eb50dc16e3129ce1b97923cc9db01a273cd06983ba58" exitCode=0 Jul 02 18:31:51.934362 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.934340 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jf5gb" event={"ID":"30271745-5c2c-4ad3-82ec-7d7322ddf9b6","Type":"ContainerDied","Data":"44b2d43cf85e29157496eb50dc16e3129ce1b97923cc9db01a273cd06983ba58"} Jul 02 18:31:51.936972 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.936944 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" event={"ID":"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b","Type":"ContainerStarted","Data":"dc722cd74be3e60fedd45f1de85fd8c6a299f62dec49f3ace617be7f50117a3a"} Jul 02 18:31:51.939281 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.939254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gm98z" event={"ID":"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0","Type":"ContainerStarted","Data":"44d0050fcb32994177d9e065a487d70f2e02743a90f5f34bf65d82a8788e2a0f"} Jul 02 18:31:51.939376 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.939304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gm98z" event={"ID":"a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0","Type":"ContainerStarted","Data":"1aa85c145db677f3a3213b1969bfa5e87d6da159e62ddb0f231a065ec5b3612a"} Jul 02 18:31:51.973239 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:51.972755 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gm98z" podStartSLOduration=65.922679693 podStartE2EDuration="1m6.972734104s" totalImagesPullingTime="1.050054411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:51.97122707 +0000 UTC m=+67.968255608" watchObservedRunningTime="2026-07-02 18:31:51.972734104 +0000 UTC m=+67.969762622" Jul 02 18:31:52.115951 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.115872 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:52.217052 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.216962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:52.699295 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.699153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:52.771519 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.771479 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-866bb47569-rnl69"] Jul 02 18:31:52.774581 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.774556 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.780639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.779868 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dbb2i44fqbo1f\"" Jul 02 18:31:52.780639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.780163 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 18:31:52.780639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.780363 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 18:31:52.780639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.780487 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 18:31:52.780639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.780533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 18:31:52.781004 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.780816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5jc8r\"" Jul 02 18:31:52.781056 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.781047 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 18:31:52.794473 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.794447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866bb47569-rnl69"] Jul 02 18:31:52.805899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.805815 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:52.881039 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881005 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd05dbd-051d-4de0-a9e8-f2c44de90975-metrics-client-ca\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881211 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881072 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881211 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881103 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-tls\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881211 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881211 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881167 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-grpc-tls\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881211 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881195 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhgmg\" (UniqueName: \"kubernetes.io/projected/0bd05dbd-051d-4de0-a9e8-f2c44de90975-kube-api-access-qhgmg\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881468 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.881468 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.881262 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.946518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.946435 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"3b7d976208942c6c4f1ef73792a8fd33803f6d84258c87fc57ddd2be178bf1b6"} Jul 02 18:31:52.950460 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.950318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jf5gb" event={"ID":"30271745-5c2c-4ad3-82ec-7d7322ddf9b6","Type":"ContainerStarted","Data":"b53b32d0cd2fbe8e1c62f8f28b3e5c8351aea28862e92b1b23d217eed71cd20c"} Jul 02 18:31:52.950460 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.950373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jf5gb" event={"ID":"30271745-5c2c-4ad3-82ec-7d7322ddf9b6","Type":"ContainerStarted","Data":"a8741f7a5b9ee8a5d5f38a89a63ce5566a5395f1957f533f8f612509daedac70"} Jul 02 18:31:52.973063 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.973007 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jf5gb" podStartSLOduration=2.611274668 podStartE2EDuration="3.972985445s" totalImagesPullingTime="1.267690317s" totalInitContainerRuntime="94.02046ms" isStatefulPod=true podCreationTimestamp="2026-07-02 18:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:52.972555828 +0000 UTC m=+68.969584364" watchObservedRunningTime="2026-07-02 18:31:52.972985445 +0000 UTC m=+68.970013958" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.981929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd05dbd-051d-4de0-a9e8-f2c44de90975-metrics-client-ca\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-tls\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-grpc-tls\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhgmg\" (UniqueName: \"kubernetes.io/projected/0bd05dbd-051d-4de0-a9e8-f2c44de90975-kube-api-access-qhgmg\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.982558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.982213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.983742 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.983450 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd05dbd-051d-4de0-a9e8-f2c44de90975-metrics-client-ca\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.988236 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.987575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.988236 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.987661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.988236 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.987932 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-tls\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.988236 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.987957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.988505 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.988432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-grpc-tls\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.989621 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.989582 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0bd05dbd-051d-4de0-a9e8-f2c44de90975-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:52.991813 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:52.991790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhgmg\" (UniqueName: \"kubernetes.io/projected/0bd05dbd-051d-4de0-a9e8-f2c44de90975-kube-api-access-qhgmg\") pod \"thanos-querier-866bb47569-rnl69\" (UID: \"0bd05dbd-051d-4de0-a9e8-f2c44de90975\") " pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:53.000736 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:53.000699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:53.088965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:53.088727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:31:53.478589 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:53.478555 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:53.896253 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:53.896179 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-czxh9" Jul 02 18:31:54.187334 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.187301 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84cdf5cd44-qp7vg"] Jul 02 18:31:54.190623 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.190605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.192857 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.192832 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 18:31:54.195426 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.195203 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8fte7fc1nf587\"" Jul 02 18:31:54.195426 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.195257 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 18:31:54.195426 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.195304 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 18:31:54.195426 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.195321 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 18:31:54.195426 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.195256 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gszh8\"" Jul 02 18:31:54.201814 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.201772 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84cdf5cd44-qp7vg"] Jul 02 18:31:54.292439 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-secret-metrics-server-tls\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.292623 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-client-ca-bundle\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.292623 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8d6b6b0-891b-4702-875f-946c292158f7-metrics-server-audit-profiles\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.292623 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292586 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d6b6b0-891b-4702-875f-946c292158f7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.292822 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-secret-metrics-server-client-certs\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.292822 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8d6b6b0-891b-4702-875f-946c292158f7-audit-log\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.292822 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.292742 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhbtg\" (UniqueName: \"kubernetes.io/projected/c8d6b6b0-891b-4702-875f-946c292158f7-kube-api-access-rhbtg\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393401 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-secret-metrics-server-tls\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393491 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-client-ca-bundle\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393491 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8d6b6b0-891b-4702-875f-946c292158f7-metrics-server-audit-profiles\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393491 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d6b6b0-891b-4702-875f-946c292158f7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-secret-metrics-server-client-certs\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8d6b6b0-891b-4702-875f-946c292158f7-audit-log\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.393639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.393561 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhbtg\" (UniqueName: \"kubernetes.io/projected/c8d6b6b0-891b-4702-875f-946c292158f7-kube-api-access-rhbtg\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.394338 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.394284 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c8d6b6b0-891b-4702-875f-946c292158f7-audit-log\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.394338 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.394319 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8d6b6b0-891b-4702-875f-946c292158f7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.394558 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.394540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c8d6b6b0-891b-4702-875f-946c292158f7-metrics-server-audit-profiles\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.396155 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.396130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-secret-metrics-server-client-certs\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.396424 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.396402 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-client-ca-bundle\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.396467 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.396403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c8d6b6b0-891b-4702-875f-946c292158f7-secret-metrics-server-tls\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.401619 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.401591 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhbtg\" (UniqueName: \"kubernetes.io/projected/c8d6b6b0-891b-4702-875f-946c292158f7-kube-api-access-rhbtg\") pod \"metrics-server-84cdf5cd44-qp7vg\" (UID: \"c8d6b6b0-891b-4702-875f-946c292158f7\") " pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.503111 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.503033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:31:54.504606 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.504566 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:54.512538 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.512515 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55"] Jul 02 18:31:54.514915 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.514896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:54.516871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.516848 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 18:31:54.517016 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.516880 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tkr2x\"" Jul 02 18:31:54.527484 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.527203 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55"] Jul 02 18:31:54.594683 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.594647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxlcz\" (UniqueName: \"kubernetes.io/projected/ff49335c-8755-4bd7-a9e3-679675007b59-kube-api-access-jxlcz\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:54.594886 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.594729 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff49335c-8755-4bd7-a9e3-679675007b59-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:54.695550 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.695514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff49335c-8755-4bd7-a9e3-679675007b59-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:54.695737 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.695569 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxlcz\" (UniqueName: \"kubernetes.io/projected/ff49335c-8755-4bd7-a9e3-679675007b59-kube-api-access-jxlcz\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:54.695737 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:54.695637 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 18:31:54.695737 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:31:54.695714 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff49335c-8755-4bd7-a9e3-679675007b59-monitoring-plugin-cert podName:ff49335c-8755-4bd7-a9e3-679675007b59 nodeName:}" failed. No retries permitted until 2026-07-02 18:31:55.195696067 +0000 UTC m=+71.192724581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ff49335c-8755-4bd7-a9e3-679675007b59-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-lnl55" (UID: "ff49335c-8755-4bd7-a9e3-679675007b59") : secret "monitoring-plugin-cert" not found Jul 02 18:31:54.707550 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.707527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxlcz\" (UniqueName: \"kubernetes.io/projected/ff49335c-8755-4bd7-a9e3-679675007b59-kube-api-access-jxlcz\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:54.922672 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:54.922580 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:55.199790 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:55.199752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff49335c-8755-4bd7-a9e3-679675007b59-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:55.202410 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:55.202380 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff49335c-8755-4bd7-a9e3-679675007b59-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lnl55\" (UID: \"ff49335c-8755-4bd7-a9e3-679675007b59\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:55.428122 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:55.428085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:55.999533 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:55.999448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" event={"ID":"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b","Type":"ContainerStarted","Data":"8a58d0d29edf2511eef60c30d9eeaddb5d2d737dbe53828e67ff3f68b898774c"} Jul 02 18:31:56.013235 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:56.013146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:56.024424 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:56.024324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-866bb47569-rnl69"] Jul 02 18:31:56.036384 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:56.036351 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd05dbd_051d_4de0_a9e8_f2c44de90975.slice/crio-f039fc004f0f5ec16aa07dfccfd32f780072ae0fff1eae8fe509448d890d098e WatchSource:0}: Error finding container f039fc004f0f5ec16aa07dfccfd32f780072ae0fff1eae8fe509448d890d098e: Status 404 returned error can't find the container with id f039fc004f0f5ec16aa07dfccfd32f780072ae0fff1eae8fe509448d890d098e Jul 02 18:31:56.159266 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:56.159235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:56.260148 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:56.260117 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55"] Jul 02 18:31:56.263296 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:56.263256 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff49335c_8755_4bd7_a9e3_679675007b59.slice/crio-8db09c817e5004d2208fe3ca3c92b443a2f2aac28b13ccb60dedf8bbe3b33099 WatchSource:0}: Error finding container 8db09c817e5004d2208fe3ca3c92b443a2f2aac28b13ccb60dedf8bbe3b33099: Status 404 returned error can't find the container with id 8db09c817e5004d2208fe3ca3c92b443a2f2aac28b13ccb60dedf8bbe3b33099 Jul 02 18:31:56.263503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:56.263479 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84cdf5cd44-qp7vg"] Jul 02 18:31:56.266686 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:56.266662 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d6b6b0_891b_4702_875f_946c292158f7.slice/crio-d25975f225a9763eca98cc66bd8513fea3fea9414bb08f6d43ec921aadb9b939 WatchSource:0}: Error finding container d25975f225a9763eca98cc66bd8513fea3fea9414bb08f6d43ec921aadb9b939: Status 404 returned error can't find the container with id d25975f225a9763eca98cc66bd8513fea3fea9414bb08f6d43ec921aadb9b939 Jul 02 18:31:57.005728 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.005683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" event={"ID":"ff49335c-8755-4bd7-a9e3-679675007b59","Type":"ContainerStarted","Data":"8db09c817e5004d2208fe3ca3c92b443a2f2aac28b13ccb60dedf8bbe3b33099"} Jul 02 18:31:57.007617 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.007533 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"f039fc004f0f5ec16aa07dfccfd32f780072ae0fff1eae8fe509448d890d098e"} Jul 02 18:31:57.010768 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.009652 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b" exitCode=0 Jul 02 18:31:57.010768 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.009731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b"} Jul 02 18:31:57.014126 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.014065 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bgr8t" event={"ID":"fd000e81-7047-4324-a533-2424973d8b1e","Type":"ContainerStarted","Data":"4179ace037860cb402e1f77d782866b138f45a5c791692e2a89d64868bf31ff6"} Jul 02 18:31:57.014226 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.014136 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:31:57.016289 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.016267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" event={"ID":"c8d6b6b0-891b-4702-875f-946c292158f7","Type":"ContainerStarted","Data":"d25975f225a9763eca98cc66bd8513fea3fea9414bb08f6d43ec921aadb9b939"} Jul 02 18:31:57.019138 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.019089 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zx6n4" event={"ID":"74c57049-22b3-42e7-9ed8-8e3257057143","Type":"ContainerStarted","Data":"b66bb9d7593a26ebd1fe3a0784d0493220b95bd049bf7ee9159532784644c318"} Jul 02 18:31:57.022439 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.022317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" event={"ID":"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b","Type":"ContainerStarted","Data":"533b9a98f5ba31e34407ee474cae827f87db4f4f446337ece39373503c34ebc3"} Jul 02 18:31:57.022439 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.022366 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" event={"ID":"09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b","Type":"ContainerStarted","Data":"dc0f3f91c7e8a2aa926291bd9a1218dd257821085413bf30821cb0165475f994"} Jul 02 18:31:57.054234 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.053965 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bgr8t" podStartSLOduration=66.760763673 podStartE2EDuration="1m12.053948012s" totalImagesPullingTime="5.293184339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:57.05339749 +0000 UTC m=+73.050426003" watchObservedRunningTime="2026-07-02 18:31:57.053948012 +0000 UTC m=+73.050976525" Jul 02 18:31:57.071860 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.071792 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-cwnnl" podStartSLOduration=4.11692281 podStartE2EDuration="8.071758829s" totalImagesPullingTime="3.954836019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:57.070553457 +0000 UTC m=+73.067581970" watchObservedRunningTime="2026-07-02 18:31:57.071758829 +0000 UTC m=+73.068787343" Jul 02 18:31:57.087484 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.087017 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zx6n4" podStartSLOduration=66.79035209 podStartE2EDuration="1m12.086998297s" totalImagesPullingTime="5.296646207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:57.086249303 +0000 UTC m=+73.083277847" watchObservedRunningTime="2026-07-02 18:31:57.086998297 +0000 UTC m=+73.084026811" Jul 02 18:31:57.759607 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.759565 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:57.857769 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:57.857725 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:58.077764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.077667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:58.091241 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.091205 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-k4c7r"] Jul 02 18:31:58.094675 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.094654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:31:58.099349 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.099193 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 18:31:58.099490 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.099471 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 18:31:58.100030 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.099998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ljb7p\"" Jul 02 18:31:58.113329 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.111733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-k4c7r"] Jul 02 18:31:58.232878 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.232845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw64h\" (UniqueName: \"kubernetes.io/projected/df468f2d-ff1e-4afe-8245-28c6f2d91aec-kube-api-access-vw64h\") pod \"downloads-685bfb5f64-k4c7r\" (UID: \"df468f2d-ff1e-4afe-8245-28c6f2d91aec\") " pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:31:58.258135 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.258100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:58.333899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.333791 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw64h\" (UniqueName: \"kubernetes.io/projected/df468f2d-ff1e-4afe-8245-28c6f2d91aec-kube-api-access-vw64h\") pod \"downloads-685bfb5f64-k4c7r\" (UID: \"df468f2d-ff1e-4afe-8245-28c6f2d91aec\") " pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:31:58.348105 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.348067 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw64h\" (UniqueName: \"kubernetes.io/projected/df468f2d-ff1e-4afe-8245-28c6f2d91aec-kube-api-access-vw64h\") pod \"downloads-685bfb5f64-k4c7r\" (UID: \"df468f2d-ff1e-4afe-8245-28c6f2d91aec\") " pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:31:58.358859 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.358820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:58.406261 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.406224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:31:58.415342 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.415291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:58.613645 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.613602 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-k4c7r"] Jul 02 18:31:58.628001 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:31:58.627969 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf468f2d_ff1e_4afe_8245_28c6f2d91aec.slice/crio-03973413bbb26caed23c461b0d84018ee72a03d45346163b9d55e6aa5aff991f WatchSource:0}: Error finding container 03973413bbb26caed23c461b0d84018ee72a03d45346163b9d55e6aa5aff991f: Status 404 returned error can't find the container with id 03973413bbb26caed23c461b0d84018ee72a03d45346163b9d55e6aa5aff991f Jul 02 18:31:58.757820 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:58.757639 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:59.035586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.035547 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" event={"ID":"c8d6b6b0-891b-4702-875f-946c292158f7","Type":"ContainerStarted","Data":"a9d44dca38ad6268c867274cbdab45ae3fbe70a53d1702a8a9df90df277cd2b8"} Jul 02 18:31:59.037466 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.037392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-k4c7r" event={"ID":"df468f2d-ff1e-4afe-8245-28c6f2d91aec","Type":"ContainerStarted","Data":"03973413bbb26caed23c461b0d84018ee72a03d45346163b9d55e6aa5aff991f"} Jul 02 18:31:59.040864 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.040394 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" event={"ID":"ff49335c-8755-4bd7-a9e3-679675007b59","Type":"ContainerStarted","Data":"fd3702e1168b04e227dcfbcbd6ff9e1bfa7361b897be2b363fece3fd8af2db69"} Jul 02 18:31:59.040864 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.040472 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:59.044478 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.044293 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"db0affedaf24be2b63e66dc9dc05726d695fe39fa1c424ef4e44f6f967a3a0fc"} Jul 02 18:31:59.044478 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.044368 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"cf6082f5a159c5184b4b15b9280223206cfdd4443b8953bcf2844c5474f46324"} Jul 02 18:31:59.044478 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.044409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"3151f64da65583ca5d07ccdc1d60d273471adf365c15fff0524f118082e25517"} Jul 02 18:31:59.046881 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.046855 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" Jul 02 18:31:59.057061 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.057010 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" podStartSLOduration=2.863317909 podStartE2EDuration="5.056989316s" totalImagesPullingTime="2.193671407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:59.0565738 +0000 UTC m=+75.053602350" watchObservedRunningTime="2026-07-02 18:31:59.056989316 +0000 UTC m=+75.054017821" Jul 02 18:31:59.075286 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.075213 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lnl55" podStartSLOduration=2.878294576 podStartE2EDuration="5.075192841s" totalImagesPullingTime="2.196898265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:31:59.072730109 +0000 UTC m=+75.069758622" watchObservedRunningTime="2026-07-02 18:31:59.075192841 +0000 UTC m=+75.072221354" Jul 02 18:31:59.150362 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.150325 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:59.219704 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.219668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:59.756378 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.756348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:31:59.957988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:31:59.957908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:00.018325 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.018287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:00.054825 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.054773 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3"} Jul 02 18:32:00.054988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.054888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75"} Jul 02 18:32:00.054988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.054930 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30"} Jul 02 18:32:00.054988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.054965 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a"} Jul 02 18:32:00.055224 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.055001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7"} Jul 02 18:32:00.055224 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.055042 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerStarted","Data":"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e"} Jul 02 18:32:00.058217 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.058048 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"8389a2276b5ccf074fc508e1bb4e1003218c5d42443d4ba2bee8225a6c82c6f2"} Jul 02 18:32:00.058217 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.058124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"ab6c942acd967a5937d17252e27d697f5efbc77a275b359c75b363c6b9f5f40f"} Jul 02 18:32:00.058217 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.058167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" event={"ID":"0bd05dbd-051d-4de0-a9e8-f2c44de90975","Type":"ContainerStarted","Data":"8281397eda8a9791ac6e9785a4e717f5c839c41f8c6c7be55712bfb1aa921c73"} Jul 02 18:32:00.079617 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.079560 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.835963077 podStartE2EDuration="10.079537209s" totalImagesPullingTime="6.233668552s" totalInitContainerRuntime="9.90558ms" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:32:00.078946084 +0000 UTC m=+76.075974622" watchObservedRunningTime="2026-07-02 18:32:00.079537209 +0000 UTC m=+76.076565810" Jul 02 18:32:00.106920 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.106857 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" podStartSLOduration=4.689054648 podStartE2EDuration="8.106839849s" totalImagesPullingTime="3.417785201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:32:00.10249837 +0000 UTC m=+76.099526921" watchObservedRunningTime="2026-07-02 18:32:00.106839849 +0000 UTC m=+76.103868360" Jul 02 18:32:00.325544 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:00.325462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:01.063535 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:01.063499 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:32:05.131178 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:05.131140 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:05.231897 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:05.231856 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:05.332491 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:05.332452 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:07.074748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.074617 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-866bb47569-rnl69" Jul 02 18:32:07.081240 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.081211 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:07.184081 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.184035 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:07.977065 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.977028 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6876b659c9-pkvhk"] Jul 02 18:32:07.980026 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.980001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:07.983105 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.983073 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 18:32:07.983233 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.983156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fpbkv\"" Jul 02 18:32:07.983815 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.983450 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 18:32:07.983815 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.983587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 18:32:07.983815 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.983624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 18:32:07.983815 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.983708 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 18:32:07.992337 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:07.992280 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6876b659c9-pkvhk"] Jul 02 18:32:08.124531 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.124230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-service-ca\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.124531 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.124282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-oauth-config\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.124531 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.124307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqgmn\" (UniqueName: \"kubernetes.io/projected/5b0aa196-f138-475e-9858-5a90d87b937d-kube-api-access-nqgmn\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.124531 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.124346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-console-config\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.124531 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.124388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-serving-cert\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.124531 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.124419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-oauth-serving-cert\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.225360 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.225326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-oauth-serving-cert\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.225566 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.225389 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-service-ca\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.225566 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.225426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-oauth-config\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.225566 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.225449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmn\" (UniqueName: \"kubernetes.io/projected/5b0aa196-f138-475e-9858-5a90d87b937d-kube-api-access-nqgmn\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.225830 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.225806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-console-config\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.225914 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.225886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-serving-cert\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.226256 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.226198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-oauth-serving-cert\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.226256 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.226252 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-service-ca\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.230139 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.228904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-console-config\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.230657 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.230635 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-oauth-config\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.231202 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.231162 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-serving-cert\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.232940 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.232917 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqgmn\" (UniqueName: \"kubernetes.io/projected/5b0aa196-f138-475e-9858-5a90d87b937d-kube-api-access-nqgmn\") pod \"console-6876b659c9-pkvhk\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.294037 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.294001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:08.436603 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.436567 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6876b659c9-pkvhk"] Jul 02 18:32:08.442992 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:32:08.442962 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0aa196_f138_475e_9858_5a90d87b937d.slice/crio-b1d547866929f375cc6130757ed5a958da512ef5004663adde6429feaad0f3f7 WatchSource:0}: Error finding container b1d547866929f375cc6130757ed5a958da512ef5004663adde6429feaad0f3f7: Status 404 returned error can't find the container with id b1d547866929f375cc6130757ed5a958da512ef5004663adde6429feaad0f3f7 Jul 02 18:32:08.514568 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.514481 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:08.566199 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:08.566160 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:09.099450 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:09.099414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6876b659c9-pkvhk" event={"ID":"5b0aa196-f138-475e-9858-5a90d87b937d","Type":"ContainerStarted","Data":"b1d547866929f375cc6130757ed5a958da512ef5004663adde6429feaad0f3f7"} Jul 02 18:32:10.176242 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.176209 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c6d45877f-ftqtq"] Jul 02 18:32:10.178482 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.178465 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.185068 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.185045 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 18:32:10.189252 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.189230 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6d45877f-ftqtq"] Jul 02 18:32:10.190111 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.190092 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:10.257001 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.256969 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:10.345894 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.345866 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-serving-cert\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.346072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.345913 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv5v2\" (UniqueName: \"kubernetes.io/projected/521623c4-e87b-49f3-867c-a6d2a57c77b7-kube-api-access-mv5v2\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.346072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.345942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-config\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.346072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.346052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-trusted-ca-bundle\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.346220 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.346095 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-oauth-config\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.346220 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.346154 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-service-ca\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.346220 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.346180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-oauth-serving-cert\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447240 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-serving-cert\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447271 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5v2\" (UniqueName: \"kubernetes.io/projected/521623c4-e87b-49f3-867c-a6d2a57c77b7-kube-api-access-mv5v2\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-config\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-trusted-ca-bundle\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-oauth-config\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-service-ca\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.447674 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.447437 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-oauth-serving-cert\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.448527 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.448444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-config\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.448527 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.448498 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-oauth-serving-cert\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.448694 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.448579 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-service-ca\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.448764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.448748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-trusted-ca-bundle\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.450225 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.450202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-oauth-config\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.450418 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.450400 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-serving-cert\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.454750 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.454731 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv5v2\" (UniqueName: \"kubernetes.io/projected/521623c4-e87b-49f3-867c-a6d2a57c77b7-kube-api-access-mv5v2\") pod \"console-6c6d45877f-ftqtq\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:10.490956 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:10.490926 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:14.503881 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:14.503844 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:32:14.504410 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:14.503908 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:32:14.717139 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:14.717107 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/init-config-reloader/0.log" Jul 02 18:32:14.722645 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:14.722620 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/alertmanager/0.log" Jul 02 18:32:14.806959 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:14.806834 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/config-reloader/0.log" Jul 02 18:32:15.006211 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:15.006179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/kube-rbac-proxy-web/0.log" Jul 02 18:32:15.208481 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:15.208455 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/kube-rbac-proxy/0.log" Jul 02 18:32:15.407269 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:15.407179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/kube-rbac-proxy-metric/0.log" Jul 02 18:32:15.606806 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:15.606712 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5c9575ae-e6c8-474b-9baf-dd9ffebbe841/prom-label-proxy/0.log" Jul 02 18:32:16.006813 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.006766 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-cwnnl_09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b/kube-state-metrics/0.log" Jul 02 18:32:16.205885 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.205858 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-cwnnl_09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b/kube-rbac-proxy-main/0.log" Jul 02 18:32:16.406380 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.406314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-cwnnl_09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b/kube-rbac-proxy-self/0.log" Jul 02 18:32:16.614219 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.614175 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84cdf5cd44-qp7vg_c8d6b6b0-891b-4702-875f-946c292158f7/metrics-server/0.log" Jul 02 18:32:16.709842 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.709808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:16.765493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.765459 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:16.809021 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:16.808968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lnl55_ff49335c-8755-4bd7-a9e3-679675007b59/monitoring-plugin/0.log" Jul 02 18:32:17.927875 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:17.927852 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c6d45877f-ftqtq"] Jul 02 18:32:17.930675 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:32:17.930651 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521623c4_e87b_49f3_867c_a6d2a57c77b7.slice/crio-3df0d6a802ac88f0cfd00dccdd3c7c37c23f8cc759f20d22e79f38b997e7fcdb WatchSource:0}: Error finding container 3df0d6a802ac88f0cfd00dccdd3c7c37c23f8cc759f20d22e79f38b997e7fcdb: Status 404 returned error can't find the container with id 3df0d6a802ac88f0cfd00dccdd3c7c37c23f8cc759f20d22e79f38b997e7fcdb Jul 02 18:32:18.139231 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.139134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6876b659c9-pkvhk" event={"ID":"5b0aa196-f138-475e-9858-5a90d87b937d","Type":"ContainerStarted","Data":"668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e"} Jul 02 18:32:18.140650 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.140620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-k4c7r" event={"ID":"df468f2d-ff1e-4afe-8245-28c6f2d91aec","Type":"ContainerStarted","Data":"2c2161cdc8dadf6fb67ffacc41eb96888983d16f61cc9cca04634826da5cf355"} Jul 02 18:32:18.140994 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.140747 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:32:18.142137 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.142116 2579 patch_prober.go:28] interesting pod/downloads-685bfb5f64-k4c7r container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" start-of-body= Jul 02 18:32:18.142305 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.142156 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-k4c7r" podUID="df468f2d-ff1e-4afe-8245-28c6f2d91aec" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.16:8080/\": dial tcp 10.134.0.16:8080: connect: connection refused" Jul 02 18:32:18.142412 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.142393 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6d45877f-ftqtq" event={"ID":"521623c4-e87b-49f3-867c-a6d2a57c77b7","Type":"ContainerStarted","Data":"c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86"} Jul 02 18:32:18.142476 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.142430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6d45877f-ftqtq" event={"ID":"521623c4-e87b-49f3-867c-a6d2a57c77b7","Type":"ContainerStarted","Data":"3df0d6a802ac88f0cfd00dccdd3c7c37c23f8cc759f20d22e79f38b997e7fcdb"} Jul 02 18:32:18.158160 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.158108 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6876b659c9-pkvhk" podStartSLOduration=1.796250889 podStartE2EDuration="11.158092622s" totalImagesPullingTime="9.361841733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:32:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:32:18.157157874 +0000 UTC m=+94.154186387" watchObservedRunningTime="2026-07-02 18:32:18.158092622 +0000 UTC m=+94.155121113" Jul 02 18:32:18.189542 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.189493 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-k4c7r" podStartSLOduration=1.004039252 podStartE2EDuration="20.189475903s" totalImagesPullingTime="19.185436651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:32:18.173321649 +0000 UTC m=+94.170350207" watchObservedRunningTime="2026-07-02 18:32:18.189475903 +0000 UTC m=+94.186504396" Jul 02 18:32:18.189660 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.189595 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c6d45877f-ftqtq" podStartSLOduration=8.189586506 podStartE2EDuration="8.189586506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:32:18.188981634 +0000 UTC m=+94.186010174" watchObservedRunningTime="2026-07-02 18:32:18.189586506 +0000 UTC m=+94.186615020" Jul 02 18:32:18.206293 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.206275 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jf5gb_30271745-5c2c-4ad3-82ec-7d7322ddf9b6/init-textfile/0.log" Jul 02 18:32:18.294767 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.294727 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:18.294957 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.294818 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:18.300866 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.300843 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:18.408152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.408073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jf5gb_30271745-5c2c-4ad3-82ec-7d7322ddf9b6/node-exporter/0.log" Jul 02 18:32:18.607162 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:18.607131 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jf5gb_30271745-5c2c-4ad3-82ec-7d7322ddf9b6/kube-rbac-proxy/0.log" Jul 02 18:32:19.151963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:19.151934 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-k4c7r" Jul 02 18:32:19.153566 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:19.153538 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:20.497123 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:20.497095 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:20.497681 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:20.497145 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:20.497965 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:20.497940 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:20.810109 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:20.810034 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-g2wqd_82e2a212-ef5f-409a-a3d1-4918e28180c6/prometheus-operator/0.log" Jul 02 18:32:21.006768 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.006734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-g2wqd_82e2a212-ef5f-409a-a3d1-4918e28180c6/kube-rbac-proxy/0.log" Jul 02 18:32:21.161582 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.161512 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:32:21.203496 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.203466 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6876b659c9-pkvhk"] Jul 02 18:32:21.208419 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.208393 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-r6j9n_1b2ba0a4-5655-44dc-bef5-df9e45f7d12c/prometheus-operator-admission-webhook/0.log" Jul 02 18:32:21.406804 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.406753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/thanos-query/0.log" Jul 02 18:32:21.607359 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.607317 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy-web/0.log" Jul 02 18:32:21.807899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.807874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy/0.log" Jul 02 18:32:21.983700 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:21.983665 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:22.005869 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:22.005844 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/prom-label-proxy/0.log" Jul 02 18:32:22.084730 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:22.084697 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:22.183473 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:22.183444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:22.207214 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:22.207179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy-rules/0.log" Jul 02 18:32:22.241624 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:22.241546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:22.406796 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:22.406754 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy-metrics/0.log" Jul 02 18:32:23.208400 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:23.208355 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6876b659c9-pkvhk_5b0aa196-f138-475e-9858-5a90d87b937d/console/0.log" Jul 02 18:32:23.406944 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:23.406907 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c6d45877f-ftqtq_521623c4-e87b-49f3-867c-a6d2a57c77b7/console/0.log" Jul 02 18:32:23.609891 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:23.609815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-k4c7r_df468f2d-ff1e-4afe-8245-28c6f2d91aec/download-server/0.log" Jul 02 18:32:25.205361 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:25.205297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:25.306436 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:25.306392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:28.030748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:28.030717 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bgr8t" Jul 02 18:32:31.704569 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:31.704538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:31.769989 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:31.769951 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:34.508557 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:34.508533 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:32:34.512250 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:34.512228 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84cdf5cd44-qp7vg" Jul 02 18:32:46.709556 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:46.709525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:46.761160 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:46.761121 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:47.186268 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.186178 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6876b659c9-pkvhk" podUID="5b0aa196-f138-475e-9858-5a90d87b937d" containerName="console" containerID="cri-o://668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e" gracePeriod=15 Jul 02 18:32:47.471816 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.471791 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:47.571494 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.571468 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-oauth-config\") pod \"5b0aa196-f138-475e-9858-5a90d87b937d\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " Jul 02 18:32:47.571677 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.571528 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-service-ca\") pod \"5b0aa196-f138-475e-9858-5a90d87b937d\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " Jul 02 18:32:47.571677 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.571550 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-console-config\") pod \"5b0aa196-f138-475e-9858-5a90d87b937d\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " Jul 02 18:32:47.571677 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.571571 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-serving-cert\") pod \"5b0aa196-f138-475e-9858-5a90d87b937d\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " Jul 02 18:32:47.571677 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.571603 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqgmn\" (UniqueName: \"kubernetes.io/projected/5b0aa196-f138-475e-9858-5a90d87b937d-kube-api-access-nqgmn\") pod \"5b0aa196-f138-475e-9858-5a90d87b937d\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " Jul 02 18:32:47.571677 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.571629 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-oauth-serving-cert\") pod \"5b0aa196-f138-475e-9858-5a90d87b937d\" (UID: \"5b0aa196-f138-475e-9858-5a90d87b937d\") " Jul 02 18:32:47.572069 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.572028 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-service-ca" (OuterVolumeSpecName: "service-ca") pod "5b0aa196-f138-475e-9858-5a90d87b937d" (UID: "5b0aa196-f138-475e-9858-5a90d87b937d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:32:47.572195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.572066 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5b0aa196-f138-475e-9858-5a90d87b937d" (UID: "5b0aa196-f138-475e-9858-5a90d87b937d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:32:47.572195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.572062 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-console-config" (OuterVolumeSpecName: "console-config") pod "5b0aa196-f138-475e-9858-5a90d87b937d" (UID: "5b0aa196-f138-475e-9858-5a90d87b937d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:32:47.573799 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.573749 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5b0aa196-f138-475e-9858-5a90d87b937d" (UID: "5b0aa196-f138-475e-9858-5a90d87b937d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:32:47.573799 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.573770 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5b0aa196-f138-475e-9858-5a90d87b937d" (UID: "5b0aa196-f138-475e-9858-5a90d87b937d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:32:47.573957 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.573880 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b0aa196-f138-475e-9858-5a90d87b937d-kube-api-access-nqgmn" (OuterVolumeSpecName: "kube-api-access-nqgmn") pod "5b0aa196-f138-475e-9858-5a90d87b937d" (UID: "5b0aa196-f138-475e-9858-5a90d87b937d"). InnerVolumeSpecName "kube-api-access-nqgmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:32:47.672592 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.672554 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqgmn\" (UniqueName: \"kubernetes.io/projected/5b0aa196-f138-475e-9858-5a90d87b937d-kube-api-access-nqgmn\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:32:47.672592 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.672590 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-oauth-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:32:47.672766 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.672605 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-oauth-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:32:47.672766 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.672620 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-service-ca\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:32:47.672766 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.672634 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5b0aa196-f138-475e-9858-5a90d87b937d-console-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:32:47.672766 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:47.672647 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5b0aa196-f138-475e-9858-5a90d87b937d-console-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:32:48.273291 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.273258 2579 generic.go:356] "Generic (PLEG): container finished" podID="5b0aa196-f138-475e-9858-5a90d87b937d" containerID="668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e" exitCode=0 Jul 02 18:32:48.273739 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.273309 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6876b659c9-pkvhk" Jul 02 18:32:48.273739 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.273352 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6876b659c9-pkvhk" event={"ID":"5b0aa196-f138-475e-9858-5a90d87b937d","Type":"ContainerDied","Data":"668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e"} Jul 02 18:32:48.273739 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.273414 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6876b659c9-pkvhk" event={"ID":"5b0aa196-f138-475e-9858-5a90d87b937d","Type":"ContainerDied","Data":"b1d547866929f375cc6130757ed5a958da512ef5004663adde6429feaad0f3f7"} Jul 02 18:32:48.273739 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.273446 2579 scope.go:117] "RemoveContainer" containerID="668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e" Jul 02 18:32:48.281838 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.281823 2579 scope.go:117] "RemoveContainer" containerID="668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e" Jul 02 18:32:48.282096 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:32:48.282078 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e\": container with ID starting with 668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e not found: ID does not exist" containerID="668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e" Jul 02 18:32:48.282158 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.282106 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e"} err="failed to get container status \"668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e\": rpc error: code = NotFound desc = could not find container \"668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e\": container with ID starting with 668f7f9bdc3d594a67d0d2e083614e17678a3bcaaf8a8a91057e2579598d063e not found: ID does not exist" Jul 02 18:32:48.292066 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.292041 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6876b659c9-pkvhk"] Jul 02 18:32:48.295651 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.295632 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6876b659c9-pkvhk"] Jul 02 18:32:48.495484 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:48.495440 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b0aa196-f138-475e-9858-5a90d87b937d" path="/var/lib/kubelet/pods/5b0aa196-f138-475e-9858-5a90d87b937d/volumes" Jul 02 18:32:54.755493 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:54.755457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:54.809041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:54.809009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:32:57.200521 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:32:57.200466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:08.902872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:08.902838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:09.133809 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.133740 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:09.956326 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956292 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:33:09.956771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956567 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="alertmanager" containerID="cri-o://49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e" gracePeriod=120 Jul 02 18:33:09.956771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956641 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-metric" containerID="cri-o://ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75" gracePeriod=120 Jul 02 18:33:09.956771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956638 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-web" containerID="cri-o://10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a" gracePeriod=120 Jul 02 18:33:09.956771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956676 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="prom-label-proxy" containerID="cri-o://ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3" gracePeriod=120 Jul 02 18:33:09.956771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956670 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy" containerID="cri-o://b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30" gracePeriod=120 Jul 02 18:33:09.956771 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:09.956651 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="config-reloader" containerID="cri-o://601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7" gracePeriod=120 Jul 02 18:33:10.368174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368094 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3" exitCode=0 Jul 02 18:33:10.368174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368118 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30" exitCode=0 Jul 02 18:33:10.368174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368124 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7" exitCode=0 Jul 02 18:33:10.368174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368130 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e" exitCode=0 Jul 02 18:33:10.368174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368162 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3"} Jul 02 18:33:10.368459 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30"} Jul 02 18:33:10.368459 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7"} Jul 02 18:33:10.368459 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:10.368277 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e"} Jul 02 18:33:11.196607 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.196585 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.262759 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.262733 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-main-tls\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.262925 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.262796 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.262925 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.262823 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hnhs\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-kube-api-access-6hnhs\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.262925 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.262847 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-cluster-tls-config\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.262978 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263011 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-web\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263041 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-main-db\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263078 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-metrics-client-ca\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263154 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263152 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-volume\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263413 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263177 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-web-config\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263413 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263204 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263413 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263227 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-out\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.263413 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.263264 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-tls-assets\") pod \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\" (UID: \"5c9575ae-e6c8-474b-9baf-dd9ffebbe841\") " Jul 02 18:33:11.264306 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.264242 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 18:33:11.264646 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.264616 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:33:11.264741 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.264695 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:33:11.266203 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.266172 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:33:11.266584 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.266553 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-kube-api-access-6hnhs" (OuterVolumeSpecName: "kube-api-access-6hnhs") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "kube-api-access-6hnhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:33:11.266695 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.266658 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.267254 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.267220 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-out" (OuterVolumeSpecName: "config-out") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 18:33:11.267487 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.267455 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.267579 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.267553 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.267959 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.267931 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-volume" (OuterVolumeSpecName: "config-volume") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.268232 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.268211 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.271051 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.271001 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.278265 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.278214 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-web-config" (OuterVolumeSpecName: "web-config") pod "5c9575ae-e6c8-474b-9baf-dd9ffebbe841" (UID: "5c9575ae-e6c8-474b-9baf-dd9ffebbe841"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:11.363789 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363748 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-volume\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363789 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363801 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-web-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363812 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363823 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-config-out\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363831 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-tls-assets\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363839 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-main-tls\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363847 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363856 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hnhs\" (UniqueName: \"kubernetes.io/projected/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-kube-api-access-6hnhs\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363863 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-cluster-tls-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363872 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363881 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363889 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-alertmanager-main-db\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.363968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.363897 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c9575ae-e6c8-474b-9baf-dd9ffebbe841-metrics-client-ca\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:11.374913 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.374881 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75" exitCode=0 Jul 02 18:33:11.374913 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.374905 2579 generic.go:356] "Generic (PLEG): container finished" podID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerID="10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a" exitCode=0 Jul 02 18:33:11.375106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.374949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75"} Jul 02 18:33:11.375106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.374971 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.375106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.375033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a"} Jul 02 18:33:11.375106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.375062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5c9575ae-e6c8-474b-9baf-dd9ffebbe841","Type":"ContainerDied","Data":"3b7d976208942c6c4f1ef73792a8fd33803f6d84258c87fc57ddd2be178bf1b6"} Jul 02 18:33:11.375106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.375091 2579 scope.go:117] "RemoveContainer" containerID="ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3" Jul 02 18:33:11.382741 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.382724 2579 scope.go:117] "RemoveContainer" containerID="ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75" Jul 02 18:33:11.389567 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.389548 2579 scope.go:117] "RemoveContainer" containerID="b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30" Jul 02 18:33:11.396671 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.396656 2579 scope.go:117] "RemoveContainer" containerID="10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a" Jul 02 18:33:11.396952 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.396930 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:33:11.400817 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.400796 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:33:11.403515 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.403499 2579 scope.go:117] "RemoveContainer" containerID="601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7" Jul 02 18:33:11.410163 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.410145 2579 scope.go:117] "RemoveContainer" containerID="49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e" Jul 02 18:33:11.416759 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.416736 2579 scope.go:117] "RemoveContainer" containerID="396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b" Jul 02 18:33:11.424546 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.424527 2579 scope.go:117] "RemoveContainer" containerID="ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3" Jul 02 18:33:11.424958 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.424928 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3\": container with ID starting with ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3 not found: ID does not exist" containerID="ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3" Jul 02 18:33:11.425074 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.424967 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3"} err="failed to get container status \"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3\": rpc error: code = NotFound desc = could not find container \"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3\": container with ID starting with ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3 not found: ID does not exist" Jul 02 18:33:11.425074 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.424989 2579 scope.go:117] "RemoveContainer" containerID="ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75" Jul 02 18:33:11.425299 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.425274 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75\": container with ID starting with ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75 not found: ID does not exist" containerID="ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75" Jul 02 18:33:11.425387 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.425306 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75"} err="failed to get container status \"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75\": rpc error: code = NotFound desc = could not find container \"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75\": container with ID starting with ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75 not found: ID does not exist" Jul 02 18:33:11.425387 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.425330 2579 scope.go:117] "RemoveContainer" containerID="b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30" Jul 02 18:33:11.425732 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.425710 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30\": container with ID starting with b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30 not found: ID does not exist" containerID="b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30" Jul 02 18:33:11.425825 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.425740 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30"} err="failed to get container status \"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30\": rpc error: code = NotFound desc = could not find container \"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30\": container with ID starting with b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30 not found: ID does not exist" Jul 02 18:33:11.425825 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.425765 2579 scope.go:117] "RemoveContainer" containerID="10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a" Jul 02 18:33:11.426057 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.426039 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a\": container with ID starting with 10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a not found: ID does not exist" containerID="10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a" Jul 02 18:33:11.426103 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426063 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a"} err="failed to get container status \"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a\": rpc error: code = NotFound desc = could not find container \"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a\": container with ID starting with 10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a not found: ID does not exist" Jul 02 18:33:11.426103 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426081 2579 scope.go:117] "RemoveContainer" containerID="601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7" Jul 02 18:33:11.426324 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.426310 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7\": container with ID starting with 601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7 not found: ID does not exist" containerID="601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7" Jul 02 18:33:11.426372 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426320 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:33:11.426372 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426327 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7"} err="failed to get container status \"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7\": rpc error: code = NotFound desc = could not find container \"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7\": container with ID starting with 601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7 not found: ID does not exist" Jul 02 18:33:11.426372 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426340 2579 scope.go:117] "RemoveContainer" containerID="49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e" Jul 02 18:33:11.426567 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.426553 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e\": container with ID starting with 49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e not found: ID does not exist" containerID="49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e" Jul 02 18:33:11.426605 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426580 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e"} err="failed to get container status \"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e\": rpc error: code = NotFound desc = could not find container \"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e\": container with ID starting with 49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e not found: ID does not exist" Jul 02 18:33:11.426605 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426586 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="config-reloader" Jul 02 18:33:11.426605 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426592 2579 scope.go:117] "RemoveContainer" containerID="396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b" Jul 02 18:33:11.426605 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426598 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="config-reloader" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426609 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-web" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426616 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-web" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426623 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-metric" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426658 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-metric" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426670 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="alertmanager" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426678 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="alertmanager" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426685 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426694 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426715 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="prom-label-proxy" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426725 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="prom-label-proxy" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426738 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b0aa196-f138-475e-9858-5a90d87b937d" containerName="console" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426746 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b0aa196-f138-475e-9858-5a90d87b937d" containerName="console" Jul 02 18:33:11.426756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426759 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="init-config-reloader" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426768 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="init-config-reloader" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:11.426840 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b\": container with ID starting with 396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b not found: ID does not exist" containerID="396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426863 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="alertmanager" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426859 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b"} err="failed to get container status \"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b\": rpc error: code = NotFound desc = could not find container \"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b\": container with ID starting with 396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b not found: ID does not exist" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426872 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="config-reloader" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426876 2579 scope.go:117] "RemoveContainer" containerID="ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426878 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-web" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426929 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426935 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b0aa196-f138-475e-9858-5a90d87b937d" containerName="console" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426946 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="kube-rbac-proxy-metric" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.426953 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" containerName="prom-label-proxy" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427138 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3"} err="failed to get container status \"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3\": rpc error: code = NotFound desc = could not find container \"ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3\": container with ID starting with ef502fc77ccdde39c6894a27afba2ea065ff019ba398a750bda1f88feb405bc3 not found: ID does not exist" Jul 02 18:33:11.427195 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427154 2579 scope.go:117] "RemoveContainer" containerID="ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75" Jul 02 18:33:11.427636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427374 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75"} err="failed to get container status \"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75\": rpc error: code = NotFound desc = could not find container \"ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75\": container with ID starting with ca633aa35275a848dc8aa59085e17131832e309c883dafb96b5be37347cc7b75 not found: ID does not exist" Jul 02 18:33:11.427636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427389 2579 scope.go:117] "RemoveContainer" containerID="b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30" Jul 02 18:33:11.427636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427582 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30"} err="failed to get container status \"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30\": rpc error: code = NotFound desc = could not find container \"b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30\": container with ID starting with b0d3d6c6d836532ab73c7c719b85069d8bf8760d57b734390d411114b7d3de30 not found: ID does not exist" Jul 02 18:33:11.427636 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427596 2579 scope.go:117] "RemoveContainer" containerID="10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a" Jul 02 18:33:11.427834 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427813 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a"} err="failed to get container status \"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a\": rpc error: code = NotFound desc = could not find container \"10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a\": container with ID starting with 10a9fcf8b517ae145feadab6a4b94a5f1c2a8ded3929a4a9a7a185eefe6f9a9a not found: ID does not exist" Jul 02 18:33:11.427881 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.427834 2579 scope.go:117] "RemoveContainer" containerID="601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7" Jul 02 18:33:11.428099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.428072 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7"} err="failed to get container status \"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7\": rpc error: code = NotFound desc = could not find container \"601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7\": container with ID starting with 601840c70ceea267bfc76391bf25a27e94a23621103941207986730f348797e7 not found: ID does not exist" Jul 02 18:33:11.428099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.428088 2579 scope.go:117] "RemoveContainer" containerID="49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e" Jul 02 18:33:11.428470 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.428442 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e"} err="failed to get container status \"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e\": rpc error: code = NotFound desc = could not find container \"49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e\": container with ID starting with 49cb78391dab616bdc94e037dc822d325378b7eab88817995486a7b0bf724e5e not found: ID does not exist" Jul 02 18:33:11.428470 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.428470 2579 scope.go:117] "RemoveContainer" containerID="396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b" Jul 02 18:33:11.428757 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.428724 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b"} err="failed to get container status \"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b\": rpc error: code = NotFound desc = could not find container \"396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b\": container with ID starting with 396bedee878d800e7ea1d1aff610773c3239ee14b0a285a9cefa2cb0b55c3f8b not found: ID does not exist" Jul 02 18:33:11.430839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.430821 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.432759 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.432739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 18:33:11.432944 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.432885 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 18:33:11.433023 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.432970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 18:33:11.433023 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.432978 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 18:33:11.433023 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.432998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 18:33:11.433191 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.433049 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-br5mq\"" Jul 02 18:33:11.433191 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.433078 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 18:33:11.433191 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.433079 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 18:33:11.433191 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.433186 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 18:33:11.437823 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.437789 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 18:33:11.443499 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.443474 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:33:11.464798 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c31cae2b-ca97-4726-96d6-8d2b607c212a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.464798 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-config-volume\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.464798 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c31cae2b-ca97-4726-96d6-8d2b607c212a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.464983 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.464983 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.464983 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.464983 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.464944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5g6h\" (UniqueName: \"kubernetes.io/projected/c31cae2b-ca97-4726-96d6-8d2b607c212a-kube-api-access-c5g6h\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.465168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.465013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c31cae2b-ca97-4726-96d6-8d2b607c212a-config-out\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.465168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.465044 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.465168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.465079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c31cae2b-ca97-4726-96d6-8d2b607c212a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.465168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.465115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.465168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.465132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-web-config\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.465168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.465156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c31cae2b-ca97-4726-96d6-8d2b607c212a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.565890 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c31cae2b-ca97-4726-96d6-8d2b607c212a-config-out\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.565890 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565835 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.565890 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c31cae2b-ca97-4726-96d6-8d2b607c212a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-web-config\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565939 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c31cae2b-ca97-4726-96d6-8d2b607c212a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.565971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c31cae2b-ca97-4726-96d6-8d2b607c212a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-config-volume\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c31cae2b-ca97-4726-96d6-8d2b607c212a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566152 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566579 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566579 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5g6h\" (UniqueName: \"kubernetes.io/projected/c31cae2b-ca97-4726-96d6-8d2b607c212a-kube-api-access-c5g6h\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.566579 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.566279 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c31cae2b-ca97-4726-96d6-8d2b607c212a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.567341 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.567281 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c31cae2b-ca97-4726-96d6-8d2b607c212a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.567533 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.567484 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c31cae2b-ca97-4726-96d6-8d2b607c212a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.568765 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.568741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c31cae2b-ca97-4726-96d6-8d2b607c212a-config-out\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.569214 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.569169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c31cae2b-ca97-4726-96d6-8d2b607c212a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.569317 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.569274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.569379 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.569325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.569379 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.569371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-web-config\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.569627 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.569604 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-config-volume\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.569853 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.569839 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.570051 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.570031 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.570578 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.570552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c31cae2b-ca97-4726-96d6-8d2b607c212a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.573836 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.573820 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5g6h\" (UniqueName: \"kubernetes.io/projected/c31cae2b-ca97-4726-96d6-8d2b607c212a-kube-api-access-c5g6h\") pod \"alertmanager-main-0\" (UID: \"c31cae2b-ca97-4726-96d6-8d2b607c212a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.740628 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.740594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 18:33:11.870140 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:11.870112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 18:33:11.871983 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:33:11.871959 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31cae2b_ca97_4726_96d6_8d2b607c212a.slice/crio-47b5603fc82984475a81f839599c709108228ccb18651baad444373b5e940ab4 WatchSource:0}: Error finding container 47b5603fc82984475a81f839599c709108228ccb18651baad444373b5e940ab4: Status 404 returned error can't find the container with id 47b5603fc82984475a81f839599c709108228ccb18651baad444373b5e940ab4 Jul 02 18:33:12.380707 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:12.380670 2579 generic.go:356] "Generic (PLEG): container finished" podID="c31cae2b-ca97-4726-96d6-8d2b607c212a" containerID="7c7af5ebe5cab9c11e820236332e400849735f2d31f9ed94660b3787e0cd4c0c" exitCode=0 Jul 02 18:33:12.381108 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:12.380744 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerDied","Data":"7c7af5ebe5cab9c11e820236332e400849735f2d31f9ed94660b3787e0cd4c0c"} Jul 02 18:33:12.381108 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:12.380828 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"47b5603fc82984475a81f839599c709108228ccb18651baad444373b5e940ab4"} Jul 02 18:33:12.496318 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:12.496291 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c9575ae-e6c8-474b-9baf-dd9ffebbe841" path="/var/lib/kubelet/pods/5c9575ae-e6c8-474b-9baf-dd9ffebbe841/volumes" Jul 02 18:33:13.387931 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.387892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"e53d6419b7a2c7268171ef20b8857bb17261a29e73d43c5216c2c3801e8f1c17"} Jul 02 18:33:13.388414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.388001 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"4f9411aacd53850131378a9bc9d5d0389a8801a8af62f6ef3b9efbe608b46d1d"} Jul 02 18:33:13.388414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.388055 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"5357296a81882f0ca3c6cc1077b7727d1fbb69de4cb1c4fc547fd96a0583d1a4"} Jul 02 18:33:13.388414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.388098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"4247026546c5eb49296832b4f91ee61619bbbb7fd4ed1f9a2d47f881674e0540"} Jul 02 18:33:13.388414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.388140 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"cdb05a49329cb6b4fe37b588bd12f70c4d90eec3324db5cccd636524f63e0f04"} Jul 02 18:33:13.388414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.388180 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c31cae2b-ca97-4726-96d6-8d2b607c212a","Type":"ContainerStarted","Data":"ff05d8d42d8ef45348442afdb65726f1f47f2eef1976ad5441262fc2852fe45c"} Jul 02 18:33:13.413168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.413116 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.398034226 podStartE2EDuration="2.41309544s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.061214ms" isStatefulPod=false podCreationTimestamp="2026-07-02 18:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:33:13.41099647 +0000 UTC m=+149.408024983" watchObservedRunningTime="2026-07-02 18:33:13.41309544 +0000 UTC m=+149.410123954" Jul 02 18:33:13.963639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.963591 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b8648cc8c-g5l89"] Jul 02 18:33:13.966715 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.966694 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.969046 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.969019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 18:33:13.969161 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.969086 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-g6m55\"" Jul 02 18:33:13.969161 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.969115 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 18:33:13.969286 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.969231 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 18:33:13.969360 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.969343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 18:33:13.969423 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.969408 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 18:33:13.974924 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.974891 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 18:33:13.982455 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.982435 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b8648cc8c-g5l89"] Jul 02 18:33:13.984140 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-metrics-client-ca\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984251 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-secret-telemeter-client\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984251 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6xzd\" (UniqueName: \"kubernetes.io/projected/fee7df20-f87a-4ab4-9584-b366b7dfa415-kube-api-access-t6xzd\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984346 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984346 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-telemeter-client-tls\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984431 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984431 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-federate-client-tls\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:13.984524 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:13.984453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-serving-certs-ca-bundle\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.085684 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-metrics-client-ca\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.085896 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085697 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-secret-telemeter-client\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.085896 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085729 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6xzd\" (UniqueName: \"kubernetes.io/projected/fee7df20-f87a-4ab4-9584-b366b7dfa415-kube-api-access-t6xzd\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.085896 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.085896 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-telemeter-client-tls\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.085896 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085875 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.086133 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-federate-client-tls\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.086133 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.085943 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-serving-certs-ca-bundle\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.087287 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.086667 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-serving-certs-ca-bundle\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.087287 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.087147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.087713 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.087675 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee7df20-f87a-4ab4-9584-b366b7dfa415-metrics-client-ca\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.089612 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.089582 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-federate-client-tls\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.089612 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.089597 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-secret-telemeter-client\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.089811 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.089726 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.089933 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.089913 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fee7df20-f87a-4ab4-9584-b366b7dfa415-telemeter-client-tls\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.102156 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.102129 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6xzd\" (UniqueName: \"kubernetes.io/projected/fee7df20-f87a-4ab4-9584-b366b7dfa415-kube-api-access-t6xzd\") pod \"telemeter-client-b8648cc8c-g5l89\" (UID: \"fee7df20-f87a-4ab4-9584-b366b7dfa415\") " pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.278847 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.278650 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" Jul 02 18:33:14.432603 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:14.432580 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b8648cc8c-g5l89"] Jul 02 18:33:14.435022 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:33:14.434993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee7df20_f87a_4ab4_9584_b366b7dfa415.slice/crio-489752830f1e18dd45ade8b08ee156fd1ac33ec5444558392a18a61385ac1647 WatchSource:0}: Error finding container 489752830f1e18dd45ade8b08ee156fd1ac33ec5444558392a18a61385ac1647: Status 404 returned error can't find the container with id 489752830f1e18dd45ade8b08ee156fd1ac33ec5444558392a18a61385ac1647 Jul 02 18:33:15.398322 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:15.398284 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" event={"ID":"fee7df20-f87a-4ab4-9584-b366b7dfa415","Type":"ContainerStarted","Data":"489752830f1e18dd45ade8b08ee156fd1ac33ec5444558392a18a61385ac1647"} Jul 02 18:33:16.404137 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:16.404094 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" event={"ID":"fee7df20-f87a-4ab4-9584-b366b7dfa415","Type":"ContainerStarted","Data":"68f3bce76032862377b48f25f3c7a37aba47280cf17135b172f32bc7224ea408"} Jul 02 18:33:16.404447 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:16.404183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" event={"ID":"fee7df20-f87a-4ab4-9584-b366b7dfa415","Type":"ContainerStarted","Data":"3004a907ad202b9d3d401e91a20f383d3e145f0793e55293d4fafc8fee8c9035"} Jul 02 18:33:17.409647 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:17.409611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" event={"ID":"fee7df20-f87a-4ab4-9584-b366b7dfa415","Type":"ContainerStarted","Data":"42f15cd9e87b1717844b4a5d79d66682fe305c683f2021cc193544d03a2b4450"} Jul 02 18:33:17.432888 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:17.432831 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b8648cc8c-g5l89" podStartSLOduration=2.596546833 podStartE2EDuration="4.432815734s" totalImagesPullingTime="1.836268901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:33:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:33:17.431260827 +0000 UTC m=+153.428289350" watchObservedRunningTime="2026-07-02 18:33:17.432815734 +0000 UTC m=+153.429844246" Jul 02 18:33:18.185795 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.185743 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77df996f95-tj986"] Jul 02 18:33:18.188364 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.188341 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.201622 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.201599 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77df996f95-tj986"] Jul 02 18:33:18.222362 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-serving-cert\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.222518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwrpw\" (UniqueName: \"kubernetes.io/projected/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-kube-api-access-rwrpw\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.222518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-oauth-config\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.222518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-config\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.222518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-service-ca\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.222518 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-oauth-serving-cert\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.222683 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.222541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-trusted-ca-bundle\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.240073 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.240029 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:18.323581 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-serving-cert\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.323791 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwrpw\" (UniqueName: \"kubernetes.io/projected/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-kube-api-access-rwrpw\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.323791 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-oauth-config\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.323791 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-config\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.323791 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-service-ca\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.323791 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323684 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-oauth-serving-cert\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.323791 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.323700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-trusted-ca-bundle\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.324542 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.324516 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-service-ca\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.324746 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.324721 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-config\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.324849 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.324812 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-trusted-ca-bundle\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.324934 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.324860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-oauth-serving-cert\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.326440 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.326395 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-oauth-config\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.327041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.327017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-serving-cert\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.330667 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.330644 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwrpw\" (UniqueName: \"kubernetes.io/projected/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-kube-api-access-rwrpw\") pod \"console-77df996f95-tj986\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.341635 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.341607 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:18.499173 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.499143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:18.624234 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:18.624209 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77df996f95-tj986"] Jul 02 18:33:18.626804 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:33:18.626750 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9b5341_d77c_4ae9_add0_00e6a9b6b091.slice/crio-3f2c6363c199baa349231aa9b9029cca8fbcb052b638138a470329c7b4802541 WatchSource:0}: Error finding container 3f2c6363c199baa349231aa9b9029cca8fbcb052b638138a470329c7b4802541: Status 404 returned error can't find the container with id 3f2c6363c199baa349231aa9b9029cca8fbcb052b638138a470329c7b4802541 Jul 02 18:33:19.420041 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:19.420007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df996f95-tj986" event={"ID":"8a9b5341-d77c-4ae9-add0-00e6a9b6b091","Type":"ContainerStarted","Data":"ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e"} Jul 02 18:33:19.420240 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:19.420053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df996f95-tj986" event={"ID":"8a9b5341-d77c-4ae9-add0-00e6a9b6b091","Type":"ContainerStarted","Data":"3f2c6363c199baa349231aa9b9029cca8fbcb052b638138a470329c7b4802541"} Jul 02 18:33:19.436422 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:19.436382 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77df996f95-tj986" podStartSLOduration=1.436366738 podStartE2EDuration="1.436366738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:33:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:33:19.435411249 +0000 UTC m=+155.432439763" watchObservedRunningTime="2026-07-02 18:33:19.436366738 +0000 UTC m=+155.433395250" Jul 02 18:33:28.499462 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:28.499431 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:28.499883 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:28.499496 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:28.504475 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:28.504455 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:29.463007 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:29.462979 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:33:29.506733 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:29.506699 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6d45877f-ftqtq"] Jul 02 18:33:29.630632 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:29.630589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:29.730514 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:29.730410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:29.830059 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:29.830017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:44.936033 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:44.935996 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:44.989353 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:44.989320 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:33:54.529394 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.529339 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c6d45877f-ftqtq" podUID="521623c4-e87b-49f3-867c-a6d2a57c77b7" containerName="console" containerID="cri-o://c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86" gracePeriod=15 Jul 02 18:33:54.768071 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.768048 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:33:54.922076 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.921999 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-trusted-ca-bundle\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922076 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922052 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-serving-cert\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922435 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922087 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-oauth-serving-cert\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922435 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922113 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv5v2\" (UniqueName: \"kubernetes.io/projected/521623c4-e87b-49f3-867c-a6d2a57c77b7-kube-api-access-mv5v2\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922435 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922134 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-service-ca\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922435 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922197 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-config\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922435 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922245 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-oauth-config\") pod \"521623c4-e87b-49f3-867c-a6d2a57c77b7\" (UID: \"521623c4-e87b-49f3-867c-a6d2a57c77b7\") " Jul 02 18:33:54.922680 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922507 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:33:54.922680 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922556 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-service-ca" (OuterVolumeSpecName: "service-ca") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:33:54.922680 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922578 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-config" (OuterVolumeSpecName: "console-config") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:33:54.922870 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.922693 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:33:54.924199 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.924171 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:54.924300 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.924247 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/521623c4-e87b-49f3-867c-a6d2a57c77b7-kube-api-access-mv5v2" (OuterVolumeSpecName: "kube-api-access-mv5v2") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "kube-api-access-mv5v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:33:54.924300 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:54.924253 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "521623c4-e87b-49f3-867c-a6d2a57c77b7" (UID: "521623c4-e87b-49f3-867c-a6d2a57c77b7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:33:55.023832 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023772 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.023832 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023827 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-oauth-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.023832 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023837 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-trusted-ca-bundle\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.023832 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023846 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/521623c4-e87b-49f3-867c-a6d2a57c77b7-console-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.024066 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023856 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-oauth-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.024066 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023864 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv5v2\" (UniqueName: \"kubernetes.io/projected/521623c4-e87b-49f3-867c-a6d2a57c77b7-kube-api-access-mv5v2\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.024066 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.023873 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/521623c4-e87b-49f3-867c-a6d2a57c77b7-service-ca\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:33:55.557221 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.557187 2579 generic.go:356] "Generic (PLEG): container finished" podID="521623c4-e87b-49f3-867c-a6d2a57c77b7" containerID="c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86" exitCode=0 Jul 02 18:33:55.557699 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.557238 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c6d45877f-ftqtq" Jul 02 18:33:55.557699 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.557270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6d45877f-ftqtq" event={"ID":"521623c4-e87b-49f3-867c-a6d2a57c77b7","Type":"ContainerDied","Data":"c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86"} Jul 02 18:33:55.557699 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.557316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c6d45877f-ftqtq" event={"ID":"521623c4-e87b-49f3-867c-a6d2a57c77b7","Type":"ContainerDied","Data":"3df0d6a802ac88f0cfd00dccdd3c7c37c23f8cc759f20d22e79f38b997e7fcdb"} Jul 02 18:33:55.557699 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.557335 2579 scope.go:117] "RemoveContainer" containerID="c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86" Jul 02 18:33:55.565932 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.565918 2579 scope.go:117] "RemoveContainer" containerID="c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86" Jul 02 18:33:55.566172 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:33:55.566156 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86\": container with ID starting with c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86 not found: ID does not exist" containerID="c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86" Jul 02 18:33:55.566212 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.566181 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86"} err="failed to get container status \"c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86\": rpc error: code = NotFound desc = could not find container \"c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86\": container with ID starting with c1daeffdd523d0ce346002768846798f82b198703f62b5d55d2c0ac9e1b3ba86 not found: ID does not exist" Jul 02 18:33:55.576166 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.576145 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c6d45877f-ftqtq"] Jul 02 18:33:55.581854 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:55.581835 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c6d45877f-ftqtq"] Jul 02 18:33:56.495248 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:33:56.495215 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="521623c4-e87b-49f3-867c-a6d2a57c77b7" path="/var/lib/kubelet/pods/521623c4-e87b-49f3-867c-a6d2a57c77b7/volumes" Jul 02 18:34:16.375759 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:16.375719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:24.099897 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:24.099866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:24.159169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:24.159142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:29.332820 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.332786 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84bdc59c6c-tpbgb"] Jul 02 18:34:29.333272 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.333126 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="521623c4-e87b-49f3-867c-a6d2a57c77b7" containerName="console" Jul 02 18:34:29.333272 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.333140 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="521623c4-e87b-49f3-867c-a6d2a57c77b7" containerName="console" Jul 02 18:34:29.333272 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.333196 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="521623c4-e87b-49f3-867c-a6d2a57c77b7" containerName="console" Jul 02 18:34:29.336409 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.336390 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.346924 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.346900 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bdc59c6c-tpbgb"] Jul 02 18:34:29.380418 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.380388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:29.395539 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-trusted-ca-bundle\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.395640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395556 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-config\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.395640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-oauth-serving-cert\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.395640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395625 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-serving-cert\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.395839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395639 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-service-ca\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.395839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwsvw\" (UniqueName: \"kubernetes.io/projected/f427a756-ee27-4f40-9c92-67a2ce1b37dd-kube-api-access-vwsvw\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.395839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.395702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-oauth-config\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.435955 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.435925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:29.496421 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-trusted-ca-bundle\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.496562 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-config\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.496562 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-oauth-serving-cert\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.496562 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-serving-cert\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.496562 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-service-ca\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.496562 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwsvw\" (UniqueName: \"kubernetes.io/projected/f427a756-ee27-4f40-9c92-67a2ce1b37dd-kube-api-access-vwsvw\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.496840 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.496587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-oauth-config\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.497321 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.497295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-service-ca\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.497430 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.497316 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-oauth-serving-cert\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.497430 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.497415 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-trusted-ca-bundle\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.497535 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.497438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-config\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.499022 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.499001 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-serving-cert\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.499111 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.499024 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-oauth-config\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.503395 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.503375 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwsvw\" (UniqueName: \"kubernetes.io/projected/f427a756-ee27-4f40-9c92-67a2ce1b37dd-kube-api-access-vwsvw\") pod \"console-84bdc59c6c-tpbgb\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.645566 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.645491 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:29.774146 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:29.774124 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bdc59c6c-tpbgb"] Jul 02 18:34:29.776235 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:34:29.776196 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf427a756_ee27_4f40_9c92_67a2ce1b37dd.slice/crio-51851d876db375c6c09be980ad4b3f5d9dd149f8c098e0a8248a9687db1102c6 WatchSource:0}: Error finding container 51851d876db375c6c09be980ad4b3f5d9dd149f8c098e0a8248a9687db1102c6: Status 404 returned error can't find the container with id 51851d876db375c6c09be980ad4b3f5d9dd149f8c098e0a8248a9687db1102c6 Jul 02 18:34:30.693250 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:30.693218 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bdc59c6c-tpbgb" event={"ID":"f427a756-ee27-4f40-9c92-67a2ce1b37dd","Type":"ContainerStarted","Data":"5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093"} Jul 02 18:34:30.693750 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:30.693275 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bdc59c6c-tpbgb" event={"ID":"f427a756-ee27-4f40-9c92-67a2ce1b37dd","Type":"ContainerStarted","Data":"51851d876db375c6c09be980ad4b3f5d9dd149f8c098e0a8248a9687db1102c6"} Jul 02 18:34:30.710034 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:30.709990 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84bdc59c6c-tpbgb" podStartSLOduration=1.709974745 podStartE2EDuration="1.709974745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:34:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:34:30.708819809 +0000 UTC m=+226.705848341" watchObservedRunningTime="2026-07-02 18:34:30.709974745 +0000 UTC m=+226.707003257" Jul 02 18:34:32.724884 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:32.724833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:36.022761 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:36.022721 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:36.070116 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:36.070086 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:39.645682 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:39.645647 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:39.646193 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:39.645714 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:39.650143 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:39.650120 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:39.730430 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:39.730400 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:34:39.781750 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:39.781718 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77df996f95-tj986"] Jul 02 18:34:39.900748 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:39.900648 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:40.001710 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:40.001678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:40.103590 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:40.103559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:46.717314 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:46.717283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:46.815449 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:46.815409 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:46.916173 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:46.916141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:48.292462 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:48.292424 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:34:48.390218 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:34:48.390191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:04.802325 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:04.802277 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77df996f95-tj986" podUID="8a9b5341-d77c-4ae9-add0-00e6a9b6b091" containerName="console" containerID="cri-o://ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e" gracePeriod=15 Jul 02 18:35:05.055130 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.055072 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:35:05.097643 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097607 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-trusted-ca-bundle\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.097643 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097644 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-service-ca\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.097907 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097685 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-serving-cert\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.097907 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097707 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-oauth-serving-cert\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.097907 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097742 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwrpw\" (UniqueName: \"kubernetes.io/projected/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-kube-api-access-rwrpw\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.097907 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097799 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-oauth-config\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.097907 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.097831 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-config\") pod \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\" (UID: \"8a9b5341-d77c-4ae9-add0-00e6a9b6b091\") " Jul 02 18:35:05.098164 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.098091 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:35:05.098164 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.098105 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:35:05.098300 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.098274 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-config" (OuterVolumeSpecName: "console-config") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:35:05.098383 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.098323 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:35:05.100006 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.099977 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:35:05.100095 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.100049 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-kube-api-access-rwrpw" (OuterVolumeSpecName: "kube-api-access-rwrpw") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "kube-api-access-rwrpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:35:05.100095 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.100051 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a9b5341-d77c-4ae9-add0-00e6a9b6b091" (UID: "8a9b5341-d77c-4ae9-add0-00e6a9b6b091"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.198952 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.199004 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-oauth-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.199019 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwrpw\" (UniqueName: \"kubernetes.io/projected/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-kube-api-access-rwrpw\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.199034 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-oauth-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.199052 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-console-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.199066 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-trusted-ca-bundle\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.203441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.199079 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a9b5341-d77c-4ae9-add0-00e6a9b6b091-service-ca\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:35:05.830451 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.830415 2579 generic.go:356] "Generic (PLEG): container finished" podID="8a9b5341-d77c-4ae9-add0-00e6a9b6b091" containerID="ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e" exitCode=0 Jul 02 18:35:05.830861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.830487 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77df996f95-tj986" Jul 02 18:35:05.830861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.830507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df996f95-tj986" event={"ID":"8a9b5341-d77c-4ae9-add0-00e6a9b6b091","Type":"ContainerDied","Data":"ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e"} Jul 02 18:35:05.830861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.830563 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77df996f95-tj986" event={"ID":"8a9b5341-d77c-4ae9-add0-00e6a9b6b091","Type":"ContainerDied","Data":"3f2c6363c199baa349231aa9b9029cca8fbcb052b638138a470329c7b4802541"} Jul 02 18:35:05.830861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.830582 2579 scope.go:117] "RemoveContainer" containerID="ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e" Jul 02 18:35:05.839503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.839482 2579 scope.go:117] "RemoveContainer" containerID="ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e" Jul 02 18:35:05.839765 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:35:05.839745 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e\": container with ID starting with ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e not found: ID does not exist" containerID="ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e" Jul 02 18:35:05.839856 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.839793 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e"} err="failed to get container status \"ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e\": rpc error: code = NotFound desc = could not find container \"ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e\": container with ID starting with ccd4afaaec91dcedb17a1383b01a3337f15a0c41a412b6497e542dffe7e1294e not found: ID does not exist" Jul 02 18:35:05.856145 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.856108 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77df996f95-tj986"] Jul 02 18:35:05.868809 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.868763 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77df996f95-tj986"] Jul 02 18:35:05.931247 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.931218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:05.943470 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.943445 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2"] Jul 02 18:35:05.943760 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.943749 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9b5341-d77c-4ae9-add0-00e6a9b6b091" containerName="console" Jul 02 18:35:05.943837 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.943762 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9b5341-d77c-4ae9-add0-00e6a9b6b091" containerName="console" Jul 02 18:35:05.943837 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.943823 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9b5341-d77c-4ae9-add0-00e6a9b6b091" containerName="console" Jul 02 18:35:05.947774 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.947758 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:05.949813 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.949790 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-spvzk\"" Jul 02 18:35:05.949921 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.949854 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 18:35:05.949997 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.949981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 18:35:05.950084 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.950068 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 18:35:05.950146 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.950077 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 18:35:05.953361 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:05.953336 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2"] Jul 02 18:35:06.005708 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.005680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckkr5\" (UniqueName: \"kubernetes.io/projected/21d2d5e4-4d4f-489e-b1ea-384e934db41e-kube-api-access-ckkr5\") pod \"managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2\" (UID: \"21d2d5e4-4d4f-489e-b1ea-384e934db41e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.005909 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.005743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21d2d5e4-4d4f-489e-b1ea-384e934db41e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2\" (UID: \"21d2d5e4-4d4f-489e-b1ea-384e934db41e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.033427 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.033387 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:06.036479 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.036444 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2"] Jul 02 18:35:06.039484 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.039463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.041317 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.041303 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 18:35:06.047591 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.047565 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2"] Jul 02 18:35:06.095589 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.095482 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:06.106937 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.106916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vb6n\" (UniqueName: \"kubernetes.io/projected/93b04af0-620b-4325-b69a-9f892b1c3ecb-kube-api-access-2vb6n\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.107050 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.106970 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckkr5\" (UniqueName: \"kubernetes.io/projected/21d2d5e4-4d4f-489e-b1ea-384e934db41e-kube-api-access-ckkr5\") pod \"managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2\" (UID: \"21d2d5e4-4d4f-489e-b1ea-384e934db41e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.107050 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.107022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/93b04af0-620b-4325-b69a-9f892b1c3ecb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.107135 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.107087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21d2d5e4-4d4f-489e-b1ea-384e934db41e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2\" (UID: \"21d2d5e4-4d4f-489e-b1ea-384e934db41e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.107135 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.107129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93b04af0-620b-4325-b69a-9f892b1c3ecb-tmp\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.109522 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.109500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/21d2d5e4-4d4f-489e-b1ea-384e934db41e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2\" (UID: \"21d2d5e4-4d4f-489e-b1ea-384e934db41e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.114005 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.113979 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckkr5\" (UniqueName: \"kubernetes.io/projected/21d2d5e4-4d4f-489e-b1ea-384e934db41e-kube-api-access-ckkr5\") pod \"managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2\" (UID: \"21d2d5e4-4d4f-489e-b1ea-384e934db41e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.208019 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.207979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/93b04af0-620b-4325-b69a-9f892b1c3ecb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.208189 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.208067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93b04af0-620b-4325-b69a-9f892b1c3ecb-tmp\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.208189 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.208098 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vb6n\" (UniqueName: \"kubernetes.io/projected/93b04af0-620b-4325-b69a-9f892b1c3ecb-kube-api-access-2vb6n\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.208504 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.208478 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93b04af0-620b-4325-b69a-9f892b1c3ecb-tmp\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.210511 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.210493 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/93b04af0-620b-4325-b69a-9f892b1c3ecb-klusterlet-config\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.215436 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.215401 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vb6n\" (UniqueName: \"kubernetes.io/projected/93b04af0-620b-4325-b69a-9f892b1c3ecb-kube-api-access-2vb6n\") pod \"klusterlet-addon-workmgr-7ffdfcb7bf-stfs2\" (UID: \"93b04af0-620b-4325-b69a-9f892b1c3ecb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.270933 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.270902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" Jul 02 18:35:06.352983 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.352839 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:06.409640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.409603 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2"] Jul 02 18:35:06.416194 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:35:06.416163 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21d2d5e4_4d4f_489e_b1ea_384e934db41e.slice/crio-09eadfb46dd4a86d28ce1fd235a6bb91ee584cadb102a6e0bae8dd0630415f30 WatchSource:0}: Error finding container 09eadfb46dd4a86d28ce1fd235a6bb91ee584cadb102a6e0bae8dd0630415f30: Status 404 returned error can't find the container with id 09eadfb46dd4a86d28ce1fd235a6bb91ee584cadb102a6e0bae8dd0630415f30 Jul 02 18:35:06.488755 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.488732 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2"] Jul 02 18:35:06.491675 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:35:06.491650 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93b04af0_620b_4325_b69a_9f892b1c3ecb.slice/crio-36737bf3c37e0ad8184c2e6f8828720e2d7d59c26379c5213f4731f592319746 WatchSource:0}: Error finding container 36737bf3c37e0ad8184c2e6f8828720e2d7d59c26379c5213f4731f592319746: Status 404 returned error can't find the container with id 36737bf3c37e0ad8184c2e6f8828720e2d7d59c26379c5213f4731f592319746 Jul 02 18:35:06.495919 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.495895 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9b5341-d77c-4ae9-add0-00e6a9b6b091" path="/var/lib/kubelet/pods/8a9b5341-d77c-4ae9-add0-00e6a9b6b091/volumes" Jul 02 18:35:06.834913 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.834884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" event={"ID":"21d2d5e4-4d4f-489e-b1ea-384e934db41e","Type":"ContainerStarted","Data":"09eadfb46dd4a86d28ce1fd235a6bb91ee584cadb102a6e0bae8dd0630415f30"} Jul 02 18:35:06.836575 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:06.836557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" event={"ID":"93b04af0-620b-4325-b69a-9f892b1c3ecb","Type":"ContainerStarted","Data":"36737bf3c37e0ad8184c2e6f8828720e2d7d59c26379c5213f4731f592319746"} Jul 02 18:35:10.857402 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:10.857311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" event={"ID":"93b04af0-620b-4325-b69a-9f892b1c3ecb","Type":"ContainerStarted","Data":"7f46e71daad296a65eafde00f8f28958798eb7fc193b35b8fd6fb6a11338792f"} Jul 02 18:35:10.857884 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:10.857520 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:10.859601 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:10.859580 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" Jul 02 18:35:10.872110 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:10.871563 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7ffdfcb7bf-stfs2" podStartSLOduration=0.801427112 podStartE2EDuration="4.871545989s" totalImagesPullingTime="4.070118877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:35:10.871164979 +0000 UTC m=+266.868193507" watchObservedRunningTime="2026-07-02 18:35:10.871545989 +0000 UTC m=+266.868574501" Jul 02 18:35:11.862888 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:11.862765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" event={"ID":"21d2d5e4-4d4f-489e-b1ea-384e934db41e","Type":"ContainerStarted","Data":"8d0c797893b6a68273ea53d0a15c216db61263d06aabedef5680bb3603720ad2"} Jul 02 18:35:11.877602 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:11.877555 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c6cf7fb76-cvkn2" podStartSLOduration=1.731354922 podStartE2EDuration="6.877542803s" totalImagesPullingTime="5.146187881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:35:11.875795743 +0000 UTC m=+267.872824249" watchObservedRunningTime="2026-07-02 18:35:11.877542803 +0000 UTC m=+267.874571313" Jul 02 18:35:32.983853 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:32.983794 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:34.394855 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:34.394824 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:44.339643 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:44.339613 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:35:44.346825 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:44.346805 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 18:35:44.348085 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:44.348065 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:35:55.330525 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:55.330483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:35:55.428662 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:35:55.428638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:01.031188 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.031157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:01.310723 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.310627 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:01.311091 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.311071 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-gq96h"] Jul 02 18:36:01.313525 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.313499 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.315501 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.315470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 02 18:36:01.315623 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.315532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 02 18:36:01.315756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.315742 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 02 18:36:01.316102 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.316082 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 02 18:36:01.316174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.316104 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 02 18:36:01.316174 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.316104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-nrsz8\"" Jul 02 18:36:01.321928 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.321907 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-gq96h"] Jul 02 18:36:01.365434 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.365400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kgdq\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-kube-api-access-7kgdq\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.365434 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.365451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.365650 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.365545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-cabundle0\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.422271 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.422226 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:01.465963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.465932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-cabundle0\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.466065 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.465981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kgdq\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-kube-api-access-7kgdq\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.466065 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.466014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.466142 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.466123 2579 secret.go:281] references non-existent secret key: ca.crt Jul 02 18:36:01.466142 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.466134 2579 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 02 18:36:01.466142 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.466143 2579 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-gq96h: references non-existent secret key: ca.crt Jul 02 18:36:01.466252 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.466191 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates podName:a24d1bc5-07d0-4482-a8a0-ceb202a8bb52 nodeName:}" failed. No retries permitted until 2026-07-02 18:36:01.966175566 +0000 UTC m=+317.963204056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates") pod "keda-operator-68bff59c-gq96h" (UID: "a24d1bc5-07d0-4482-a8a0-ceb202a8bb52") : references non-existent secret key: ca.crt Jul 02 18:36:01.466626 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.466607 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-cabundle0\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.474950 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.474924 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kgdq\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-kube-api-access-7kgdq\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.544645 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.544605 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:01.709162 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.709133 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:01.970477 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:01.970399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:01.970611 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.970511 2579 secret.go:281] references non-existent secret key: ca.crt Jul 02 18:36:01.970611 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.970523 2579 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 02 18:36:01.970611 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.970531 2579 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-gq96h: references non-existent secret key: ca.crt Jul 02 18:36:01.970611 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:36:01.970578 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates podName:a24d1bc5-07d0-4482-a8a0-ceb202a8bb52 nodeName:}" failed. No retries permitted until 2026-07-02 18:36:02.970565491 +0000 UTC m=+318.967593981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates") pod "keda-operator-68bff59c-gq96h" (UID: "a24d1bc5-07d0-4482-a8a0-ceb202a8bb52") : references non-existent secret key: ca.crt Jul 02 18:36:02.106958 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.106922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.207968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.207938 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.437648 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.437616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.539228 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.539199 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.601283 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.601247 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.661960 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.661929 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.789005 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.788920 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:36:02.979087 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.979052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:02.981489 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:02.981464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a24d1bc5-07d0-4482-a8a0-ceb202a8bb52-certificates\") pod \"keda-operator-68bff59c-gq96h\" (UID: \"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52\") " pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:03.125794 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:03.125691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:03.251045 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:03.251020 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-gq96h"] Jul 02 18:36:03.253675 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:36:03.253646 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24d1bc5_07d0_4482_a8a0_ceb202a8bb52.slice/crio-78a246668ecefa2b7c1fd824f900923df1f2cbbaab4527eceec6d357a628ac83 WatchSource:0}: Error finding container 78a246668ecefa2b7c1fd824f900923df1f2cbbaab4527eceec6d357a628ac83: Status 404 returned error can't find the container with id 78a246668ecefa2b7c1fd824f900923df1f2cbbaab4527eceec6d357a628ac83 Jul 02 18:36:03.254959 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:03.254940 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 18:36:04.068187 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:04.068093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-gq96h" event={"ID":"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52","Type":"ContainerStarted","Data":"78a246668ecefa2b7c1fd824f900923df1f2cbbaab4527eceec6d357a628ac83"} Jul 02 18:36:07.084628 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:07.084540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-gq96h" event={"ID":"a24d1bc5-07d0-4482-a8a0-ceb202a8bb52","Type":"ContainerStarted","Data":"d4b546d71700efa0bc335833b5f1563cd3db0a56460e73c79891a3acd42fec07"} Jul 02 18:36:07.084628 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:07.084604 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:07.112419 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:07.112373 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-gq96h" podStartSLOduration=2.590670095 podStartE2EDuration="6.112357783s" totalImagesPullingTime="3.521687688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:36:07.110923855 +0000 UTC m=+323.107952370" watchObservedRunningTime="2026-07-02 18:36:07.112357783 +0000 UTC m=+323.109386311" Jul 02 18:36:28.091028 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:28.090998 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-gq96h" Jul 02 18:36:59.257986 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:36:59.257934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.230606 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.230562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.299464 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.299432 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-mzq78"] Jul 02 18:37:07.299629 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.299432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.302548 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.302532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.304540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.304519 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 02 18:37:07.304909 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.304882 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 18:37:07.305323 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.305304 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 18:37:07.305450 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.305432 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-mmjj6\"" Jul 02 18:37:07.313889 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.313868 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-mzq78"] Jul 02 18:37:07.334719 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.334695 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-chwhj"] Jul 02 18:37:07.337894 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.337876 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.340001 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.339981 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 02 18:37:07.340123 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.340109 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-x9bd2\"" Jul 02 18:37:07.346519 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.346498 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-chwhj"] Jul 02 18:37:07.400579 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.400539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.413099 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.413078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nplfq\" (UniqueName: \"kubernetes.io/projected/f3312057-90e5-4780-8ebe-9d32eb7ac881-kube-api-access-nplfq\") pod \"kserve-controller-manager-7cd6c584bf-mzq78\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.413172 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.413113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f84dae39-dc11-49e3-93cc-7c3542815774-data\") pod \"seaweedfs-64568bcd49-chwhj\" (UID: \"f84dae39-dc11-49e3-93cc-7c3542815774\") " pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.413172 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.413136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29rc\" (UniqueName: \"kubernetes.io/projected/f84dae39-dc11-49e3-93cc-7c3542815774-kube-api-access-r29rc\") pod \"seaweedfs-64568bcd49-chwhj\" (UID: \"f84dae39-dc11-49e3-93cc-7c3542815774\") " pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.413172 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.413156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3312057-90e5-4780-8ebe-9d32eb7ac881-cert\") pod \"kserve-controller-manager-7cd6c584bf-mzq78\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.497891 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.497802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.513870 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.513848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nplfq\" (UniqueName: \"kubernetes.io/projected/f3312057-90e5-4780-8ebe-9d32eb7ac881-kube-api-access-nplfq\") pod \"kserve-controller-manager-7cd6c584bf-mzq78\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.513994 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.513877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f84dae39-dc11-49e3-93cc-7c3542815774-data\") pod \"seaweedfs-64568bcd49-chwhj\" (UID: \"f84dae39-dc11-49e3-93cc-7c3542815774\") " pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.513994 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.513898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29rc\" (UniqueName: \"kubernetes.io/projected/f84dae39-dc11-49e3-93cc-7c3542815774-kube-api-access-r29rc\") pod \"seaweedfs-64568bcd49-chwhj\" (UID: \"f84dae39-dc11-49e3-93cc-7c3542815774\") " pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.513994 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.513927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3312057-90e5-4780-8ebe-9d32eb7ac881-cert\") pod \"kserve-controller-manager-7cd6c584bf-mzq78\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.514241 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.514223 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f84dae39-dc11-49e3-93cc-7c3542815774-data\") pod \"seaweedfs-64568bcd49-chwhj\" (UID: \"f84dae39-dc11-49e3-93cc-7c3542815774\") " pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.516308 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.516291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3312057-90e5-4780-8ebe-9d32eb7ac881-cert\") pod \"kserve-controller-manager-7cd6c584bf-mzq78\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.521958 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.521932 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29rc\" (UniqueName: \"kubernetes.io/projected/f84dae39-dc11-49e3-93cc-7c3542815774-kube-api-access-r29rc\") pod \"seaweedfs-64568bcd49-chwhj\" (UID: \"f84dae39-dc11-49e3-93cc-7c3542815774\") " pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.522080 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.521966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nplfq\" (UniqueName: \"kubernetes.io/projected/f3312057-90e5-4780-8ebe-9d32eb7ac881-kube-api-access-nplfq\") pod \"kserve-controller-manager-7cd6c584bf-mzq78\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.599008 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.598985 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.612947 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.612922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:07.646980 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.646956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:07.700647 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.700589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:07.756601 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.756579 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-mzq78"] Jul 02 18:37:07.759814 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:37:07.759767 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3312057_90e5_4780_8ebe_9d32eb7ac881.slice/crio-b946e22668cc5c1c021084e1c5f71b6d734fcd2b471538b2de5d7acb5175efe8 WatchSource:0}: Error finding container b946e22668cc5c1c021084e1c5f71b6d734fcd2b471538b2de5d7acb5175efe8: Status 404 returned error can't find the container with id b946e22668cc5c1c021084e1c5f71b6d734fcd2b471538b2de5d7acb5175efe8 Jul 02 18:37:07.779540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.779519 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-chwhj"] Jul 02 18:37:07.781459 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:37:07.781431 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84dae39_dc11_49e3_93cc_7c3542815774.slice/crio-9998d74ea32df4b7a0c635976528a8e49632cec63963566448ff5e740f4f2503 WatchSource:0}: Error finding container 9998d74ea32df4b7a0c635976528a8e49632cec63963566448ff5e740f4f2503: Status 404 returned error can't find the container with id 9998d74ea32df4b7a0c635976528a8e49632cec63963566448ff5e740f4f2503 Jul 02 18:37:07.782072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:07.782045 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:37:08.333386 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:08.333260 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-chwhj" event={"ID":"f84dae39-dc11-49e3-93cc-7c3542815774","Type":"ContainerStarted","Data":"9998d74ea32df4b7a0c635976528a8e49632cec63963566448ff5e740f4f2503"} Jul 02 18:37:08.335578 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:08.335547 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" event={"ID":"f3312057-90e5-4780-8ebe-9d32eb7ac881","Type":"ContainerStarted","Data":"b946e22668cc5c1c021084e1c5f71b6d734fcd2b471538b2de5d7acb5175efe8"} Jul 02 18:37:12.355017 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:12.354980 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-chwhj" event={"ID":"f84dae39-dc11-49e3-93cc-7c3542815774","Type":"ContainerStarted","Data":"6a750d9288a78cd7a60330380fc578accb277b00fe2b5ef92507620e1bcc588e"} Jul 02 18:37:12.355475 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:12.355132 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:12.356428 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:12.356404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" event={"ID":"f3312057-90e5-4780-8ebe-9d32eb7ac881","Type":"ContainerStarted","Data":"1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d"} Jul 02 18:37:12.356536 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:12.356524 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:12.369177 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:12.369130 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-chwhj" podStartSLOduration=1.483674845 podStartE2EDuration="5.369117103s" totalImagesPullingTime="3.885442258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:37:12.368032599 +0000 UTC m=+388.365061112" watchObservedRunningTime="2026-07-02 18:37:12.369117103 +0000 UTC m=+388.366145614" Jul 02 18:37:12.381872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:12.381834 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" podStartSLOduration=1.557549546 podStartE2EDuration="5.381821878s" totalImagesPullingTime="3.824272332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:37:12.380897259 +0000 UTC m=+388.377925753" watchObservedRunningTime="2026-07-02 18:37:12.381821878 +0000 UTC m=+388.378850389" Jul 02 18:37:18.362843 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:18.362809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-chwhj" Jul 02 18:37:42.103033 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.103001 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-mzq78"] Jul 02 18:37:42.103497 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.103230 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" podUID="f3312057-90e5-4780-8ebe-9d32eb7ac881" containerName="manager" containerID="cri-o://1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d" gracePeriod=10 Jul 02 18:37:42.109055 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.109029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:42.123841 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.123819 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-8nb45"] Jul 02 18:37:42.128013 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.127991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.135743 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.135718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-8nb45"] Jul 02 18:37:42.315194 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.315166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds5ql\" (UniqueName: \"kubernetes.io/projected/7d786236-6a6c-4106-961c-dd10c9ff1fd7-kube-api-access-ds5ql\") pod \"kserve-controller-manager-7cd6c584bf-8nb45\" (UID: \"7d786236-6a6c-4106-961c-dd10c9ff1fd7\") " pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.315354 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.315217 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d786236-6a6c-4106-961c-dd10c9ff1fd7-cert\") pod \"kserve-controller-manager-7cd6c584bf-8nb45\" (UID: \"7d786236-6a6c-4106-961c-dd10c9ff1fd7\") " pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.345624 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.345599 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:42.415969 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.415896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds5ql\" (UniqueName: \"kubernetes.io/projected/7d786236-6a6c-4106-961c-dd10c9ff1fd7-kube-api-access-ds5ql\") pod \"kserve-controller-manager-7cd6c584bf-8nb45\" (UID: \"7d786236-6a6c-4106-961c-dd10c9ff1fd7\") " pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.415969 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.415948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d786236-6a6c-4106-961c-dd10c9ff1fd7-cert\") pod \"kserve-controller-manager-7cd6c584bf-8nb45\" (UID: \"7d786236-6a6c-4106-961c-dd10c9ff1fd7\") " pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.418326 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.418184 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d786236-6a6c-4106-961c-dd10c9ff1fd7-cert\") pod \"kserve-controller-manager-7cd6c584bf-8nb45\" (UID: \"7d786236-6a6c-4106-961c-dd10c9ff1fd7\") " pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.425259 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.425231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds5ql\" (UniqueName: \"kubernetes.io/projected/7d786236-6a6c-4106-961c-dd10c9ff1fd7-kube-api-access-ds5ql\") pod \"kserve-controller-manager-7cd6c584bf-8nb45\" (UID: \"7d786236-6a6c-4106-961c-dd10c9ff1fd7\") " pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.472337 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.472304 2579 generic.go:356] "Generic (PLEG): container finished" podID="f3312057-90e5-4780-8ebe-9d32eb7ac881" containerID="1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d" exitCode=0 Jul 02 18:37:42.472472 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.472364 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" Jul 02 18:37:42.472472 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.472392 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" event={"ID":"f3312057-90e5-4780-8ebe-9d32eb7ac881","Type":"ContainerDied","Data":"1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d"} Jul 02 18:37:42.472586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.472483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd6c584bf-mzq78" event={"ID":"f3312057-90e5-4780-8ebe-9d32eb7ac881","Type":"ContainerDied","Data":"b946e22668cc5c1c021084e1c5f71b6d734fcd2b471538b2de5d7acb5175efe8"} Jul 02 18:37:42.472586 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.472516 2579 scope.go:117] "RemoveContainer" containerID="1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d" Jul 02 18:37:42.478064 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.478044 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:42.480601 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.480585 2579 scope.go:117] "RemoveContainer" containerID="1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d" Jul 02 18:37:42.480907 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:37:42.480886 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d\": container with ID starting with 1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d not found: ID does not exist" containerID="1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d" Jul 02 18:37:42.480963 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.480918 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d"} err="failed to get container status \"1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d\": rpc error: code = NotFound desc = could not find container \"1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d\": container with ID starting with 1c9e0914c581d975148cac287cb9481d7bd53a5504f2a1f15c4349be1942a02d not found: ID does not exist" Jul 02 18:37:42.516808 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.516767 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3312057-90e5-4780-8ebe-9d32eb7ac881-cert\") pod \"f3312057-90e5-4780-8ebe-9d32eb7ac881\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " Jul 02 18:37:42.517068 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.516860 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nplfq\" (UniqueName: \"kubernetes.io/projected/f3312057-90e5-4780-8ebe-9d32eb7ac881-kube-api-access-nplfq\") pod \"f3312057-90e5-4780-8ebe-9d32eb7ac881\" (UID: \"f3312057-90e5-4780-8ebe-9d32eb7ac881\") " Jul 02 18:37:42.519191 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.519166 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3312057-90e5-4780-8ebe-9d32eb7ac881-cert" (OuterVolumeSpecName: "cert") pod "f3312057-90e5-4780-8ebe-9d32eb7ac881" (UID: "f3312057-90e5-4780-8ebe-9d32eb7ac881"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:37:42.519281 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.519213 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3312057-90e5-4780-8ebe-9d32eb7ac881-kube-api-access-nplfq" (OuterVolumeSpecName: "kube-api-access-nplfq") pod "f3312057-90e5-4780-8ebe-9d32eb7ac881" (UID: "f3312057-90e5-4780-8ebe-9d32eb7ac881"). InnerVolumeSpecName "kube-api-access-nplfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:37:42.603707 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.603681 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-8nb45"] Jul 02 18:37:42.606101 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:37:42.606075 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d786236_6a6c_4106_961c_dd10c9ff1fd7.slice/crio-2eb67ca6b9347f9f92be47d5a9c6fd8b66894581650e7d2879c40cf1913f9ba8 WatchSource:0}: Error finding container 2eb67ca6b9347f9f92be47d5a9c6fd8b66894581650e7d2879c40cf1913f9ba8: Status 404 returned error can't find the container with id 2eb67ca6b9347f9f92be47d5a9c6fd8b66894581650e7d2879c40cf1913f9ba8 Jul 02 18:37:42.618355 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.618328 2579 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3312057-90e5-4780-8ebe-9d32eb7ac881-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:37:42.618355 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.618355 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nplfq\" (UniqueName: \"kubernetes.io/projected/f3312057-90e5-4780-8ebe-9d32eb7ac881-kube-api-access-nplfq\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:37:42.792108 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.792080 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-mzq78"] Jul 02 18:37:42.797768 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:42.797747 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-7cd6c584bf-mzq78"] Jul 02 18:37:43.479352 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:43.479318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" event={"ID":"7d786236-6a6c-4106-961c-dd10c9ff1fd7","Type":"ContainerStarted","Data":"d50d7762a10ab356aed18fcf107770f4148a5cb15ba0bd1652ead497ea0682ff"} Jul 02 18:37:43.479719 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:43.479365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" event={"ID":"7d786236-6a6c-4106-961c-dd10c9ff1fd7","Type":"ContainerStarted","Data":"2eb67ca6b9347f9f92be47d5a9c6fd8b66894581650e7d2879c40cf1913f9ba8"} Jul 02 18:37:43.479719 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:43.479395 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:37:43.494191 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:43.494153 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" podStartSLOduration=1.071071859 podStartE2EDuration="1.494139088s" totalImagesPullingTime="423.067229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:37:43.492487799 +0000 UTC m=+419.489516313" watchObservedRunningTime="2026-07-02 18:37:43.494139088 +0000 UTC m=+419.491167600" Jul 02 18:37:44.495722 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:37:44.495686 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3312057-90e5-4780-8ebe-9d32eb7ac881" path="/var/lib/kubelet/pods/f3312057-90e5-4780-8ebe-9d32eb7ac881/volumes" Jul 02 18:38:14.489054 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:14.488980 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-7cd6c584bf-8nb45" Jul 02 18:38:15.445751 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.445718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:15.484597 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.484562 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-4pqw9"] Jul 02 18:38:15.484939 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.484915 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3312057-90e5-4780-8ebe-9d32eb7ac881" containerName="manager" Jul 02 18:38:15.484998 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.484940 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3312057-90e5-4780-8ebe-9d32eb7ac881" containerName="manager" Jul 02 18:38:15.485037 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.485012 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3312057-90e5-4780-8ebe-9d32eb7ac881" containerName="manager" Jul 02 18:38:15.487072 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.487054 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.488913 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.488893 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 02 18:38:15.489032 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.488970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-wwjrk\"" Jul 02 18:38:15.497179 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.497159 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-4pqw9"] Jul 02 18:38:15.507348 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.507327 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-h7b2k"] Jul 02 18:38:15.509607 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.509591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:15.512016 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.511998 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 02 18:38:15.512120 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.512045 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-9srps\"" Jul 02 18:38:15.516267 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.516241 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:15.519488 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.519465 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-h7b2k"] Jul 02 18:38:15.566660 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.566622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv8gf\" (UniqueName: \"kubernetes.io/projected/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-kube-api-access-jv8gf\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:15.566831 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.566676 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxgj9\" (UniqueName: \"kubernetes.io/projected/bba1d4a3-5af4-48c7-88e3-0f1317ac5811-kube-api-access-fxgj9\") pod \"model-serving-api-fd65d7d6-4pqw9\" (UID: \"bba1d4a3-5af4-48c7-88e3-0f1317ac5811\") " pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.566831 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.566739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bba1d4a3-5af4-48c7-88e3-0f1317ac5811-tls-certs\") pod \"model-serving-api-fd65d7d6-4pqw9\" (UID: \"bba1d4a3-5af4-48c7-88e3-0f1317ac5811\") " pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.566831 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.566806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-cert\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:15.667257 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.667226 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxgj9\" (UniqueName: \"kubernetes.io/projected/bba1d4a3-5af4-48c7-88e3-0f1317ac5811-kube-api-access-fxgj9\") pod \"model-serving-api-fd65d7d6-4pqw9\" (UID: \"bba1d4a3-5af4-48c7-88e3-0f1317ac5811\") " pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.667420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.667283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bba1d4a3-5af4-48c7-88e3-0f1317ac5811-tls-certs\") pod \"model-serving-api-fd65d7d6-4pqw9\" (UID: \"bba1d4a3-5af4-48c7-88e3-0f1317ac5811\") " pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.667420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.667358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-cert\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:15.667420 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.667401 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv8gf\" (UniqueName: \"kubernetes.io/projected/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-kube-api-access-jv8gf\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:15.667616 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:38:15.667540 2579 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 18:38:15.667678 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:38:15.667618 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-cert podName:d1c72b8a-8e4d-4867-b487-7ba01b6a1904 nodeName:}" failed. No retries permitted until 2026-07-02 18:38:16.16759822 +0000 UTC m=+452.164626720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-cert") pod "odh-model-controller-84b54b7f97-h7b2k" (UID: "d1c72b8a-8e4d-4867-b487-7ba01b6a1904") : secret "odh-model-controller-webhook-cert" not found Jul 02 18:38:15.667747 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.667689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:15.670021 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.670002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bba1d4a3-5af4-48c7-88e3-0f1317ac5811-tls-certs\") pod \"model-serving-api-fd65d7d6-4pqw9\" (UID: \"bba1d4a3-5af4-48c7-88e3-0f1317ac5811\") " pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.675149 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.675130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv8gf\" (UniqueName: \"kubernetes.io/projected/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-kube-api-access-jv8gf\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:15.678366 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.678342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxgj9\" (UniqueName: \"kubernetes.io/projected/bba1d4a3-5af4-48c7-88e3-0f1317ac5811-kube-api-access-fxgj9\") pod \"model-serving-api-fd65d7d6-4pqw9\" (UID: \"bba1d4a3-5af4-48c7-88e3-0f1317ac5811\") " pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.797022 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.796939 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:15.919865 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:15.919841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-4pqw9"] Jul 02 18:38:15.922041 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:38:15.922014 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba1d4a3_5af4_48c7_88e3_0f1317ac5811.slice/crio-ffed2461b1a1a8ac29af1d9f5d0552a923f2da5312c5cb0eae945cb3cbcf17f7 WatchSource:0}: Error finding container ffed2461b1a1a8ac29af1d9f5d0552a923f2da5312c5cb0eae945cb3cbcf17f7: Status 404 returned error can't find the container with id ffed2461b1a1a8ac29af1d9f5d0552a923f2da5312c5cb0eae945cb3cbcf17f7 Jul 02 18:38:16.062050 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.061956 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:16.162535 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.162497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:16.172632 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.172608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-cert\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:16.174920 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.174903 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1c72b8a-8e4d-4867-b487-7ba01b6a1904-cert\") pod \"odh-model-controller-84b54b7f97-h7b2k\" (UID: \"d1c72b8a-8e4d-4867-b487-7ba01b6a1904\") " pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:16.218854 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.218825 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:16.420851 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.420752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:16.577672 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.577597 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-h7b2k"] Jul 02 18:38:16.612187 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:16.612153 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-4pqw9" event={"ID":"bba1d4a3-5af4-48c7-88e3-0f1317ac5811","Type":"ContainerStarted","Data":"ffed2461b1a1a8ac29af1d9f5d0552a923f2da5312c5cb0eae945cb3cbcf17f7"} Jul 02 18:38:16.642340 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:38:16.642313 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c72b8a_8e4d_4867_b487_7ba01b6a1904.slice/crio-3307c3555c0c9d50cf8ecd3cd8b15179c8364d0e0c5c04e2b38f754330bc6116 WatchSource:0}: Error finding container 3307c3555c0c9d50cf8ecd3cd8b15179c8364d0e0c5c04e2b38f754330bc6116: Status 404 returned error can't find the container with id 3307c3555c0c9d50cf8ecd3cd8b15179c8364d0e0c5c04e2b38f754330bc6116 Jul 02 18:38:17.617546 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:17.617509 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" event={"ID":"d1c72b8a-8e4d-4867-b487-7ba01b6a1904","Type":"ContainerStarted","Data":"3307c3555c0c9d50cf8ecd3cd8b15179c8364d0e0c5c04e2b38f754330bc6116"} Jul 02 18:38:18.623939 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:18.623900 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-4pqw9" event={"ID":"bba1d4a3-5af4-48c7-88e3-0f1317ac5811","Type":"ContainerStarted","Data":"2773394b1bd143ccc2caf09068534a5a1f62c5c4100a2b2448f6e24b285e1e0a"} Jul 02 18:38:18.624377 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:18.624036 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:18.638942 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:18.638876 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-4pqw9" podStartSLOduration=1.9148382480000001 podStartE2EDuration="3.638856068s" totalImagesPullingTime="1.72401782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:38:18.637093745 +0000 UTC m=+454.634122294" watchObservedRunningTime="2026-07-02 18:38:18.638856068 +0000 UTC m=+454.635884582" Jul 02 18:38:20.636097 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:20.636060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" event={"ID":"d1c72b8a-8e4d-4867-b487-7ba01b6a1904","Type":"ContainerStarted","Data":"c4c77770b0691e0e3bfd30fafabc14b4bf75d658da0420dc68ecae0960a9cfe6"} Jul 02 18:38:20.636540 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:20.636164 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:20.651768 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:20.651720 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" podStartSLOduration=2.728496334 podStartE2EDuration="5.6516951s" totalImagesPullingTime="2.923198766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:38:20.650992399 +0000 UTC m=+456.648020931" watchObservedRunningTime="2026-07-02 18:38:20.6516951 +0000 UTC m=+456.648723614" Jul 02 18:38:21.186546 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.186513 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75f8d7dfff-fdmnb"] Jul 02 18:38:21.190065 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.190046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.197502 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.197476 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f8d7dfff-fdmnb"] Jul 02 18:38:21.236363 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.236326 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:21.323194 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-oauth-config\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.323194 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-serving-cert\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.323389 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-trusted-ca-bundle\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.323389 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-service-ca\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.323389 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323340 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-oauth-serving-cert\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.323389 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-config\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.323513 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.323406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dr9g\" (UniqueName: \"kubernetes.io/projected/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-kube-api-access-6dr9g\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.337839 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.337808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:21.424136 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-config\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.424313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dr9g\" (UniqueName: \"kubernetes.io/projected/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-kube-api-access-6dr9g\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.424313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-oauth-config\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.424313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-serving-cert\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.424313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-trusted-ca-bundle\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.424313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-service-ca\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.424313 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.424277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-oauth-serving-cert\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.425031 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.425006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-config\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.425196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.425032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-oauth-serving-cert\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.425196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.425004 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-service-ca\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.425196 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.425144 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-trusted-ca-bundle\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.426654 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.426633 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-oauth-config\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.426765 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.426728 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-console-serving-cert\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.430989 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.430969 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dr9g\" (UniqueName: \"kubernetes.io/projected/0f63129b-b5e0-4867-bc05-9f2fcc998dd6-kube-api-access-6dr9g\") pod \"console-75f8d7dfff-fdmnb\" (UID: \"0f63129b-b5e0-4867-bc05-9f2fcc998dd6\") " pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.500419 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.500386 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:21.631603 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.631510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75f8d7dfff-fdmnb"] Jul 02 18:38:21.633848 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:38:21.633817 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f63129b_b5e0_4867_bc05_9f2fcc998dd6.slice/crio-a3495caf5d1bfc65edbec9eeeafe623ee697f553779f135091f24ae557e76c1c WatchSource:0}: Error finding container a3495caf5d1bfc65edbec9eeeafe623ee697f553779f135091f24ae557e76c1c: Status 404 returned error can't find the container with id a3495caf5d1bfc65edbec9eeeafe623ee697f553779f135091f24ae557e76c1c Jul 02 18:38:21.643278 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:21.643246 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f8d7dfff-fdmnb" event={"ID":"0f63129b-b5e0-4867-bc05-9f2fcc998dd6","Type":"ContainerStarted","Data":"a3495caf5d1bfc65edbec9eeeafe623ee697f553779f135091f24ae557e76c1c"} Jul 02 18:38:22.649260 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:22.649219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75f8d7dfff-fdmnb" event={"ID":"0f63129b-b5e0-4867-bc05-9f2fcc998dd6","Type":"ContainerStarted","Data":"f83d73a3f997a877ccae7d6616b93774bd864c1629cc865c088f8605835bfca2"} Jul 02 18:38:22.668242 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:22.668195 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75f8d7dfff-fdmnb" podStartSLOduration=1.6681767509999998 podStartE2EDuration="1.668176751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:38:22.666585263 +0000 UTC m=+458.663613776" watchObservedRunningTime="2026-07-02 18:38:22.668176751 +0000 UTC m=+458.665205320" Jul 02 18:38:24.755953 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:24.755913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:29.634884 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:29.634856 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-4pqw9" Jul 02 18:38:31.501298 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.501251 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:31.501298 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.501315 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:31.506400 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.506376 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:31.646412 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.646386 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-h7b2k" Jul 02 18:38:31.692694 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.692667 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75f8d7dfff-fdmnb" Jul 02 18:38:31.740871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.740835 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84bdc59c6c-tpbgb"] Jul 02 18:38:31.831625 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.831541 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:31.933416 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:31.933383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:32.033982 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:32.033921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:50.113045 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:50.113006 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:38:56.767517 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:56.767470 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84bdc59c6c-tpbgb" podUID="f427a756-ee27-4f40-9c92-67a2ce1b37dd" containerName="console" containerID="cri-o://5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093" gracePeriod=15 Jul 02 18:38:57.010762 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.010734 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:38:57.127350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127274 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwsvw\" (UniqueName: \"kubernetes.io/projected/f427a756-ee27-4f40-9c92-67a2ce1b37dd-kube-api-access-vwsvw\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127305 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-service-ca\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127340 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-serving-cert\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127612 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127394 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-config\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127612 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127424 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-trusted-ca-bundle\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127612 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127458 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-oauth-serving-cert\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127612 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127505 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-oauth-config\") pod \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\" (UID: \"f427a756-ee27-4f40-9c92-67a2ce1b37dd\") " Jul 02 18:38:57.127922 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127824 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:38:57.127922 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.127831 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-config" (OuterVolumeSpecName: "console-config") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:38:57.128106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.128001 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:38:57.128161 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.128112 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 18:38:57.129543 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.129520 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:38:57.129657 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.129600 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 18:38:57.129714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.129651 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f427a756-ee27-4f40-9c92-67a2ce1b37dd-kube-api-access-vwsvw" (OuterVolumeSpecName: "kube-api-access-vwsvw") pod "f427a756-ee27-4f40-9c92-67a2ce1b37dd" (UID: "f427a756-ee27-4f40-9c92-67a2ce1b37dd"). InnerVolumeSpecName "kube-api-access-vwsvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:38:57.228204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228168 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.228204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228196 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-trusted-ca-bundle\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.228204 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228206 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-oauth-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.228466 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228215 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-oauth-config\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.228466 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228225 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwsvw\" (UniqueName: \"kubernetes.io/projected/f427a756-ee27-4f40-9c92-67a2ce1b37dd-kube-api-access-vwsvw\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.228466 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228233 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f427a756-ee27-4f40-9c92-67a2ce1b37dd-service-ca\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.228466 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.228242 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f427a756-ee27-4f40-9c92-67a2ce1b37dd-console-serving-cert\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:38:57.806453 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.806415 2579 generic.go:356] "Generic (PLEG): container finished" podID="f427a756-ee27-4f40-9c92-67a2ce1b37dd" containerID="5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093" exitCode=0 Jul 02 18:38:57.806910 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.806486 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bdc59c6c-tpbgb" Jul 02 18:38:57.806910 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.806507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bdc59c6c-tpbgb" event={"ID":"f427a756-ee27-4f40-9c92-67a2ce1b37dd","Type":"ContainerDied","Data":"5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093"} Jul 02 18:38:57.806910 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.806564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bdc59c6c-tpbgb" event={"ID":"f427a756-ee27-4f40-9c92-67a2ce1b37dd","Type":"ContainerDied","Data":"51851d876db375c6c09be980ad4b3f5d9dd149f8c098e0a8248a9687db1102c6"} Jul 02 18:38:57.806910 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.806584 2579 scope.go:117] "RemoveContainer" containerID="5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093" Jul 02 18:38:57.815579 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.815563 2579 scope.go:117] "RemoveContainer" containerID="5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093" Jul 02 18:38:57.815882 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:38:57.815862 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093\": container with ID starting with 5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093 not found: ID does not exist" containerID="5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093" Jul 02 18:38:57.815955 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.815888 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093"} err="failed to get container status \"5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093\": rpc error: code = NotFound desc = could not find container \"5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093\": container with ID starting with 5c41eaef6fff58fa2b0920c87d4f729f55dfaa1721c561572495b781e23af093 not found: ID does not exist" Jul 02 18:38:57.825851 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.825828 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84bdc59c6c-tpbgb"] Jul 02 18:38:57.827392 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:57.827371 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84bdc59c6c-tpbgb"] Jul 02 18:38:58.496018 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:38:58.495986 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f427a756-ee27-4f40-9c92-67a2ce1b37dd" path="/var/lib/kubelet/pods/f427a756-ee27-4f40-9c92-67a2ce1b37dd/volumes" Jul 02 18:40:08.597178 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.597147 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx"] Jul 02 18:40:08.597592 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.597510 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f427a756-ee27-4f40-9c92-67a2ce1b37dd" containerName="console" Jul 02 18:40:08.597592 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.597521 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f427a756-ee27-4f40-9c92-67a2ce1b37dd" containerName="console" Jul 02 18:40:08.597592 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.597583 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f427a756-ee27-4f40-9c92-67a2ce1b37dd" containerName="console" Jul 02 18:40:08.600487 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.600469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.602432 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.602411 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 02 18:40:08.607819 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.607798 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx"] Jul 02 18:40:08.624120 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.624093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:40:08.733949 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.733914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-lkgcx\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.734123 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.733990 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64c2\" (UniqueName: \"kubernetes.io/projected/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-kube-api-access-m64c2\") pod \"seaweedfs-tls-custom-6644bf5d6c-lkgcx\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.835040 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.835001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-lkgcx\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.835169 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.835091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64c2\" (UniqueName: \"kubernetes.io/projected/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-kube-api-access-m64c2\") pod \"seaweedfs-tls-custom-6644bf5d6c-lkgcx\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.835385 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.835365 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-lkgcx\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.843095 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.843066 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64c2\" (UniqueName: \"kubernetes.io/projected/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-kube-api-access-m64c2\") pod \"seaweedfs-tls-custom-6644bf5d6c-lkgcx\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:08.910931 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:08.910849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:09.040105 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:09.040084 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx"] Jul 02 18:40:09.109151 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:09.109116 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" event={"ID":"cf4b1ddb-93e0-42ca-8c70-28ec9e122619","Type":"ContainerStarted","Data":"3e8ee0f3a4e8c568c47dd5cf9eedf273dc17cb4a10c9fba40443e11c22fc898c"} Jul 02 18:40:10.115142 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:10.115104 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" event={"ID":"cf4b1ddb-93e0-42ca-8c70-28ec9e122619","Type":"ContainerStarted","Data":"37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33"} Jul 02 18:40:10.130968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:10.130917 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" podStartSLOduration=1.8405848360000001 podStartE2EDuration="2.13090053s" totalImagesPullingTime="290.315694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:40:10.129548359 +0000 UTC m=+566.126576872" watchObservedRunningTime="2026-07-02 18:40:10.13090053 +0000 UTC m=+566.127929041" Jul 02 18:40:11.528742 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:11.528707 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx"] Jul 02 18:40:12.125298 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:12.125261 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" podUID="cf4b1ddb-93e0-42ca-8c70-28ec9e122619" containerName="seaweedfs-tls-custom" containerID="cri-o://37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33" gracePeriod=30 Jul 02 18:40:13.368713 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.368683 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:13.475795 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.475735 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-data\") pod \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " Jul 02 18:40:13.475961 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.475847 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m64c2\" (UniqueName: \"kubernetes.io/projected/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-kube-api-access-m64c2\") pod \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\" (UID: \"cf4b1ddb-93e0-42ca-8c70-28ec9e122619\") " Jul 02 18:40:13.477056 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.477022 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-data" (OuterVolumeSpecName: "data") pod "cf4b1ddb-93e0-42ca-8c70-28ec9e122619" (UID: "cf4b1ddb-93e0-42ca-8c70-28ec9e122619"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 18:40:13.477866 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.477836 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-kube-api-access-m64c2" (OuterVolumeSpecName: "kube-api-access-m64c2") pod "cf4b1ddb-93e0-42ca-8c70-28ec9e122619" (UID: "cf4b1ddb-93e0-42ca-8c70-28ec9e122619"). InnerVolumeSpecName "kube-api-access-m64c2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 18:40:13.576723 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.576675 2579 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-data\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:40:13.576723 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:13.576719 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m64c2\" (UniqueName: \"kubernetes.io/projected/cf4b1ddb-93e0-42ca-8c70-28ec9e122619-kube-api-access-m64c2\") on node \"ip-10-0-136-219.ec2.internal\" DevicePath \"\"" Jul 02 18:40:14.135590 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.135555 2579 generic.go:356] "Generic (PLEG): container finished" podID="cf4b1ddb-93e0-42ca-8c70-28ec9e122619" containerID="37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33" exitCode=0 Jul 02 18:40:14.135764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.135616 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" Jul 02 18:40:14.135764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.135630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" event={"ID":"cf4b1ddb-93e0-42ca-8c70-28ec9e122619","Type":"ContainerDied","Data":"37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33"} Jul 02 18:40:14.135764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.135685 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx" event={"ID":"cf4b1ddb-93e0-42ca-8c70-28ec9e122619","Type":"ContainerDied","Data":"3e8ee0f3a4e8c568c47dd5cf9eedf273dc17cb4a10c9fba40443e11c22fc898c"} Jul 02 18:40:14.135764 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.135711 2579 scope.go:117] "RemoveContainer" containerID="37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33" Jul 02 18:40:14.145424 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.145401 2579 scope.go:117] "RemoveContainer" containerID="37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33" Jul 02 18:40:14.145670 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:40:14.145648 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33\": container with ID starting with 37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33 not found: ID does not exist" containerID="37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33" Jul 02 18:40:14.145714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.145681 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33"} err="failed to get container status \"37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33\": rpc error: code = NotFound desc = could not find container \"37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33\": container with ID starting with 37f6c90e2e650c73107de28b7646bbe613a4e34b40c0fdc8135d8b2453b7ec33 not found: ID does not exist" Jul 02 18:40:14.156950 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.156887 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx"] Jul 02 18:40:14.160804 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.160766 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-lkgcx"] Jul 02 18:40:14.168682 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:40:14.168655 2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4b1ddb_93e0_42ca_8c70_28ec9e122619.slice/crio-3e8ee0f3a4e8c568c47dd5cf9eedf273dc17cb4a10c9fba40443e11c22fc898c\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4b1ddb_93e0_42ca_8c70_28ec9e122619.slice\": RecentStats: unable to find data in memory cache]" Jul 02 18:40:14.186186 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.186163 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-9ns8f"] Jul 02 18:40:14.186826 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.186807 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4b1ddb-93e0-42ca-8c70-28ec9e122619" containerName="seaweedfs-tls-custom" Jul 02 18:40:14.186945 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.186935 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4b1ddb-93e0-42ca-8c70-28ec9e122619" containerName="seaweedfs-tls-custom" Jul 02 18:40:14.187128 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.187117 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4b1ddb-93e0-42ca-8c70-28ec9e122619" containerName="seaweedfs-tls-custom" Jul 02 18:40:14.191814 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.191796 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.194244 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.194219 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 02 18:40:14.194350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.194221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 02 18:40:14.195359 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.195339 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-9ns8f"] Jul 02 18:40:14.283576 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.283543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/a7bccb61-5112-416c-8ccd-a5ca81389d6a-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.283576 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.283580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djwjt\" (UniqueName: \"kubernetes.io/projected/a7bccb61-5112-416c-8ccd-a5ca81389d6a-kube-api-access-djwjt\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.283879 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.283741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a7bccb61-5112-416c-8ccd-a5ca81389d6a-data\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.384508 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.384471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a7bccb61-5112-416c-8ccd-a5ca81389d6a-data\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.385009 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.384528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/a7bccb61-5112-416c-8ccd-a5ca81389d6a-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.385009 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.384545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djwjt\" (UniqueName: \"kubernetes.io/projected/a7bccb61-5112-416c-8ccd-a5ca81389d6a-kube-api-access-djwjt\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.385009 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.384985 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a7bccb61-5112-416c-8ccd-a5ca81389d6a-data\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.387044 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.387002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/a7bccb61-5112-416c-8ccd-a5ca81389d6a-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.392323 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.392302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djwjt\" (UniqueName: \"kubernetes.io/projected/a7bccb61-5112-416c-8ccd-a5ca81389d6a-kube-api-access-djwjt\") pod \"seaweedfs-tls-custom-8b44d767d-9ns8f\" (UID: \"a7bccb61-5112-416c-8ccd-a5ca81389d6a\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.495451 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.495420 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4b1ddb-93e0-42ca-8c70-28ec9e122619" path="/var/lib/kubelet/pods/cf4b1ddb-93e0-42ca-8c70-28ec9e122619/volumes" Jul 02 18:40:14.502878 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.502852 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" Jul 02 18:40:14.631482 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:14.631437 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-9ns8f"] Jul 02 18:40:14.634045 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:40:14.634019 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bccb61_5112_416c_8ccd_a5ca81389d6a.slice/crio-f8c88ff2b8edcb082f3f0e08ef87790e4c4c8d55ecfa0542d59049a13b65ac93 WatchSource:0}: Error finding container f8c88ff2b8edcb082f3f0e08ef87790e4c4c8d55ecfa0542d59049a13b65ac93: Status 404 returned error can't find the container with id f8c88ff2b8edcb082f3f0e08ef87790e4c4c8d55ecfa0542d59049a13b65ac93 Jul 02 18:40:15.142178 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:15.142143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" event={"ID":"a7bccb61-5112-416c-8ccd-a5ca81389d6a","Type":"ContainerStarted","Data":"f46e9fedaf64347fbf3c39127dc15a85bd1f3fb15442192a3a23981474c26172"} Jul 02 18:40:15.142354 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:15.142188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" event={"ID":"a7bccb61-5112-416c-8ccd-a5ca81389d6a","Type":"ContainerStarted","Data":"f8c88ff2b8edcb082f3f0e08ef87790e4c4c8d55ecfa0542d59049a13b65ac93"} Jul 02 18:40:15.157383 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:15.157339 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-9ns8f" podStartSLOduration=0.858522018 podStartE2EDuration="1.157323728s" totalImagesPullingTime="298.80171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:40:15.155165256 +0000 UTC m=+571.152193793" watchObservedRunningTime="2026-07-02 18:40:15.157323728 +0000 UTC m=+571.154352240" Jul 02 18:40:26.921373 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.921338 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-w98qq"] Jul 02 18:40:26.924729 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.924711 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:26.926665 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.926645 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 02 18:40:26.926765 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.926675 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 02 18:40:26.930761 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.930724 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:40:26.931437 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.931417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-w98qq"] Jul 02 18:40:26.998082 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.998040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:26.998240 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.998111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbz6h\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-kube-api-access-xbz6h\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:26.998240 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:26.998157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8fba5bc3-312b-4155-bb47-74f84480467a-data\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.098616 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.098591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbz6h\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-kube-api-access-xbz6h\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.098829 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.098662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8fba5bc3-312b-4155-bb47-74f84480467a-data\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.098829 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.098707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.098968 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:40:27.098867 2579 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 02 18:40:27.098968 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:40:27.098887 2579 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-w98qq: secret "seaweedfs-tls-serving" not found Jul 02 18:40:27.098968 ip-10-0-136-219 kubenswrapper[2579]: E0702 18:40:27.098950 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-seaweedfs-tls-serving podName:8fba5bc3-312b-4155-bb47-74f84480467a nodeName:}" failed. No retries permitted until 2026-07-02 18:40:27.598928862 +0000 UTC m=+583.595957365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-w98qq" (UID: "8fba5bc3-312b-4155-bb47-74f84480467a") : secret "seaweedfs-tls-serving" not found Jul 02 18:40:27.099117 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.099048 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8fba5bc3-312b-4155-bb47-74f84480467a-data\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.106084 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.106065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbz6h\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-kube-api-access-xbz6h\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.442140 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.442107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:40:27.602581 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.602547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.604916 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.604892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8fba5bc3-312b-4155-bb47-74f84480467a-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w98qq\" (UID: \"8fba5bc3-312b-4155-bb47-74f84480467a\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.835633 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.835547 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" Jul 02 18:40:27.960342 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:27.960320 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-w98qq"] Jul 02 18:40:27.962817 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:40:27.962774 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fba5bc3_312b_4155_bb47_74f84480467a.slice/crio-616e0ad45c038dd364528c7956e0c02ceafe69c0f9c9ca8c400a217edf331362 WatchSource:0}: Error finding container 616e0ad45c038dd364528c7956e0c02ceafe69c0f9c9ca8c400a217edf331362: Status 404 returned error can't find the container with id 616e0ad45c038dd364528c7956e0c02ceafe69c0f9c9ca8c400a217edf331362 Jul 02 18:40:28.204112 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:28.204077 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" event={"ID":"8fba5bc3-312b-4155-bb47-74f84480467a","Type":"ContainerStarted","Data":"616e0ad45c038dd364528c7956e0c02ceafe69c0f9c9ca8c400a217edf331362"} Jul 02 18:40:29.209330 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:29.209297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" event={"ID":"8fba5bc3-312b-4155-bb47-74f84480467a","Type":"ContainerStarted","Data":"47f43343620fa884d52b1e37014e385c5506f297384439c85acc47179b6775f2"} Jul 02 18:40:29.225877 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:29.225800 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w98qq" podStartSLOduration=2.9728035999999998 podStartE2EDuration="3.22575907s" totalImagesPullingTime="252.95547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:40:29.225205396 +0000 UTC m=+585.222233910" watchObservedRunningTime="2026-07-02 18:40:29.22575907 +0000 UTC m=+585.222787585" Jul 02 18:40:42.351999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:42.351968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:40:43.425868 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:43.425836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:40:44.381261 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:44.381230 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:40:44.382874 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:44.382853 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:40:54.443680 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:54.443640 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:40:54.681668 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:40:54.681631 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:41:46.996848 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:41:46.996808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:41:47.058741 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:41:47.058701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:38.004999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:38.004913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:39.661511 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:39.661428 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:39.777166 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:39.777114 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:39.872627 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:39.872595 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:44.831039 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:44.831009 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:44.884435 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:44.884404 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:42:47.975554 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:42:47.975513 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:43:39.231800 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:43:39.231753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:44:14.805487 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:44:14.805393 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:44:14.883968 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:44:14.883932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:44:14.947599 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:44:14.947563 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:44:34.877568 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:44:34.877530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:44:34.993330 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:44:34.993291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:45:44.416895 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:45:44.416810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:45:44.417462 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:45:44.417296 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:46:10.229421 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:46:10.229384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:46:11.577330 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:46:11.577300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:46:20.145547 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:46:20.145504 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:46:20.243131 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:46:20.243076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:49:30.444639 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:49:30.444599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:49:31.080703 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:49:31.080671 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:49:35.655350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:49:35.655317 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:49:36.265552 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:49:36.265518 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:50:44.446382 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:50:44.446354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:50:44.446914 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:50:44.446610 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:51:45.902370 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:51:45.902292 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:51:50.972082 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:51:50.972027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:51:51.490711 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:51:51.490678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:52:48.482170 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:52:48.482136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:53:51.198282 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:53:51.198229 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:53:56.276039 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:53:56.276005 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:53:56.335861 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:53:56.335829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:55:37.305765 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:55:37.305735 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:55:41.563554 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:55:41.563512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:55:41.833374 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:55:41.833291 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:55:44.474950 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:55:44.474924 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:55:44.475490 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:55:44.475474 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:56:11.711264 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:11.711167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:18.288448 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:18.288410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:18.389960 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:18.389921 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:45.852641 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:45.852604 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:46.007871 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.007843 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m256x/must-gather-n5z64"] Jul 02 18:56:46.015350 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.015325 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.017363 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.017337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m256x\"/\"openshift-service-ca.crt\"" Jul 02 18:56:46.017460 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.017365 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m256x\"/\"kube-root-ca.crt\"" Jul 02 18:56:46.017460 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.017424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m256x\"/\"default-dockercfg-6692h\"" Jul 02 18:56:46.020942 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.020921 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m256x/must-gather-n5z64"] Jul 02 18:56:46.023855 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.023829 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:46.108139 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.108065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtvlh\" (UniqueName: \"kubernetes.io/projected/21dc415e-a193-424e-991a-02bddb3887b9-kube-api-access-vtvlh\") pod \"must-gather-n5z64\" (UID: \"21dc415e-a193-424e-991a-02bddb3887b9\") " pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.108139 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.108104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21dc415e-a193-424e-991a-02bddb3887b9-must-gather-output\") pod \"must-gather-n5z64\" (UID: \"21dc415e-a193-424e-991a-02bddb3887b9\") " pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.125912 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.125885 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:46.209160 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.209130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtvlh\" (UniqueName: \"kubernetes.io/projected/21dc415e-a193-424e-991a-02bddb3887b9-kube-api-access-vtvlh\") pod \"must-gather-n5z64\" (UID: \"21dc415e-a193-424e-991a-02bddb3887b9\") " pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.209387 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.209176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21dc415e-a193-424e-991a-02bddb3887b9-must-gather-output\") pod \"must-gather-n5z64\" (UID: \"21dc415e-a193-424e-991a-02bddb3887b9\") " pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.209567 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.209550 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/21dc415e-a193-424e-991a-02bddb3887b9-must-gather-output\") pod \"must-gather-n5z64\" (UID: \"21dc415e-a193-424e-991a-02bddb3887b9\") " pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.216988 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.216960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtvlh\" (UniqueName: \"kubernetes.io/projected/21dc415e-a193-424e-991a-02bddb3887b9-kube-api-access-vtvlh\") pod \"must-gather-n5z64\" (UID: \"21dc415e-a193-424e-991a-02bddb3887b9\") " pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.325761 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.325728 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m256x/must-gather-n5z64" Jul 02 18:56:46.448975 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.448944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m256x/must-gather-n5z64"] Jul 02 18:56:46.450853 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:56:46.450827 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21dc415e_a193_424e_991a_02bddb3887b9.slice/crio-a2041403c60d1f7561a777340f96fedbf1ac0605d2af168561e5bb9b653420e6 WatchSource:0}: Error finding container a2041403c60d1f7561a777340f96fedbf1ac0605d2af168561e5bb9b653420e6: Status 404 returned error can't find the container with id a2041403c60d1f7561a777340f96fedbf1ac0605d2af168561e5bb9b653420e6 Jul 02 18:56:46.452856 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.452837 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 18:56:46.573999 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:46.573967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m256x/must-gather-n5z64" event={"ID":"21dc415e-a193-424e-991a-02bddb3887b9","Type":"ContainerStarted","Data":"a2041403c60d1f7561a777340f96fedbf1ac0605d2af168561e5bb9b653420e6"} Jul 02 18:56:47.584625 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:47.584091 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m256x/must-gather-n5z64" event={"ID":"21dc415e-a193-424e-991a-02bddb3887b9","Type":"ContainerStarted","Data":"17b73e31d93e004c204261854ed76ffb741ec42a5ef26d9e1e98746ea874dee0"} Jul 02 18:56:47.584625 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:47.584143 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m256x/must-gather-n5z64" event={"ID":"21dc415e-a193-424e-991a-02bddb3887b9","Type":"ContainerStarted","Data":"0ac5c1a16ec9caba79f4b4fa2416a590b2d0e43cff61c5000c983b135dd8c12a"} Jul 02 18:56:47.600423 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:47.600364 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m256x/must-gather-n5z64" podStartSLOduration=2.043972449 podStartE2EDuration="2.600345044s" totalImagesPullingTime="556.372595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 18:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:56:47.599252478 +0000 UTC m=+1563.596280992" watchObservedRunningTime="2026-07-02 18:56:47.600345044 +0000 UTC m=+1563.597373557" Jul 02 18:56:48.428239 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:48.428211 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zx6n4_74c57049-22b3-42e7-9ed8-8e3257057143/global-pull-secret-syncer/0.log" Jul 02 18:56:48.481826 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:48.481788 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" Jul 02 18:56:48.605575 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:48.605544 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-219.ec2.internal_b4a2b1f1ab3d3c828e793f3e77e1a6f7/haproxy/0.log" Jul 02 18:56:51.505497 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:51.505462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:52.370503 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.370465 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/alertmanager/0.log" Jul 02 18:56:52.406630 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.406587 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/config-reloader/0.log" Jul 02 18:56:52.443670 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.443627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/kube-rbac-proxy-web/0.log" Jul 02 18:56:52.475416 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.475383 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/kube-rbac-proxy/0.log" Jul 02 18:56:52.520148 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.520114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/kube-rbac-proxy-metric/0.log" Jul 02 18:56:52.552561 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.552526 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/prom-label-proxy/0.log" Jul 02 18:56:52.592519 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.592494 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c31cae2b-ca97-4726-96d6-8d2b607c212a/init-config-reloader/0.log" Jul 02 18:56:52.671723 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.671647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-cwnnl_09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b/kube-state-metrics/0.log" Jul 02 18:56:52.700548 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.700515 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-cwnnl_09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b/kube-rbac-proxy-main/0.log" Jul 02 18:56:52.737411 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.737367 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-cwnnl_09d3faa5-0cd6-49de-8bb1-62c7fdbdfc9b/kube-rbac-proxy-self/0.log" Jul 02 18:56:52.776066 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.776012 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84cdf5cd44-qp7vg_c8d6b6b0-891b-4702-875f-946c292158f7/metrics-server/0.log" Jul 02 18:56:52.817765 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.817730 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lnl55_ff49335c-8755-4bd7-a9e3-679675007b59/monitoring-plugin/0.log" Jul 02 18:56:52.872127 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:52.872088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-27zfs_8388090f-d725-4d3d-996b-0981a649b5d8/konnectivity-agent/0.log" limit=1024 Jul 02 18:56:53.017652 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.017625 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jf5gb_30271745-5c2c-4ad3-82ec-7d7322ddf9b6/node-exporter/0.log" Jul 02 18:56:53.043603 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.043573 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jf5gb_30271745-5c2c-4ad3-82ec-7d7322ddf9b6/kube-rbac-proxy/0.log" Jul 02 18:56:53.070108 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.070064 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jf5gb_30271745-5c2c-4ad3-82ec-7d7322ddf9b6/init-textfile/0.log" Jul 02 18:56:53.433976 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.433900 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-g2wqd_82e2a212-ef5f-409a-a3d1-4918e28180c6/prometheus-operator/0.log" Jul 02 18:56:53.453608 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.453581 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-g2wqd_82e2a212-ef5f-409a-a3d1-4918e28180c6/kube-rbac-proxy/0.log" Jul 02 18:56:53.480239 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.480201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-r6j9n_1b2ba0a4-5655-44dc-bef5-df9e45f7d12c/prometheus-operator-admission-webhook/0.log" Jul 02 18:56:53.513747 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.513722 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b8648cc8c-g5l89_fee7df20-f87a-4ab4-9584-b366b7dfa415/telemeter-client/0.log" Jul 02 18:56:53.541340 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.541311 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b8648cc8c-g5l89_fee7df20-f87a-4ab4-9584-b366b7dfa415/reload/0.log" Jul 02 18:56:53.565340 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.565311 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b8648cc8c-g5l89_fee7df20-f87a-4ab4-9584-b366b7dfa415/kube-rbac-proxy/0.log" Jul 02 18:56:53.603714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.603689 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/thanos-query/0.log" Jul 02 18:56:53.636168 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.636141 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy-web/0.log" Jul 02 18:56:53.660716 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.660690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy/0.log" Jul 02 18:56:53.685272 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.685201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/prom-label-proxy/0.log" Jul 02 18:56:53.708250 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.708206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy-rules/0.log" Jul 02 18:56:53.731361 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:53.731328 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-866bb47569-rnl69_0bd05dbd-051d-4de0-a9e8-f2c44de90975/kube-rbac-proxy-metrics/0.log" Jul 02 18:56:56.002634 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.002577 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75f8d7dfff-fdmnb_0f63129b-b5e0-4867-bc05-9f2fcc998dd6/console/0.log" Jul 02 18:56:56.044344 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.044268 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-k4c7r_df468f2d-ff1e-4afe-8245-28c6f2d91aec/download-server/0.log" Jul 02 18:56:56.848456 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.846500 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb"] Jul 02 18:56:56.852492 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.852466 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:56.858312 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.858284 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb"] Jul 02 18:56:56.912703 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.912667 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbx6\" (UniqueName: \"kubernetes.io/projected/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-kube-api-access-tkbx6\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:56.912923 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.912736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-podres\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:56.912923 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.912871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-sys\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:56.912923 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.912914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-proc\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:56.913121 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:56.913037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-lib-modules\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.014003 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.013961 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbx6\" (UniqueName: \"kubernetes.io/projected/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-kube-api-access-tkbx6\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.014577 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.014553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-podres\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.014746 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.014730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-sys\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.014894 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.014877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-proc\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.015236 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.015217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-lib-modules\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.015430 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.015406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-lib-modules\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.015512 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.015166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-proc\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.015512 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.015092 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-podres\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.015635 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.015128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-sys\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.022987 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.022966 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbx6\" (UniqueName: \"kubernetes.io/projected/28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9-kube-api-access-tkbx6\") pod \"perf-node-gather-daemonset-klqxb\" (UID: \"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9\") " pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.167413 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.167308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:57.333818 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.333451 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb"] Jul 02 18:56:57.335885 ip-10-0-136-219 kubenswrapper[2579]: W0702 18:56:57.335853 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod28a3f9b6_6a58_47bf_94cb_a3cbd06d85c9.slice/crio-45a672120bec9acdccc33969f6aba9419a0cc306589baf045786177cd10e7d3d WatchSource:0}: Error finding container 45a672120bec9acdccc33969f6aba9419a0cc306589baf045786177cd10e7d3d: Status 404 returned error can't find the container with id 45a672120bec9acdccc33969f6aba9419a0cc306589baf045786177cd10e7d3d Jul 02 18:56:57.518460 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.518433 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-czxh9_0bd8cbe5-fd87-4dc6-a247-d052bcb199b6/dns/0.log" Jul 02 18:56:57.541994 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.541968 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-czxh9_0bd8cbe5-fd87-4dc6-a247-d052bcb199b6/kube-rbac-proxy/0.log" Jul 02 18:56:57.613094 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.613070 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4tfr_fb1140e8-6d0a-412f-90f9-a10dc88b32b8/dns-node-resolver/0.log" Jul 02 18:56:57.650141 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.650106 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" event={"ID":"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9","Type":"ContainerStarted","Data":"0074d68887371bfc5b18fc9935e9f47ddf7b1cf883d6f068f8640df4ebaf35cb"} Jul 02 18:56:57.650342 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.650195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" event={"ID":"28a3f9b6-6a58-47bf-94cb-a3cbd06d85c9","Type":"ContainerStarted","Data":"45a672120bec9acdccc33969f6aba9419a0cc306589baf045786177cd10e7d3d"} Jul 02 18:56:57.650923 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:57.650900 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:56:58.094756 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:58.094726 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4v9fw_e43d40e2-8f1b-4115-95e2-610f903982af/node-ca/0.log" Jul 02 18:56:59.310235 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:59.310200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ks472_fd384d57-9fbc-4b80-b662-d8c8732ad4d5/serve-healthcheck-canary/0.log" Jul 02 18:56:59.704714 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:59.704687 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z27rs_ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428/kube-rbac-proxy/0.log" Jul 02 18:56:59.725662 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:59.725636 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z27rs_ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428/exporter/0.log" Jul 02 18:56:59.750192 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:56:59.750166 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z27rs_ed8ba670-3b2a-4dd6-800f-3f6ce9bbe428/extractor/0.log" Jul 02 18:57:01.870904 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:01.870871 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-7cd6c584bf-8nb45_7d786236-6a6c-4106-961c-dd10c9ff1fd7/manager/0.log" Jul 02 18:57:01.914872 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:01.914845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-4pqw9_bba1d4a3-5af4-48c7-88e3-0f1317ac5811/server/0.log" Jul 02 18:57:02.024106 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:02.024073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-h7b2k_d1c72b8a-8e4d-4867-b487-7ba01b6a1904/manager/0.log" Jul 02 18:57:02.186555 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:02.186479 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-chwhj_f84dae39-dc11-49e3-93cc-7c3542815774/seaweedfs/0.log" Jul 02 18:57:02.213126 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:02.213097 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-9ns8f_a7bccb61-5112-416c-8ccd-a5ca81389d6a/seaweedfs-tls-custom/0.log" Jul 02 18:57:02.239374 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:02.239350 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-w98qq_8fba5bc3-312b-4155-bb47-74f84480467a/seaweedfs-tls-serving/0.log" Jul 02 18:57:04.672297 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:04.672267 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" Jul 02 18:57:04.687565 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:04.687513 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m256x/perf-node-gather-daemonset-klqxb" podStartSLOduration=8.687498237 podStartE2EDuration="8.687498237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 18:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 18:56:57.669818885 +0000 UTC m=+1573.666847413" watchObservedRunningTime="2026-07-02 18:57:04.687498237 +0000 UTC m=+1580.684526748" Jul 02 18:57:07.591044 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.591021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/kube-multus-additional-cni-plugins/0.log" Jul 02 18:57:07.626640 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.626610 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/egress-router-binary-copy/0.log" Jul 02 18:57:07.660987 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.660950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/cni-plugins/0.log" Jul 02 18:57:07.697441 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.697416 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/bond-cni-plugin/0.log" Jul 02 18:57:07.733476 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.733451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/routeoverride-cni/0.log" Jul 02 18:57:07.768479 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.768453 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/whereabouts-cni-bincopy/0.log" Jul 02 18:57:07.798463 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:07.798437 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s4hnp_12538438-5c29-4987-bd41-b0dfa2f3bd59/whereabouts-cni/0.log" Jul 02 18:57:08.007971 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:08.007940 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sdc2q_39c18308-c3bd-4112-9e5d-7fcc6a91a68d/kube-multus/0.log" Jul 02 18:57:08.122899 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:08.122866 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gm98z_a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0/network-metrics-daemon/0.log" Jul 02 18:57:08.153927 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:08.153847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gm98z_a1dc4c7e-dbbf-43a7-a9aa-d2afd05bb6f0/kube-rbac-proxy/0.log" Jul 02 18:57:08.953414 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:08.953389 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-controller/0.log" Jul 02 18:57:08.985831 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:08.985805 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/1.log" Jul 02 18:57:08.985997 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:08.985847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovn-acl-logging/0.log" Jul 02 18:57:09.020711 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:09.020686 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/kube-rbac-proxy-node/0.log" Jul 02 18:57:09.061620 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:09.061595 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 18:57:09.090482 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:09.090451 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/northd/0.log" Jul 02 18:57:09.126040 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:09.126017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/nbdb/0.log" Jul 02 18:57:09.162976 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:09.162953 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/sbdb/0.log" Jul 02 18:57:09.237278 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:09.237204 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cftkj_61588f28-f089-43dc-8a25-11d0cfbe8c10/ovnkube-controller/0.log" Jul 02 18:57:10.582751 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:10.582727 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bgr8t_fd000e81-7047-4324-a533-2424973d8b1e/network-check-target-container/0.log" Jul 02 18:57:11.509624 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:11.509591 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5fr7t_3955805c-5724-40a1-9a69-a5dd9d0d5f00/iptables-alerter/0.log" Jul 02 18:57:12.134757 ip-10-0-136-219 kubenswrapper[2579]: I0702 18:57:12.134728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hjk6k_cbac3ee6-b584-49eb-8cb8-fab4f7cbb4d9/tuned/0.log"