Jul 01 16:58:48.046003 ip-10-0-139-133 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.454289 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459826 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459840 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459846 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459852 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459857 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459863 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459867 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:48.498356 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459871 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459876 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459881 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459886 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459890 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459894 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459899 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459904 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459909 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459914 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459918 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459923 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459928 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459932 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459936 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459941 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459945 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459951 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459956 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:48.499242 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459960 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459964 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459969 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459973 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459977 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459982 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459986 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459990 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.459994 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460000 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460004 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460008 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460012 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460016 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460021 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460025 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460029 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460034 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460039 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460044 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:48.500138 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460048 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460053 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460058 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460063 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460068 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460075 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460081 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460086 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460090 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460095 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460100 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460104 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460108 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460112 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460116 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460123 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460128 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460132 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460136 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:48.500857 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460140 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460145 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460150 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460154 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460159 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460163 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460167 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460173 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460177 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460181 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460186 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460190 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460194 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460198 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460202 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460208 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460212 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460217 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460221 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460225 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:48.501478 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460229 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460234 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460238 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460242 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460246 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460253 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460259 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460264 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460269 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460274 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460278 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460284 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460288 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.460293 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461338 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461347 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461352 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461358 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461362 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461368 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:48.502219 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461373 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461378 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461383 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461387 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461393 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461397 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461401 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461406 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461411 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461416 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461420 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461425 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461429 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461433 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461438 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461442 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461446 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461451 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461455 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:48.502819 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461459 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461463 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461468 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461472 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461477 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461481 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461485 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461489 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461493 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461498 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461502 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461507 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461511 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461516 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461520 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461525 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461529 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461533 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461537 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461541 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:48.503437 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461546 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461550 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461554 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461559 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461563 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461571 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461577 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461581 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461586 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461590 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461595 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461599 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461603 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461608 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461611 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461615 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461620 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461624 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461628 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:48.504013 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461632 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461637 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461641 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461645 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461649 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461654 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461658 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461663 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461668 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461676 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461681 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461686 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461691 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461698 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461702 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461711 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461715 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461720 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461726 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:48.504644 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461731 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461736 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461739 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461744 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461748 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461769 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461774 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461780 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461784 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461790 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461794 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461798 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461802 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461807 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461810 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.461816 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462430 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462438 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462442 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462448 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:48.505509 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462454 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462459 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462464 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462468 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462472 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462476 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462481 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462485 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462492 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462496 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462500 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462504 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462509 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462513 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462517 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462523 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462526 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462531 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462535 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462539 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:48.506125 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462543 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462548 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462552 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462556 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462560 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462564 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462568 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462573 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462577 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462581 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462585 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462590 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462594 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462599 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462604 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462608 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462612 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462616 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462621 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462625 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:48.602966 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462631 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:48.547617 ip-10-0-139-133 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462635 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462639 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462644 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462648 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462652 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462657 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462661 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462666 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462670 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462674 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462681 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462686 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462692 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462697 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462703 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462708 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462713 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462718 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:48.603820 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462724 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462729 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462733 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462738 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462742 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462746 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462751 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462772 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462776 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462781 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462785 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462788 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462793 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462799 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462804 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462808 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462814 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462819 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462823 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462827 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:48.604611 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462831 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462836 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462839 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462843 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462848 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462852 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462856 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462863 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462868 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462873 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462877 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462882 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462888 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462893 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462897 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.462901 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.462994 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463004 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463014 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463021 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463029 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:58:48.605324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463034 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463041 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463048 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463053 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463060 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463066 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463072 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463077 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463082 2572 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463087 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463092 2572 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463097 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463102 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463108 2572 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463113 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463118 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463123 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463129 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463135 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463140 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463146 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463152 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463157 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463164 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:58:48.606053 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463169 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463174 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463180 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463186 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463192 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463197 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463201 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463207 2572 flags.go:64] FLAG: --enable-server="true" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463212 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463222 2572 flags.go:64] FLAG: --event-burst="100" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463228 2572 flags.go:64] FLAG: --event-qps="50" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463233 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463240 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463245 2572 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463251 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463255 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463261 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463266 2572 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463272 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463276 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463281 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463286 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463291 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463296 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463302 2572 flags.go:64] FLAG: --feature-gates="" Jul 01 16:58:48.607050 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463308 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463313 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463318 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463323 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463328 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463333 2572 flags.go:64] FLAG: --help="false" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463344 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463350 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463354 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463359 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463365 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463370 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463376 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463380 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463385 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463392 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463397 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463403 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463408 2572 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463415 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463419 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463424 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463429 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463435 2572 flags.go:64] FLAG: --lock-file="" Jul 01 16:58:48.607975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463439 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463445 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463450 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463458 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463464 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463469 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463473 2572 flags.go:64] FLAG: --logging-format="text" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463478 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463484 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463488 2572 flags.go:64] FLAG: --manifest-url="" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463493 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463500 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463505 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463512 2572 flags.go:64] FLAG: --max-pods="110" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463517 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463522 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463527 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463533 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463538 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463543 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463548 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463560 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463565 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463571 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:58:48.608813 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463576 2572 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463582 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463591 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463595 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463602 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463607 2572 flags.go:64] FLAG: --port="10250" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463612 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463617 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-086d577b506e1230f" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463622 2572 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463628 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463633 2572 flags.go:64] FLAG: --register-node="true" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463638 2572 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463644 2572 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463649 2572 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463654 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463659 2572 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463665 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463670 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463675 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463680 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463684 2572 flags.go:64] FLAG: --runonce="false" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463689 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463695 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463700 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463705 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:58:48.609671 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463711 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463716 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463721 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463726 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463731 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463735 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463740 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463745 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463750 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463769 2572 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463775 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463785 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463790 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463796 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463802 2572 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463807 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463812 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463817 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463822 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463827 2572 flags.go:64] FLAG: --v="2" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463834 2572 flags.go:64] FLAG: --version="false" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463841 2572 flags.go:64] FLAG: --vmodule="" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463846 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.463852 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:58:48.610526 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464029 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464036 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464040 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464044 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464049 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464055 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464060 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464065 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464069 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464073 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464078 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464082 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464085 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464090 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464096 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464103 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464108 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464113 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464119 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:48.611489 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464125 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464129 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464134 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464138 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464142 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464147 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464151 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464156 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464162 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464167 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464171 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464176 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464181 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464185 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464189 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464193 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464198 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464202 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464207 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:48.612191 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464211 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464215 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464220 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464224 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464228 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464233 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464237 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464241 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464245 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464250 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464254 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464258 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464262 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464270 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464275 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464279 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464283 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464287 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464291 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464296 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:48.612817 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464300 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464304 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464309 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464313 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464317 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464321 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464325 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464329 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464334 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464338 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464342 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464348 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464352 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464357 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464361 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464365 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464370 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464374 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464378 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:48.613993 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464383 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464388 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464393 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464396 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464400 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464405 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464411 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464417 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464421 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464427 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464433 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464437 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464441 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464445 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464449 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464454 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464458 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464463 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464468 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464472 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:48.614632 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464476 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.464481 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.465133 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.472471 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.472489 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.472511 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.472517 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472591 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472597 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472602 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472606 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472610 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472613 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472616 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:48.615383 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472620 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472623 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472626 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472629 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472632 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472635 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472637 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472640 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472643 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472646 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472649 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472652 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472655 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472658 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472660 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472663 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472666 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472669 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472671 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472674 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:48.616162 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472678 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472681 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472691 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472694 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472697 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472699 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472702 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472706 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472709 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472712 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472715 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472718 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472720 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472723 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472726 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472730 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472734 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472737 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472740 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472743 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:48.617097 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472746 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472749 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472752 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472772 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472775 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472778 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472781 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472784 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472787 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472790 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472793 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472798 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472802 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472806 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472809 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472818 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472821 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472824 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472827 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:48.618358 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472830 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472833 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472835 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472841 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472844 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472847 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472849 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472852 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472855 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472858 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472861 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472863 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472866 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472869 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472872 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472874 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472877 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472880 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472882 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472885 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:48.619193 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472888 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472891 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472894 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472897 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472900 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472902 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472905 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472908 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472911 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472920 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472922 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472925 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.472928 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.472933 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473079 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:58:48.622060 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473084 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473089 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473092 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473096 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473099 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473102 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473105 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473107 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473117 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473120 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473123 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473126 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473128 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473131 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473134 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473137 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473140 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473145 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473147 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473150 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:58:48.622553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473153 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473156 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473159 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473161 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473164 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473167 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473170 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473179 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473182 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473185 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473187 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473190 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473193 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473198 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473201 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473204 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473206 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473209 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473212 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473215 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:58:48.623331 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473217 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473220 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473223 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473226 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473229 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473232 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473234 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473237 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473240 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473244 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473248 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473252 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473256 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473259 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473262 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473264 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473267 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473270 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473273 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:58:48.623934 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473275 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473284 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473287 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473290 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473293 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473295 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473300 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473303 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473305 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473308 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473311 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473314 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473316 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473319 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473322 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473325 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473329 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473331 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473335 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:58:48.763894 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473337 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473340 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473343 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473347 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473350 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473353 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473356 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473359 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473363 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473366 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473370 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473373 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473376 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473379 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473382 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473391 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473395 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473398 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473401 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:58:48.782811 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:48.473405 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.473410 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.473524 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.475600 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.476941 2572 server.go:1019] "Starting client certificate rotation" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.477048 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.477110 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.479695 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.485927 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.507220 2572 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.509378 2572 log.go:25] "Validated CRI v1 image API" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.510316 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:58:48.787507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.514426 2572 fs.go:135] Filesystem UUIDs: map[52518be7-9157-4230-8a4d-4b4ac14f4a78:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 afa84547-c869-4b85-868d-8eded911ed57:/dev/nvme0n1p4] Jul 01 16:58:48.788011 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.514440 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.518814 2572 manager.go:216] Machine: {Timestamp:2026-07-01 16:58:48.518302485 +0000 UTC m=+0.355647250 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3047471 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2faef0713c19227a663e1a001162b6 SystemUUID:ec2faef0-713c-1922-7a66-3e1a001162b6 BootID:5d2771ad-03b6-4a08-9049-acae13774ccd Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:18:a4:b3:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:18:a4:b3:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:59:ac:6d:5a:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.518911 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.518986 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.521334 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.521362 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.522098 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.522107 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:58:48.788635 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.522120 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.522739 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.523601 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.526934 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527050 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527082 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527094 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527116 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527126 2572 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527134 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527579 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.527596 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.538196 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.538816 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540589 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540627 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540855 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540870 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540881 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540890 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540900 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.540910 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.541347 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.541355 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.541367 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.541377 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.541388 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.541397 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.542243 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.542260 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.546033 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.546479 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.546493 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.546810 2572 server.go:1268] "Started kubelet" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.546864 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.546894 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.546988 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.548092 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.549595 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:58:48.789104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.554333 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.554335 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.554558 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.555044 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.555046 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.555064 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.555141 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.555149 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.557519 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.558070 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558126 2572 factory.go:55] Registering systemd factory Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558140 2572 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558334 2572 factory.go:153] Registering CRI-O factory Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558342 2572 factory.go:223] Registration of the crio container factory successfully Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558363 2572 factory.go:103] Registering Raw factory Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558373 2572 manager.go:1196] Started watching for new ooms in manager Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.558905 2572 manager.go:349] Starting recovery of all containers Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.560068 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.560338 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.560212 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18be38f54425ddfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-07-01 16:58:48.546770429 +0000 UTC m=+0.384115178,LastTimestamp:2026-07-01 16:58:48.546770429 +0000 UTC m=+0.384115178,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.570638 2572 manager.go:354] Recovery completed Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.580938 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.583542 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.583574 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.583589 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.584313 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.584322 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.584338 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.585611 2572 policy_none.go:49] "None policy: Start" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.585625 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.585635 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.586474 2572 policy_none.go:47] "Start" Jul 01 16:58:48.790667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.587059 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.587383 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18be38f5465743c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-07-01 16:58:48.583562181 +0000 UTC m=+0.420906929,LastTimestamp:2026-07-01 16:58:48.583562181 +0000 UTC m=+0.420906929,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.588880 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.588917 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.588930 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.600044 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qvsw" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.605742 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18be38f546578cfc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-07-01 16:58:48.583580924 +0000 UTC m=+0.420925670,LastTimestamp:2026-07-01 16:58:48.583580924 +0000 UTC m=+0.420925670,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.610740 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qvsw" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.615021 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-133.ec2.internal.18be38f54657c5eb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-133.ec2.internal,UID:ip-10-0-139-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-133.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-133.ec2.internal,},FirstTimestamp:2026-07-01 16:58:48.583595499 +0000 UTC m=+0.420940246,LastTimestamp:2026-07-01 16:58:48.583595499 +0000 UTC m=+0.420940246,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-133.ec2.internal,}" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.633466 2572 manager.go:337] "Starting Device Plugin manager" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.633499 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.633509 2572 server.go:87] "Starting device plugin registration server" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.633749 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.633811 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.634025 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.634101 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.634110 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.634528 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:58:48.792158 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.634579 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.643766 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.645071 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.645116 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.645144 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.645210 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.647780 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.736106 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.737371 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.737407 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.737424 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.737460 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.745595 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal"] Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.745665 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.747005 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.747039 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.747050 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.748538 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.748561 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-133.ec2.internal\": node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.748582 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.748741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.748768 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.749268 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.749288 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.749298 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.749388 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.749409 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.749423 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.750272 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.750294 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.750988 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.751016 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.751026 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:48.792775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.755627 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33a1e4823758a9cebf876a25202e1a48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"33a1e4823758a9cebf876a25202e1a48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.793784 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.755655 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33a1e4823758a9cebf876a25202e1a48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"33a1e4823758a9cebf876a25202e1a48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.793784 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.755672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8db664b064a3ce5093dc28d017aa9152-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"8db664b064a3ce5093dc28d017aa9152\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.793784 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.788522 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.806711 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.811438 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-133.ec2.internal\" not found" node="ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.856310 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33a1e4823758a9cebf876a25202e1a48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"33a1e4823758a9cebf876a25202e1a48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.856334 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33a1e4823758a9cebf876a25202e1a48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"33a1e4823758a9cebf876a25202e1a48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.856351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8db664b064a3ce5093dc28d017aa9152-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"8db664b064a3ce5093dc28d017aa9152\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.856402 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8db664b064a3ce5093dc28d017aa9152-config\") pod \"kube-apiserver-proxy-ip-10-0-139-133.ec2.internal\" (UID: \"8db664b064a3ce5093dc28d017aa9152\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.856407 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/33a1e4823758a9cebf876a25202e1a48-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"33a1e4823758a9cebf876a25202e1a48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:48.856425 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33a1e4823758a9cebf876a25202e1a48-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal\" (UID: \"33a1e4823758a9cebf876a25202e1a48\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:48.932963 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.889137 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.124418 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:48.989316 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.124418 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.091720 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.124418 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.110258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:49.124418 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.113598 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" Jul 01 16:58:49.316023 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.193442 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.316023 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.295712 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.466767 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.396725 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.607116 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.476788 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:58:49.607116 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.476939 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:58:49.607116 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.497460 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.607116 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.561797 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:49.607116 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.597871 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.615039 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:53:49 +0000 UTC" deadline="2028-01-01 11:21:47.575568997 +0000 UTC" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.615092 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13170h22m57.960490885s" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.662194 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.663199 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.663228 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.663239 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.698183 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.762428 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.722710 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:49.895330 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:49.798895 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-133.ec2.internal\" not found" Jul 01 16:58:49.895330 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:49.822852 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db664b064a3ce5093dc28d017aa9152.slice/crio-65726d913fd5fb0f1b4ec8dfac326e5d0d98705ff4722fdc57e0d637c4fd4229 WatchSource:0}: Error finding container 65726d913fd5fb0f1b4ec8dfac326e5d0d98705ff4722fdc57e0d637c4fd4229: Status 404 returned error can't find the container with id 65726d913fd5fb0f1b4ec8dfac326e5d0d98705ff4722fdc57e0d637c4fd4229 Jul 01 16:58:49.895330 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.838362 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:58:49.895330 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:49.847959 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a1e4823758a9cebf876a25202e1a48.slice/crio-a6208d6e56e88d73fe22e3c6a330dab559611a4c738ee925edd53728c9b9911f WatchSource:0}: Error finding container a6208d6e56e88d73fe22e3c6a330dab559611a4c738ee925edd53728c9b9911f: Status 404 returned error can't find the container with id a6208d6e56e88d73fe22e3c6a330dab559611a4c738ee925edd53728c9b9911f Jul 01 16:58:49.895330 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.888934 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:50.019646 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.958497 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" Jul 01 16:58:50.019646 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.978427 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:58:50.019646 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:49.979509 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" Jul 01 16:58:50.019646 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.004098 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:58:50.528926 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.528899 2572 apiserver.go:52] "Watching apiserver" Jul 01 16:58:50.538609 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.538588 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:58:50.540091 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.540067 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jxl5v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv","openshift-cluster-node-tuning-operator/tuned-9zmwb","openshift-dns/node-resolver-nq7gd","openshift-multus/network-metrics-daemon-66nq9","openshift-network-operator/iptables-alerter-m22mr","kube-system/konnectivity-agent-djk5c","kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal","openshift-image-registry/node-ca-75f85","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal","openshift-multus/multus-additional-cni-plugins-xpsb2","openshift-multus/multus-r7jmp","openshift-network-diagnostics/network-check-target-ts2zp","openshift-ovn-kubernetes/ovnkube-node-dtdwc"] Jul 01 16:58:50.542639 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.542616 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.544893 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.544870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:50.544998 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.544955 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:58:50.547173 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.547152 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.549482 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.549437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.550191 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.550168 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-56v98\"" Jul 01 16:58:50.550619 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.550466 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.550619 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.550494 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.551389 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.551369 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cdpwf\"" Jul 01 16:58:50.551623 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.551604 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:58:50.551775 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.551747 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:58:50.551975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.551958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:50.552054 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.552031 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:58:50.554192 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.554167 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.554877 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.554860 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:58:50.557018 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.556998 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.560193 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.560172 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:58:50.560280 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.560222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.560332 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.560284 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:58:50.560332 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.560296 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.560332 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.560310 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.560576 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.560558 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nln7q\"" Jul 01 16:58:50.560930 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.560901 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.561431 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.561412 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.561431 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.561428 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.561595 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.561415 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.561595 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.561561 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wqzxw\"" Jul 01 16:58:50.561906 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.561886 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhvvb\"" Jul 01 16:58:50.562005 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.561986 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:58:50.562504 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.562483 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.566911 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.566890 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.569324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.569299 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:58:50.569430 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.569366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.569704 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.569687 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.569976 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.569957 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.571988 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.571967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.572250 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572227 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b3a1960-c420-477f-97d3-407d0ed132e3-agent-certs\") pod \"konnectivity-agent-djk5c\" (UID: \"5b3a1960-c420-477f-97d3-407d0ed132e3\") " pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.572350 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572264 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b3a1960-c420-477f-97d3-407d0ed132e3-konnectivity-ca\") pod \"konnectivity-agent-djk5c\" (UID: \"5b3a1960-c420-477f-97d3-407d0ed132e3\") " pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.572350 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572317 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24ed4236-c948-4116-a87d-e1e66a32e922-host-slash\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.572350 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjf7\" (UniqueName: \"kubernetes.io/projected/24ed4236-c948-4116-a87d-e1e66a32e922-kube-api-access-vfjf7\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.572497 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-modprobe-d\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572497 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572407 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmq5w\" (UniqueName: \"kubernetes.io/projected/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-kube-api-access-wmq5w\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572497 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0151a307-6783-4944-af20-6a5161ab3c01-tmp-dir\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.572497 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysctl-d\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572676 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgxlc\" (UniqueName: \"kubernetes.io/projected/68d0cc90-fdbf-4842-a2f1-963f5d70d845-kube-api-access-qgxlc\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:50.572676 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572552 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e89d2d88-82af-497b-8b9a-12d3506dd7a7-serviceca\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.572676 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572579 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-var-lib-kubelet\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572676 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572606 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:50.572676 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572644 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-systemd\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572676 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572672 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-tuned\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-tmp\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572730 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24ed4236-c948-4116-a87d-e1e66a32e922-iptables-alerter-script\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-host\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysctl-conf\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572790 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-sys\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysconfig\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572837 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-lib-modules\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e89d2d88-82af-497b-8b9a-12d3506dd7a7-host\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-kubernetes\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.572960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-run\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.573432 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snmb2\" (UniqueName: \"kubernetes.io/projected/0151a307-6783-4944-af20-6a5161ab3c01-kube-api-access-snmb2\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.573432 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.572987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0151a307-6783-4944-af20-6a5161ab3c01-hosts-file\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.573432 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.573012 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5zl\" (UniqueName: \"kubernetes.io/projected/e89d2d88-82af-497b-8b9a-12d3506dd7a7-kube-api-access-fs5zl\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.576887 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.576867 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:58:50.577934 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.577909 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:58:50.578013 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.577949 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.578013 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.577977 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kp2v9\"" Jul 01 16:58:50.578080 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578056 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mf8h7\"" Jul 01 16:58:50.578131 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578116 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.578170 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578132 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:58:50.578170 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.577919 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:58:50.578249 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578235 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:58:50.578302 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578289 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:58:50.578361 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578341 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:58:50.578395 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578357 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xl6r9\"" Jul 01 16:58:50.578395 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578374 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:58:50.578455 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578418 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:58:50.578558 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578543 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xxtgc\"" Jul 01 16:58:50.578970 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.578952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:58:50.594696 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.594672 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:58:50.616350 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.616319 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:58:50.633439 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.633417 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-98t6h" Jul 01 16:58:50.650925 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.650869 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"33a1e4823758a9cebf876a25202e1a48","Type":"ContainerStarted","Data":"a6208d6e56e88d73fe22e3c6a330dab559611a4c738ee925edd53728c9b9911f"} Jul 01 16:58:50.651973 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.651949 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-98t6h" Jul 01 16:58:50.652224 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.652184 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"8db664b064a3ce5093dc28d017aa9152","Type":"ContainerStarted","Data":"65726d913fd5fb0f1b4ec8dfac326e5d0d98705ff4722fdc57e0d637c4fd4229"} Jul 01 16:58:50.655960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.655932 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:58:50.673505 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4lbh\" (UniqueName: \"kubernetes.io/projected/4e1b704a-e43e-4559-8382-aa1011ea804c-kube-api-access-g4lbh\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.673614 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-k8s-cni-cncf-io\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.673614 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673546 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-cni-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.673745 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673621 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-netns\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.673745 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673666 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0151a307-6783-4944-af20-6a5161ab3c01-hosts-file\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.673745 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5zl\" (UniqueName: \"kubernetes.io/projected/e89d2d88-82af-497b-8b9a-12d3506dd7a7-kube-api-access-fs5zl\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.673945 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673796 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0151a307-6783-4944-af20-6a5161ab3c01-hosts-file\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.673945 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.673945 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673881 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-socket-dir-parent\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.673945 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e89d2d88-82af-497b-8b9a-12d3506dd7a7-serviceca\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.673979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b3a1960-c420-477f-97d3-407d0ed132e3-agent-certs\") pod \"konnectivity-agent-djk5c\" (UID: \"5b3a1960-c420-477f-97d3-407d0ed132e3\") " pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24ed4236-c948-4116-a87d-e1e66a32e922-host-slash\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-env-overrides\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-cnibin\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674107 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24ed4236-c948-4116-a87d-e1e66a32e922-host-slash\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.674144 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674120 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgxlc\" (UniqueName: \"kubernetes.io/projected/68d0cc90-fdbf-4842-a2f1-963f5d70d845-kube-api-access-qgxlc\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-run-netns\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-conf-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-etc-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-systemd\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-tmp\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674407 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-sys-fs\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-systemd\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.674527 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-log-socket\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674540 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674556 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24ed4236-c948-4116-a87d-e1e66a32e922-iptables-alerter-script\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674621 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-host\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysctl-conf\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysctl-conf\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-device-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674881 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-host\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674896 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e89d2d88-82af-497b-8b9a-12d3506dd7a7-serviceca\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.674927 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-systemd\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675013 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-node-log\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.675217 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-daemon-config\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675226 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysconfig\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e89d2d88-82af-497b-8b9a-12d3506dd7a7-host\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675382 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24ed4236-c948-4116-a87d-e1e66a32e922-iptables-alerter-script\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfa80559-5b81-4609-bf42-c0dfcbbb2624-kubelet-config\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675433 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e89d2d88-82af-497b-8b9a-12d3506dd7a7-host\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-systemd-units\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-cni-bin\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysconfig\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675502 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-multus-certs\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hd5\" (UniqueName: \"kubernetes.io/projected/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-kube-api-access-j2hd5\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675596 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-os-release\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675659 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-kubernetes\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675686 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-run\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.675850 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snmb2\" (UniqueName: \"kubernetes.io/projected/0151a307-6783-4944-af20-6a5161ab3c01-kube-api-access-snmb2\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-socket-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675786 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-kubernetes\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-system-cni-dir\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675835 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-ovn\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675893 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-cni-bin\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675918 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-system-cni-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675920 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-run\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.675995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-etc-kubernetes\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676059 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b3a1960-c420-477f-97d3-407d0ed132e3-konnectivity-ca\") pod \"konnectivity-agent-djk5c\" (UID: \"5b3a1960-c420-477f-97d3-407d0ed132e3\") " pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjf7\" (UniqueName: \"kubernetes.io/projected/24ed4236-c948-4116-a87d-e1e66a32e922-kube-api-access-vfjf7\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-modprobe-d\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.676584 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmq5w\" (UniqueName: \"kubernetes.io/projected/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-kube-api-access-wmq5w\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0151a307-6783-4944-af20-6a5161ab3c01-tmp-dir\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b490022b-e429-4918-b569-714174b00688-ovn-node-metrics-cert\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676484 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-ovnkube-script-lib\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysctl-d\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-kubelet\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-modprobe-d\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-ovnkube-config\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676605 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-os-release\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-cni-binary-copy\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-hostroot\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-var-lib-kubelet\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b3a1960-c420-477f-97d3-407d0ed132e3-konnectivity-ca\") pod \"konnectivity-agent-djk5c\" (UID: \"5b3a1960-c420-477f-97d3-407d0ed132e3\") " pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.677317 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-cni-netd\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676954 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272t2\" (UniqueName: \"kubernetes.io/projected/b490022b-e429-4918-b569-714174b00688-kube-api-access-272t2\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-cnibin\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677034 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-sysctl-d\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-tuned\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677118 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-var-lib-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-sys\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-registration-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-slash\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-cni-multus\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-kubelet\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677374 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnlsh\" (UniqueName: \"kubernetes.io/projected/043d0318-2447-4ddd-8c21-2a4a4256706d-kube-api-access-rnlsh\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-lib-modules\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677460 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-var-lib-kubelet\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.678006 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.676959 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0151a307-6783-4944-af20-6a5161ab3c01-tmp-dir\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677572 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-sys\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677578 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-lib-modules\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677628 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfa80559-5b81-4609-bf42-c0dfcbbb2624-dbus\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.677653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.677742 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.677817 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:51.177795059 +0000 UTC m=+3.015139793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:50.679769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.679239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b3a1960-c420-477f-97d3-407d0ed132e3-agent-certs\") pod \"konnectivity-agent-djk5c\" (UID: \"5b3a1960-c420-477f-97d3-407d0ed132e3\") " pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.680132 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.679972 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-tmp\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.680132 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.679998 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-etc-tuned\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.701540 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.701519 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5zl\" (UniqueName: \"kubernetes.io/projected/e89d2d88-82af-497b-8b9a-12d3506dd7a7-kube-api-access-fs5zl\") pod \"node-ca-75f85\" (UID: \"e89d2d88-82af-497b-8b9a-12d3506dd7a7\") " pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.704564 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.704540 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:50.704665 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.704574 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:50.704665 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.704589 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:50.704819 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.704805 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:51.204776615 +0000 UTC m=+3.042121366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:50.706736 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.706689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snmb2\" (UniqueName: \"kubernetes.io/projected/0151a307-6783-4944-af20-6a5161ab3c01-kube-api-access-snmb2\") pod \"node-resolver-nq7gd\" (UID: \"0151a307-6783-4944-af20-6a5161ab3c01\") " pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.709221 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.709196 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjf7\" (UniqueName: \"kubernetes.io/projected/24ed4236-c948-4116-a87d-e1e66a32e922-kube-api-access-vfjf7\") pod \"iptables-alerter-m22mr\" (UID: \"24ed4236-c948-4116-a87d-e1e66a32e922\") " pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.710798 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.710771 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmq5w\" (UniqueName: \"kubernetes.io/projected/a5c55acf-c0e6-49b8-834b-6f5be9c3182f-kube-api-access-wmq5w\") pod \"tuned-9zmwb\" (UID: \"a5c55acf-c0e6-49b8-834b-6f5be9c3182f\") " pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.711104 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.711082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgxlc\" (UniqueName: \"kubernetes.io/projected/68d0cc90-fdbf-4842-a2f1-963f5d70d845-kube-api-access-qgxlc\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.777902 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-ovn\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.777957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.777987 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-cni-bin\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-system-cni-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778015 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-ovn\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-etc-kubernetes\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778042 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-etc-kubernetes\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778084 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-system-cni-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778050 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-cni-bin\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b490022b-e429-4918-b569-714174b00688-ovn-node-metrics-cert\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-ovnkube-script-lib\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-etc-selinux\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.778534 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-kubelet\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778196 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-ovnkube-config\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778213 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-kubelet\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-os-release\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778355 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-cni-binary-copy\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-hostroot\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-cni-netd\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272t2\" (UniqueName: \"kubernetes.io/projected/b490022b-e429-4918-b569-714174b00688-kube-api-access-272t2\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778483 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-cnibin\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-var-lib-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-registration-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-slash\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-cni-multus\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-kubelet\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.779475 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778627 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnlsh\" (UniqueName: \"kubernetes.io/projected/043d0318-2447-4ddd-8c21-2a4a4256706d-kube-api-access-rnlsh\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778680 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfa80559-5b81-4609-bf42-c0dfcbbb2624-dbus\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778703 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778747 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4lbh\" (UniqueName: \"kubernetes.io/projected/4e1b704a-e43e-4559-8382-aa1011ea804c-kube-api-access-g4lbh\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-k8s-cni-cncf-io\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-cni-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778833 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-netns\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-ovnkube-config\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-socket-dir-parent\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778926 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-os-release\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778943 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-cni-multus\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778982 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.780195 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779001 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-env-overrides\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779008 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-cnibin\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779059 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-var-lib-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-kubelet\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779126 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-registration-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779193 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-slash\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-hostroot\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779239 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dfa80559-5b81-4609-bf42-c0dfcbbb2624-dbus\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.778993 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-socket-dir-parent\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-cni-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779342 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-k8s-cni-cncf-io\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779407 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779459 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-env-overrides\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-cnibin\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779494 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-cni-binary-copy\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.780992 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779498 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.779502 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779522 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-cni-netd\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779573 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-netns\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-run-netns\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:50.779639 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:51.279618403 +0000 UTC m=+3.116963138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779679 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-cnibin\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-run-netns\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-conf-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779822 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-conf-dir\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779865 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-etc-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779900 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-etc-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779946 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.781592 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.779976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780075 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-openvswitch\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-sys-fs\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-log-socket\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-sys-fs\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-log-socket\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-device-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-systemd\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-node-log\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-daemon-config\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-device-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.782303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b490022b-e429-4918-b569-714174b00688-ovnkube-script-lib\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780394 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfa80559-5b81-4609-bf42-c0dfcbbb2624-kubelet-config\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780416 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-systemd-units\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780451 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dfa80559-5b81-4609-bf42-c0dfcbbb2624-kubelet-config\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780470 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-cni-bin\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-systemd-units\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780440 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-node-log\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780494 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b490022b-e429-4918-b569-714174b00688-run-systemd\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-multus-certs\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780545 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hd5\" (UniqueName: \"kubernetes.io/projected/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-kube-api-access-j2hd5\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-os-release\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-run-multus-certs\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-socket-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.782942 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-system-cni-dir\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780651 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-os-release\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780546 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-host-var-lib-cni-bin\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780718 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/043d0318-2447-4ddd-8c21-2a4a4256706d-system-cni-dir\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/043d0318-2447-4ddd-8c21-2a4a4256706d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780795 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4e1b704a-e43e-4559-8382-aa1011ea804c-socket-dir\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.780905 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-multus-daemon-config\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.783553 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.781666 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b490022b-e429-4918-b569-714174b00688-ovn-node-metrics-cert\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.793696 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.793652 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnlsh\" (UniqueName: \"kubernetes.io/projected/043d0318-2447-4ddd-8c21-2a4a4256706d-kube-api-access-rnlsh\") pod \"multus-additional-cni-plugins-xpsb2\" (UID: \"043d0318-2447-4ddd-8c21-2a4a4256706d\") " pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.793812 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.793737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4lbh\" (UniqueName: \"kubernetes.io/projected/4e1b704a-e43e-4559-8382-aa1011ea804c-kube-api-access-g4lbh\") pod \"aws-ebs-csi-driver-node-m95cv\" (UID: \"4e1b704a-e43e-4559-8382-aa1011ea804c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.795510 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.795469 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-272t2\" (UniqueName: \"kubernetes.io/projected/b490022b-e429-4918-b569-714174b00688-kube-api-access-272t2\") pod \"ovnkube-node-dtdwc\" (UID: \"b490022b-e429-4918-b569-714174b00688\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.797243 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.797223 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hd5\" (UniqueName: \"kubernetes.io/projected/f0a2467a-6f91-490e-8f89-5d7d0b52dc05-kube-api-access-j2hd5\") pod \"multus-r7jmp\" (UID: \"f0a2467a-6f91-490e-8f89-5d7d0b52dc05\") " pod="openshift-multus/multus-r7jmp" Jul 01 16:58:50.855484 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.855449 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:58:50.863373 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.863350 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" Jul 01 16:58:50.874818 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.874798 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nq7gd" Jul 01 16:58:50.880814 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.880788 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m22mr" Jul 01 16:58:50.887875 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.887795 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-75f85" Jul 01 16:58:50.895748 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.895727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" Jul 01 16:58:50.902744 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.902710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:58:50.911258 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.911235 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" Jul 01 16:58:50.922184 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:50.922161 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r7jmp" Jul 01 16:58:51.184243 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:51.184150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:51.184402 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.184301 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:51.184402 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.184383 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:52.184363437 +0000 UTC m=+4.021708168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:51.285292 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:51.285248 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:51.285487 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:51.285348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:51.285487 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.285430 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:51.285617 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.285507 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:52.285491122 +0000 UTC m=+4.122835856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:51.285617 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.285526 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:51.285617 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.285544 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:51.285617 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.285555 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:51.285824 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.285628 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:52.285598906 +0000 UTC m=+4.122943638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:51.645880 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:51.645839 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:51.646423 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:51.645969 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:58:51.654831 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:51.654798 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:53:51 +0000 UTC" deadline="2028-04-14 05:34:29.252096424 +0000 UTC" Jul 01 16:58:51.654831 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:51.654825 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15660h35m37.597276105s" Jul 01 16:58:51.859634 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.859597 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ed4236_c948_4116_a87d_e1e66a32e922.slice/crio-2bc543161b4eb29daf1a7771b2d8d0b44fcde79ed4c43ac0d338df0e5fee0adf WatchSource:0}: Error finding container 2bc543161b4eb29daf1a7771b2d8d0b44fcde79ed4c43ac0d338df0e5fee0adf: Status 404 returned error can't find the container with id 2bc543161b4eb29daf1a7771b2d8d0b44fcde79ed4c43ac0d338df0e5fee0adf Jul 01 16:58:51.860931 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.860880 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3a1960_c420_477f_97d3_407d0ed132e3.slice/crio-ab9ab390694ad4943f54bfee48e0e42932ac2313ec9a5f040a6dbb899c663b74 WatchSource:0}: Error finding container ab9ab390694ad4943f54bfee48e0e42932ac2313ec9a5f040a6dbb899c663b74: Status 404 returned error can't find the container with id ab9ab390694ad4943f54bfee48e0e42932ac2313ec9a5f040a6dbb899c663b74 Jul 01 16:58:51.861690 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.861505 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c55acf_c0e6_49b8_834b_6f5be9c3182f.slice/crio-e204860e68616a297a7652849c33c43b819e190a6a02e38bcfe0b19545327676 WatchSource:0}: Error finding container e204860e68616a297a7652849c33c43b819e190a6a02e38bcfe0b19545327676: Status 404 returned error can't find the container with id e204860e68616a297a7652849c33c43b819e190a6a02e38bcfe0b19545327676 Jul 01 16:58:51.862707 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.862462 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a2467a_6f91_490e_8f89_5d7d0b52dc05.slice/crio-461855c11394979d48b05b959b0a58e4e68da6352c78a8e39d71fd20bdc279ac WatchSource:0}: Error finding container 461855c11394979d48b05b959b0a58e4e68da6352c78a8e39d71fd20bdc279ac: Status 404 returned error can't find the container with id 461855c11394979d48b05b959b0a58e4e68da6352c78a8e39d71fd20bdc279ac Jul 01 16:58:51.865842 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.865814 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0151a307_6783_4944_af20_6a5161ab3c01.slice/crio-136619dab71b094b63b35d4f83205fe5f9b10dc09f486a75e091af14dc5adc0a WatchSource:0}: Error finding container 136619dab71b094b63b35d4f83205fe5f9b10dc09f486a75e091af14dc5adc0a: Status 404 returned error can't find the container with id 136619dab71b094b63b35d4f83205fe5f9b10dc09f486a75e091af14dc5adc0a Jul 01 16:58:51.867483 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.867461 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb490022b_e429_4918_b569_714174b00688.slice/crio-1cf3d7a7f69abf757f8f260c3c8fb537da57a05e78d655099841bf6ad225a626 WatchSource:0}: Error finding container 1cf3d7a7f69abf757f8f260c3c8fb537da57a05e78d655099841bf6ad225a626: Status 404 returned error can't find the container with id 1cf3d7a7f69abf757f8f260c3c8fb537da57a05e78d655099841bf6ad225a626 Jul 01 16:58:51.868826 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.868799 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89d2d88_82af_497b_8b9a_12d3506dd7a7.slice/crio-a0747af4b5d6cf473cb047196678f48585938db8d377e5443e19fe1e6f1396bd WatchSource:0}: Error finding container a0747af4b5d6cf473cb047196678f48585938db8d377e5443e19fe1e6f1396bd: Status 404 returned error can't find the container with id a0747af4b5d6cf473cb047196678f48585938db8d377e5443e19fe1e6f1396bd Jul 01 16:58:51.869661 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.869640 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043d0318_2447_4ddd_8c21_2a4a4256706d.slice/crio-05fa27589b99a0216eda6701ec2e501bb4cbc15a3881e7601cfa9918a80c5569 WatchSource:0}: Error finding container 05fa27589b99a0216eda6701ec2e501bb4cbc15a3881e7601cfa9918a80c5569: Status 404 returned error can't find the container with id 05fa27589b99a0216eda6701ec2e501bb4cbc15a3881e7601cfa9918a80c5569 Jul 01 16:58:51.870725 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:58:51.870173 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1b704a_e43e_4559_8382_aa1011ea804c.slice/crio-e0656050f57e0dfbddd0eb3f03b2afc65376d520f4c3136e28984d0bd8d2cbe9 WatchSource:0}: Error finding container e0656050f57e0dfbddd0eb3f03b2afc65376d520f4c3136e28984d0bd8d2cbe9: Status 404 returned error can't find the container with id e0656050f57e0dfbddd0eb3f03b2afc65376d520f4c3136e28984d0bd8d2cbe9 Jul 01 16:58:52.193327 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.193095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:52.193327 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.193250 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:52.193463 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.193345 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:54.193330613 +0000 UTC m=+6.030675344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:52.294667 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.294625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:52.294848 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.294752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:52.294848 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.294791 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:52.294931 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.294866 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:54.294849551 +0000 UTC m=+6.132194297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:52.294931 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.294919 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:52.295013 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.294939 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:52.295013 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.294952 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:52.295091 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.295013 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:54.294995126 +0000 UTC m=+6.132339860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:52.648441 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.648404 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:52.649177 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.648562 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:58:52.649177 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.649003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:52.649177 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:52.649101 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:58:52.654958 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.654895 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:53:51 +0000 UTC" deadline="2027-12-24 12:39:27.918613962 +0000 UTC" Jul 01 16:58:52.654958 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.654957 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12979h40m35.263661169s" Jul 01 16:58:52.659175 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.659044 2572 generic.go:356] "Generic (PLEG): container finished" podID="33a1e4823758a9cebf876a25202e1a48" containerID="00d272b64cbc81c1698d29879292ba6fc58b308feeca8c1e2a84925eda6c344a" exitCode=0 Jul 01 16:58:52.659175 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.659125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"33a1e4823758a9cebf876a25202e1a48","Type":"ContainerDied","Data":"00d272b64cbc81c1698d29879292ba6fc58b308feeca8c1e2a84925eda6c344a"} Jul 01 16:58:52.662304 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.661831 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" event={"ID":"8db664b064a3ce5093dc28d017aa9152","Type":"ContainerStarted","Data":"f53f235ee684a11fcd02e566732582d8abcb9a30ddff7cb30b9db71d29410a6f"} Jul 01 16:58:52.673615 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.673389 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" event={"ID":"4e1b704a-e43e-4559-8382-aa1011ea804c","Type":"ContainerStarted","Data":"e0656050f57e0dfbddd0eb3f03b2afc65376d520f4c3136e28984d0bd8d2cbe9"} Jul 01 16:58:52.676719 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.676606 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"1cf3d7a7f69abf757f8f260c3c8fb537da57a05e78d655099841bf6ad225a626"} Jul 01 16:58:52.678508 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.678467 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r7jmp" event={"ID":"f0a2467a-6f91-490e-8f89-5d7d0b52dc05","Type":"ContainerStarted","Data":"461855c11394979d48b05b959b0a58e4e68da6352c78a8e39d71fd20bdc279ac"} Jul 01 16:58:52.681529 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.681503 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-djk5c" event={"ID":"5b3a1960-c420-477f-97d3-407d0ed132e3","Type":"ContainerStarted","Data":"ab9ab390694ad4943f54bfee48e0e42932ac2313ec9a5f040a6dbb899c663b74"} Jul 01 16:58:52.686891 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.686847 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m22mr" event={"ID":"24ed4236-c948-4116-a87d-e1e66a32e922","Type":"ContainerStarted","Data":"2bc543161b4eb29daf1a7771b2d8d0b44fcde79ed4c43ac0d338df0e5fee0adf"} Jul 01 16:58:52.695070 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.694248 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerStarted","Data":"05fa27589b99a0216eda6701ec2e501bb4cbc15a3881e7601cfa9918a80c5569"} Jul 01 16:58:52.699703 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.699679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75f85" event={"ID":"e89d2d88-82af-497b-8b9a-12d3506dd7a7","Type":"ContainerStarted","Data":"a0747af4b5d6cf473cb047196678f48585938db8d377e5443e19fe1e6f1396bd"} Jul 01 16:58:52.729644 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.729564 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nq7gd" event={"ID":"0151a307-6783-4944-af20-6a5161ab3c01","Type":"ContainerStarted","Data":"136619dab71b094b63b35d4f83205fe5f9b10dc09f486a75e091af14dc5adc0a"} Jul 01 16:58:52.758041 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:52.758003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" event={"ID":"a5c55acf-c0e6-49b8-834b-6f5be9c3182f","Type":"ContainerStarted","Data":"e204860e68616a297a7652849c33c43b819e190a6a02e38bcfe0b19545327676"} Jul 01 16:58:53.646351 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:53.645847 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:53.646351 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:53.645986 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:58:53.795946 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:53.795820 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" event={"ID":"33a1e4823758a9cebf876a25202e1a48","Type":"ContainerStarted","Data":"70b10c6b9db4452e3bee3ac0134216ce875d53f9f8fc4ac9386a0d96b877c960"} Jul 01 16:58:53.814738 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:53.814667 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-133.ec2.internal" podStartSLOduration=3.814642992 podStartE2EDuration="3.814642992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:52.809082666 +0000 UTC m=+4.646427443" watchObservedRunningTime="2026-07-01 16:58:53.814642992 +0000 UTC m=+5.651987750" Jul 01 16:58:53.814955 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:53.814880 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-133.ec2.internal" podStartSLOduration=3.81486781 podStartE2EDuration="3.81486781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:58:53.813956153 +0000 UTC m=+5.651300899" watchObservedRunningTime="2026-07-01 16:58:53.81486781 +0000 UTC m=+5.652212565" Jul 01 16:58:54.213318 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:54.213277 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:54.213533 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.213502 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:54.213610 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.213568 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:58.213549832 +0000 UTC m=+10.050894576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:54.314403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:54.314479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.314648 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.314717 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:58.314696765 +0000 UTC m=+10.152041515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.314862 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.314884 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.314900 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:54.315296 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.314941 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:58:58.314928982 +0000 UTC m=+10.152273717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:54.647444 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:54.646874 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:54.647444 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.647040 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:58:54.647444 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:54.647090 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:54.647444 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:54.647275 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:58:55.646481 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:55.646436 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:55.647040 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:55.646603 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:58:56.645961 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:56.645674 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:56.645961 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:56.645832 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:58:56.646204 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:56.646067 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:56.646204 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:56.646167 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:58:57.646404 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:57.646183 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:57.646404 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:57.646318 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:58:58.247798 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:58.247624 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:58.247798 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.247795 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:58.248036 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.247864 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:06.247845738 +0000 UTC m=+18.085190480 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:58.348187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:58.348274 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.348415 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.348434 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.348447 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.348502 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:06.348484701 +0000 UTC m=+18.185829442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.348724 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:58.348823 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.348794 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:06.348776694 +0000 UTC m=+18.186121437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:58:58.645863 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:58.645769 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:58:58.646922 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.646838 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:58:58.646922 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:58.646891 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:58:58.647348 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:58.647031 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:58:59.646273 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:58:59.645756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:58:59.646273 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:58:59.645904 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:00.645988 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:00.645948 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:00.646474 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:00.646092 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:00.646550 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:00.646510 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:00.646611 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:00.646594 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:01.646007 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:01.645975 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:01.646492 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:01.646089 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:02.645324 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:02.645287 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:02.645515 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:02.645420 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:02.645515 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:02.645480 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:02.645629 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:02.645585 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:03.646274 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:03.646246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:03.646740 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:03.646360 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:04.645783 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:04.645743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:04.645783 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:04.645781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:04.646017 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:04.645877 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:04.646076 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:04.646006 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:05.645860 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:05.645821 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:05.646345 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:05.645957 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:06.313804 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:06.313769 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:06.313976 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.313936 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:59:06.314053 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.314013 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:22.313991485 +0000 UTC m=+34.151336229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:59:06.414769 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:06.414737 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:06.414949 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:06.414804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:06.414949 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.414900 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:59:06.414949 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.414908 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:59:06.414949 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.414928 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:59:06.414949 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.414941 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:59:06.415160 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.414989 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:22.414965779 +0000 UTC m=+34.252310522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:59:06.415160 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.415012 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:22.415001739 +0000 UTC m=+34.252346475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:59:06.645993 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:06.645918 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:06.646375 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.646064 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:06.646375 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:06.646120 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:06.646375 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:06.646214 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:07.645563 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:07.645527 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:07.645770 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:07.645729 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:08.649495 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:08.647623 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:08.649495 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:08.648319 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:08.649495 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:08.648443 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:08.649495 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:08.648892 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:09.645459 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:09.645419 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:09.645642 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:09.645553 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:10.646294 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:10.646220 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:10.646786 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:10.646360 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:10.646786 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:10.646424 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:10.646786 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:10.646553 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:11.645928 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.645628 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:11.646077 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:11.646011 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:11.836720 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.836668 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-djk5c" event={"ID":"5b3a1960-c420-477f-97d3-407d0ed132e3","Type":"ContainerStarted","Data":"f0c5903f86025ca8a236cd7067ce7965fde3b260426fb1f4112c7d0323f61837"} Jul 01 16:59:11.838444 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.838415 2572 generic.go:356] "Generic (PLEG): container finished" podID="043d0318-2447-4ddd-8c21-2a4a4256706d" containerID="1d2d10d7eb68e3dfa9fb1bd85daefe5b977854e5fff53b0ea88a38377e5607ca" exitCode=0 Jul 01 16:59:11.838566 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.838503 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerDied","Data":"1d2d10d7eb68e3dfa9fb1bd85daefe5b977854e5fff53b0ea88a38377e5607ca"} Jul 01 16:59:11.840234 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.840206 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-75f85" event={"ID":"e89d2d88-82af-497b-8b9a-12d3506dd7a7","Type":"ContainerStarted","Data":"f5101082e8b1861c3919d64757673d7abd23acba9c00fc314d234186ebece9bd"} Jul 01 16:59:11.841975 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.841953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nq7gd" event={"ID":"0151a307-6783-4944-af20-6a5161ab3c01","Type":"ContainerStarted","Data":"27e3197b296bbf84ab905ae0483d980d737d07fd0839f8343c41a40ef7003613"} Jul 01 16:59:11.843705 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.843659 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" event={"ID":"a5c55acf-c0e6-49b8-834b-6f5be9c3182f","Type":"ContainerStarted","Data":"4cd0b577d19b82a926cbd2d1fd9c96d24b782a192a3c6b4f59481c33a272a134"} Jul 01 16:59:11.845386 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.845366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" event={"ID":"4e1b704a-e43e-4559-8382-aa1011ea804c","Type":"ContainerStarted","Data":"1ad4423384c25f8773d0ca78ee978bb089fc95e33c8309174f7eb2a8c1a662a3"} Jul 01 16:59:11.848366 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.848349 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 16:59:11.848795 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.848773 2572 generic.go:356] "Generic (PLEG): container finished" podID="b490022b-e429-4918-b569-714174b00688" containerID="04390ad3573ebdbb5e29c8b865bd9e0e3872c6e0bfbc5699c1b3e9a048af0f7e" exitCode=1 Jul 01 16:59:11.848895 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.848837 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"d3bd53aac1ed3800e95a7b1f7510c99e2ffbec03e0eea9fff46ddd17fd9e9d1e"} Jul 01 16:59:11.848951 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.848893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"59e8b18edad236184ad340d6dc4fc6cdf989c39e827933e7707020a0e0bc7f1e"} Jul 01 16:59:11.848951 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.848936 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"6da797d7c1ea8de45070465e0dcf6227ed2a107f4c2685ed8a98e8209e2f2346"} Jul 01 16:59:11.849060 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.848999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"ab0315726c83f313976241d4ecef3e80ea45f63acc0bae00312ea7e7aebd0c70"} Jul 01 16:59:11.849060 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.849047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerDied","Data":"04390ad3573ebdbb5e29c8b865bd9e0e3872c6e0bfbc5699c1b3e9a048af0f7e"} Jul 01 16:59:11.849158 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.849095 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"9f23858455b6ea6e43f66efda5efcbf71adcebbe1aaae7f6617ef2f41f155ff6"} Jul 01 16:59:11.850483 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.850458 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r7jmp" event={"ID":"f0a2467a-6f91-490e-8f89-5d7d0b52dc05","Type":"ContainerStarted","Data":"9a6fe399e64b3a08cf174df80ebb8ba0d19763a957b69af229e2ac662c372d6c"} Jul 01 16:59:11.918779 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.918737 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-djk5c" podStartSLOduration=7.571647618 podStartE2EDuration="22.918722489s" totalImagesPullingTime="15.347074871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:11.870115642 +0000 UTC m=+23.707460392" watchObservedRunningTime="2026-07-01 16:59:11.918722489 +0000 UTC m=+23.756067239" Jul 01 16:59:11.954977 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.954933 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nq7gd" podStartSLOduration=3.9257641469999998 podStartE2EDuration="22.954919113s" totalImagesPullingTime="19.029154966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:11.919411961 +0000 UTC m=+23.756756712" watchObservedRunningTime="2026-07-01 16:59:11.954919113 +0000 UTC m=+23.792263933" Jul 01 16:59:11.955219 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.955185 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-75f85" podStartSLOduration=3.93279359 podStartE2EDuration="22.95516955s" totalImagesPullingTime="19.02237596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:11.954778387 +0000 UTC m=+23.792123137" watchObservedRunningTime="2026-07-01 16:59:11.95516955 +0000 UTC m=+23.792514297" Jul 01 16:59:11.990094 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:11.990038 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9zmwb" podStartSLOduration=3.936162576 podStartE2EDuration="22.990006381s" totalImagesPullingTime="19.053843805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:11.989269328 +0000 UTC m=+23.826614080" watchObservedRunningTime="2026-07-01 16:59:11.990006381 +0000 UTC m=+23.827351137" Jul 01 16:59:12.129505 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.129457 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r7jmp" podStartSLOduration=4.030809309 podStartE2EDuration="23.129441559s" totalImagesPullingTime="19.09863225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:12.123145814 +0000 UTC m=+23.960490564" watchObservedRunningTime="2026-07-01 16:59:12.129441559 +0000 UTC m=+23.966786309" Jul 01 16:59:12.533785 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.533762 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:59:12.623048 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.623008 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:59:12.646480 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.646219 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:12.646480 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.646284 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:12.646480 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.646262 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:59:12.623029254Z","UUID":"06a02465-872a-4c8d-9bcb-0ac40918e3a5","Handler":null,"Name":"","Endpoint":""} Jul 01 16:59:12.646480 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:12.646414 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:12.646824 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:12.646488 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:12.649579 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.649560 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:59:12.649741 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.649606 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:59:12.855116 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.855071 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" event={"ID":"4e1b704a-e43e-4559-8382-aa1011ea804c","Type":"ContainerStarted","Data":"c44c0cfa088aab69ac62ab3336895b5034dc6c3bbc211ce237693332fe4e1633"} Jul 01 16:59:12.856675 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:12.856647 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m22mr" event={"ID":"24ed4236-c948-4116-a87d-e1e66a32e922","Type":"ContainerStarted","Data":"bcfebcd6084ec714f6cb9e882918bae9b3507c03d22ba67c5e0af3b24408ebc6"} Jul 01 16:59:13.646177 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:13.645809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:13.646177 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:13.645925 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:13.863825 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:13.863798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 16:59:13.864292 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:13.864253 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"4e7e8fa3a64e3a807c180c83ec93e3980a47fd123258c9511bc092f38dd55f6a"} Jul 01 16:59:13.927139 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:13.927057 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:59:13.927700 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:13.927667 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:59:13.949623 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:13.949561 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m22mr" podStartSLOduration=5.914074409 podStartE2EDuration="24.94954341s" totalImagesPullingTime="19.035469001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:12.882293917 +0000 UTC m=+24.719638667" watchObservedRunningTime="2026-07-01 16:59:13.94954341 +0000 UTC m=+25.786888163" Jul 01 16:59:14.645989 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:14.645956 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:14.646179 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:14.645956 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:14.646179 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:14.646079 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:14.646179 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:14.646152 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:14.869340 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:14.869300 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" event={"ID":"4e1b704a-e43e-4559-8382-aa1011ea804c","Type":"ContainerStarted","Data":"c7cbfeca9c1314eeb95fb8cc38c98c68a5ad07b19e13a08223a47164b71b4466"} Jul 01 16:59:14.870424 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:14.870397 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-djk5c" Jul 01 16:59:14.902146 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:14.902045 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m95cv" podStartSLOduration=4.162840786 podStartE2EDuration="25.902024004s" totalImagesPullingTime="21.739183218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:14.900529162 +0000 UTC m=+26.737873934" watchObservedRunningTime="2026-07-01 16:59:14.902024004 +0000 UTC m=+26.739368756" Jul 01 16:59:15.645369 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:15.645339 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:15.645528 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:15.645469 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:16.648887 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.648659 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:16.649531 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.648727 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:16.649531 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:16.648925 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:16.649531 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:16.648984 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:16.876965 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.876935 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 16:59:16.877350 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.877325 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"9f540f93a08f94a421aaf18f328431409ec85cd8b4e05e91a2aeff23c4456e3d"} Jul 01 16:59:16.877573 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.877543 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:59:16.877786 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.877770 2572 scope.go:117] "RemoveContainer" containerID="04390ad3573ebdbb5e29c8b865bd9e0e3872c6e0bfbc5699c1b3e9a048af0f7e" Jul 01 16:59:16.882021 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.881986 2572 generic.go:356] "Generic (PLEG): container finished" podID="043d0318-2447-4ddd-8c21-2a4a4256706d" containerID="6693031cd8980abececa63639dbd25eb89c0c2d4c082e3080d84986c4e03a5a2" exitCode=0 Jul 01 16:59:16.882123 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.882078 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerDied","Data":"6693031cd8980abececa63639dbd25eb89c0c2d4c082e3080d84986c4e03a5a2"} Jul 01 16:59:16.894951 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:16.894933 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:59:17.646159 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:17.646123 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:17.646444 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:17.646252 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:17.888768 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:17.888742 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 16:59:17.889182 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:17.889155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" event={"ID":"b490022b-e429-4918-b569-714174b00688","Type":"ContainerStarted","Data":"e374c5aab884ad43532de9a4dcca586629bea08612201a05e38e1200e057acfc"} Jul 01 16:59:17.889384 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:17.889359 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:59:17.889590 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:17.889567 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:59:17.907126 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:17.907069 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:59:18.021843 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.021633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" podStartSLOduration=9.924289806 podStartE2EDuration="29.021617833s" totalImagesPullingTime="19.097328027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:17.960839562 +0000 UTC m=+29.798184328" watchObservedRunningTime="2026-07-01 16:59:18.021617833 +0000 UTC m=+29.858962584" Jul 01 16:59:18.646354 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.646317 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:18.646661 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:18.646437 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:18.646661 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.646533 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:18.646661 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:18.646625 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:18.740524 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.740496 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxl5v"] Jul 01 16:59:18.740726 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.740610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:18.740792 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:18.740746 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:18.741424 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.741393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ts2zp"] Jul 01 16:59:18.741882 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.741862 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-66nq9"] Jul 01 16:59:18.893453 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.893421 2572 generic.go:356] "Generic (PLEG): container finished" podID="043d0318-2447-4ddd-8c21-2a4a4256706d" containerID="848b2ba69d4d245a14cd6a517075fcf9487a41bbf756eb807e5f940ee0915539" exitCode=0 Jul 01 16:59:18.893931 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.893495 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerDied","Data":"848b2ba69d4d245a14cd6a517075fcf9487a41bbf756eb807e5f940ee0915539"} Jul 01 16:59:18.893931 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.893544 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:18.893931 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:18.893578 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:18.893931 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:18.893719 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:18.894817 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:18.894198 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:20.648668 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:20.648626 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:20.648668 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:20.648663 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:20.649139 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:20.648759 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:20.649139 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:20.648810 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:20.649139 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:20.648907 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:20.649139 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:20.648994 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:20.900823 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:20.900735 2572 generic.go:356] "Generic (PLEG): container finished" podID="043d0318-2447-4ddd-8c21-2a4a4256706d" containerID="abff2ac6c5a4c414a5d4283b67d24b9517605cc3777db395db43475c738896b1" exitCode=0 Jul 01 16:59:20.900823 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:20.900778 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerDied","Data":"abff2ac6c5a4c414a5d4283b67d24b9517605cc3777db395db43475c738896b1"} Jul 01 16:59:22.335118 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:22.334893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:22.335599 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.335035 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:59:22.335599 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.335188 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:54.335169119 +0000 UTC m=+66.172513862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:59:22.435632 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:22.435596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:22.435806 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:22.435670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:22.435806 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.435754 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:59:22.435806 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.435783 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:59:22.435806 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.435796 2572 projected.go:196] Error preparing data for projected volume kube-api-access-dks8v for pod openshift-network-diagnostics/network-check-target-ts2zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:59:22.436081 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.435823 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:59:22.436081 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.435859 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v podName:23565b87-1958-4f42-8a4c-8f5feae959b4 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:54.435840167 +0000 UTC m=+66.273184900 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dks8v" (UniqueName: "kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v") pod "network-check-target-ts2zp" (UID: "23565b87-1958-4f42-8a4c-8f5feae959b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:59:22.436081 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.435884 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret podName:dfa80559-5b81-4609-bf42-c0dfcbbb2624 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:54.435866105 +0000 UTC m=+66.273210851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret") pod "global-pull-secret-syncer-jxl5v" (UID: "dfa80559-5b81-4609-bf42-c0dfcbbb2624") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:59:22.645817 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:22.645744 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:22.645817 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:22.645778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:22.646025 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.645907 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-66nq9" podUID="68d0cc90-fdbf-4842-a2f1-963f5d70d845" Jul 01 16:59:22.646025 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:22.645919 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:22.646025 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.646015 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts2zp" podUID="23565b87-1958-4f42-8a4c-8f5feae959b4" Jul 01 16:59:22.646165 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:22.646107 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jxl5v" podUID="dfa80559-5b81-4609-bf42-c0dfcbbb2624" Jul 01 16:59:23.969970 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:23.969900 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-133.ec2.internal" event="NodeReady" Jul 01 16:59:23.970336 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:23.970041 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:59:24.054238 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.054205 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b4555c9b9-wlmt4"] Jul 01 16:59:24.056398 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.056378 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.069073 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.069054 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:59:24.071032 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.071010 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:59:24.072361 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.072341 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5lvm2\"" Jul 01 16:59:24.072528 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.072511 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:59:24.088548 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.088527 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b4555c9b9-wlmt4"] Jul 01 16:59:24.089517 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.089495 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zlz2t"] Jul 01 16:59:24.091477 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.091458 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.095124 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.095103 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:59:24.095467 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.095441 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:59:24.095718 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.095699 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96p59\"" Jul 01 16:59:24.099171 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.099149 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:59:24.116616 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.116592 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f6mwq"] Jul 01 16:59:24.118417 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.118398 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.121892 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.121873 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:59:24.122738 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.122720 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7lmd6\"" Jul 01 16:59:24.122848 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.122743 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:59:24.122848 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.122751 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:59:24.132355 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.132330 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zlz2t"] Jul 01 16:59:24.143879 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.143856 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f6mwq"] Jul 01 16:59:24.149758 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.149738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a204b28c-0c5a-4711-a78b-3da18dbe9536-ca-trust-extracted\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.149869 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.149780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.149869 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.149809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-trusted-ca\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.149982 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.149909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-bound-sa-token\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.149982 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.149945 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4j47\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-kube-api-access-x4j47\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.150080 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.149983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-image-registry-private-configuration\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.150080 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.150052 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-certificates\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.150175 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.150095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-installation-pull-secrets\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.250810 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.250783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.250810 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.250813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-trusted-ca\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251029 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.250948 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:24.251029 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.250952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-bound-sa-token\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251029 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.250969 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:24.251029 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4j47\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-kube-api-access-x4j47\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251205 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdpnf\" (UniqueName: \"kubernetes.io/projected/f13ea006-473a-4736-94b6-3e7c7f780e29-kube-api-access-rdpnf\") pod \"ingress-canary-f6mwq\" (UID: \"f13ea006-473a-4736-94b6-3e7c7f780e29\") " pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.251205 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.251078 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:24.751056105 +0000 UTC m=+36.588400850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:24.251205 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-image-registry-private-configuration\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251205 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251148 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.251205 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251172 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-tmp-dir\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.251446 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251227 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-certificates\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251446 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251261 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13ea006-473a-4736-94b6-3e7c7f780e29-cert\") pod \"ingress-canary-f6mwq\" (UID: \"f13ea006-473a-4736-94b6-3e7c7f780e29\") " pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.251446 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-config-volume\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.251446 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf4rj\" (UniqueName: \"kubernetes.io/projected/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-kube-api-access-xf4rj\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.251446 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-installation-pull-secrets\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251446 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a204b28c-0c5a-4711-a78b-3da18dbe9536-ca-trust-extracted\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251820 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251712 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-trusted-ca\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251820 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a204b28c-0c5a-4711-a78b-3da18dbe9536-ca-trust-extracted\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.251920 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.251839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-certificates\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.255588 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.255551 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-image-registry-private-configuration\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.255588 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.255557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-installation-pull-secrets\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.270773 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.270743 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4j47\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-kube-api-access-x4j47\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.271514 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.271487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-bound-sa-token\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.351811 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.351774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdpnf\" (UniqueName: \"kubernetes.io/projected/f13ea006-473a-4736-94b6-3e7c7f780e29-kube-api-access-rdpnf\") pod \"ingress-canary-f6mwq\" (UID: \"f13ea006-473a-4736-94b6-3e7c7f780e29\") " pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.351987 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.351832 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.351987 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.351868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-tmp-dir\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.352109 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.352001 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:24.352109 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.352044 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13ea006-473a-4736-94b6-3e7c7f780e29-cert\") pod \"ingress-canary-f6mwq\" (UID: \"f13ea006-473a-4736-94b6-3e7c7f780e29\") " pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.352109 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.352075 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:24.852052661 +0000 UTC m=+36.689397409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:24.352265 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.352121 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-config-volume\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.352265 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.352150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf4rj\" (UniqueName: \"kubernetes.io/projected/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-kube-api-access-xf4rj\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.352265 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.352219 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-tmp-dir\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.352713 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.352664 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-config-volume\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.354700 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.354669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f13ea006-473a-4736-94b6-3e7c7f780e29-cert\") pod \"ingress-canary-f6mwq\" (UID: \"f13ea006-473a-4736-94b6-3e7c7f780e29\") " pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.371331 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.371309 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdpnf\" (UniqueName: \"kubernetes.io/projected/f13ea006-473a-4736-94b6-3e7c7f780e29-kube-api-access-rdpnf\") pod \"ingress-canary-f6mwq\" (UID: \"f13ea006-473a-4736-94b6-3e7c7f780e29\") " pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.381487 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.381468 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf4rj\" (UniqueName: \"kubernetes.io/projected/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-kube-api-access-xf4rj\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.429521 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.429487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f6mwq" Jul 01 16:59:24.649736 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.649647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:24.649736 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.649701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:24.649736 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.649701 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:24.653501 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.653473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rp97d\"" Jul 01 16:59:24.655581 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.655556 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:59:24.655741 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.655596 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nt4t9\"" Jul 01 16:59:24.655945 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.655929 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:59:24.656292 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.656275 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:59:24.656862 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.656841 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:59:24.754642 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.754605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:24.754855 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.754807 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:24.754855 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.754831 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:24.754964 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.754903 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:25.754880329 +0000 UTC m=+37.592225077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:24.855417 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:24.855381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:24.855607 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.855546 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:24.855675 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:24.855619 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:25.855597435 +0000 UTC m=+37.692942177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:25.105991 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:25.105837 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f6mwq"] Jul 01 16:59:25.108978 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:59:25.108956 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf13ea006_473a_4736_94b6_3e7c7f780e29.slice/crio-fbef8305c75cd88360da3298179ec345ffbbf8e469a601ac63a45b4147417bc2 WatchSource:0}: Error finding container fbef8305c75cd88360da3298179ec345ffbbf8e469a601ac63a45b4147417bc2: Status 404 returned error can't find the container with id fbef8305c75cd88360da3298179ec345ffbbf8e469a601ac63a45b4147417bc2 Jul 01 16:59:25.765194 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:25.765165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:25.765390 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:25.765338 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:25.765390 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:25.765355 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:25.765517 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:25.765411 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:27.765394205 +0000 UTC m=+39.602738934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:25.866043 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:25.866011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:25.866197 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:25.866124 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:25.866197 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:25.866195 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:27.866177622 +0000 UTC m=+39.703522351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:25.916755 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:25.916721 2572 generic.go:356] "Generic (PLEG): container finished" podID="043d0318-2447-4ddd-8c21-2a4a4256706d" containerID="9d94d8bf9f7afbb1eee1d13cd1e4ae14c7324949d001190dfbb157cb2b7183d9" exitCode=0 Jul 01 16:59:25.916924 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:25.916809 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerDied","Data":"9d94d8bf9f7afbb1eee1d13cd1e4ae14c7324949d001190dfbb157cb2b7183d9"} Jul 01 16:59:25.917997 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:25.917978 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f6mwq" event={"ID":"f13ea006-473a-4736-94b6-3e7c7f780e29","Type":"ContainerStarted","Data":"fbef8305c75cd88360da3298179ec345ffbbf8e469a601ac63a45b4147417bc2"} Jul 01 16:59:26.923921 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:26.923882 2572 generic.go:356] "Generic (PLEG): container finished" podID="043d0318-2447-4ddd-8c21-2a4a4256706d" containerID="aab62dfe4799cf10c90c2f11133a23b73be95d7e298db39d19c860a304fc278c" exitCode=0 Jul 01 16:59:26.923921 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:26.923925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerDied","Data":"aab62dfe4799cf10c90c2f11133a23b73be95d7e298db39d19c860a304fc278c"} Jul 01 16:59:27.782281 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:27.782250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:27.782426 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:27.782402 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:27.782426 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:27.782418 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:27.782510 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:27.782470 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:31.782455956 +0000 UTC m=+43.619800685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:27.883130 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:27.883100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:27.883277 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:27.883259 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:27.883334 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:27.883325 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:31.883309384 +0000 UTC m=+43.720654113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:27.927469 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:27.927441 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f6mwq" event={"ID":"f13ea006-473a-4736-94b6-3e7c7f780e29","Type":"ContainerStarted","Data":"f0c602d88287c0403445da17458ce970676ef9a098da494ce1a85bb804edd570"} Jul 01 16:59:27.930625 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:27.930584 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" event={"ID":"043d0318-2447-4ddd-8c21-2a4a4256706d","Type":"ContainerStarted","Data":"5789e4c6145cc4caf35de37c598000a754fe08bc97d1326dcf30bbb2fdcf3559"} Jul 01 16:59:27.973279 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:27.973241 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f6mwq" podStartSLOduration=1.812848726 podStartE2EDuration="3.973226188s" totalImagesPullingTime="2.160377462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:27.946361713 +0000 UTC m=+39.783706464" watchObservedRunningTime="2026-07-01 16:59:27.973226188 +0000 UTC m=+39.810570939" Jul 01 16:59:27.973626 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:27.973586 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xpsb2" podStartSLOduration=9.514634793 podStartE2EDuration="38.973575343s" totalImagesPullingTime="29.45894055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:27.970529435 +0000 UTC m=+39.807874185" watchObservedRunningTime="2026-07-01 16:59:27.973575343 +0000 UTC m=+39.810920098" Jul 01 16:59:28.201263 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:28.201224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:28.313613 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:28.313577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:28.627653 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:28.627614 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:28.762782 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:28.762743 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:29.633106 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:29.633074 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:29.874463 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:29.874426 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:31.022199 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:31.022162 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:31.123585 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:31.123556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:31.200298 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:31.200267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:31.633702 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:31.633651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:31.807331 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:31.807295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:31.807519 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:31.807439 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:31.807519 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:31.807461 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:31.807519 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:31.807518 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:39.807503231 +0000 UTC m=+51.644847960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:31.907960 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:31.907892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:31.908057 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:31.908012 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:31.908104 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:31.908062 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:39.908050387 +0000 UTC m=+51.745395115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:37.759847 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:37.759809 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:37.834260 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:37.834224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:39.869743 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:39.869708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:39.870141 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:39.869837 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:39.870141 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:39.869856 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:39.870141 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:39.869909 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:55.869894646 +0000 UTC m=+67.707239378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:39.970804 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:39.970773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:39.970955 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:39.970917 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:39.970992 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:39.970980 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 16:59:55.970963376 +0000 UTC m=+67.808308116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:45.792591 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.792551 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7"] Jul 01 16:59:45.794577 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.794556 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:45.855827 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.855799 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7"] Jul 01 16:59:45.868645 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.868627 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 16:59:45.874492 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.874478 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-csl2d\"" Jul 01 16:59:45.875013 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.874991 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 16:59:45.911130 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.911109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416ae2ab-ce08-4f58-a386-de02775bf210-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:45.911224 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:45.911143 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:46.012161 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.012132 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416ae2ab-ce08-4f58-a386-de02775bf210-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:46.012161 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.012163 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:46.012331 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:46.012257 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:59:46.012365 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:46.012326 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert podName:416ae2ab-ce08-4f58-a386-de02775bf210 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:46.512304377 +0000 UTC m=+58.349649109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-zbcl7" (UID: "416ae2ab-ce08-4f58-a386-de02775bf210") : secret "networking-console-plugin-cert" not found Jul 01 16:59:46.012833 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.012816 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/416ae2ab-ce08-4f58-a386-de02775bf210-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:46.018703 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.018674 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-vrs8b"] Jul 01 16:59:46.020280 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.020266 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" Jul 01 16:59:46.029445 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:46.029416 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"network-check-source-56499946bc-vrs8b\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="f9878225-f12d-48ff-9378-93732fc614ef" pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" Jul 01 16:59:46.029538 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:46.029490 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"network-diagnostics-dockercfg-zzj4h\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zzj4h\"" type="*v1.Secret" Jul 01 16:59:46.080303 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.080250 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-vrs8b"] Jul 01 16:59:46.112993 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.112969 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8bv\" (UniqueName: \"kubernetes.io/projected/f9878225-f12d-48ff-9378-93732fc614ef-kube-api-access-pt8bv\") pod \"network-check-source-56499946bc-vrs8b\" (UID: \"f9878225-f12d-48ff-9378-93732fc614ef\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" Jul 01 16:59:46.141308 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.141287 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fssvm"] Jul 01 16:59:46.143003 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.142990 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.145860 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.145841 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 16:59:46.147173 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.147156 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 16:59:46.148466 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.148445 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:59:46.149341 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.149323 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:59:46.153877 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.153862 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q9z79\"" Jul 01 16:59:46.168591 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.168575 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 16:59:46.203882 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.203860 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fssvm"] Jul 01 16:59:46.214100 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214079 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-snapshots\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.214197 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.214197 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-serving-cert\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.214277 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-service-ca-bundle\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.214277 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8bv\" (UniqueName: \"kubernetes.io/projected/f9878225-f12d-48ff-9378-93732fc614ef-kube-api-access-pt8bv\") pod \"network-check-source-56499946bc-vrs8b\" (UID: \"f9878225-f12d-48ff-9378-93732fc614ef\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" Jul 01 16:59:46.214277 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214274 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-tmp\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.214415 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.214308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzd7\" (UniqueName: \"kubernetes.io/projected/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-kube-api-access-nxzd7\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.236161 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.236131 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8bv\" (UniqueName: \"kubernetes.io/projected/f9878225-f12d-48ff-9378-93732fc614ef-kube-api-access-pt8bv\") pod \"network-check-source-56499946bc-vrs8b\" (UID: \"f9878225-f12d-48ff-9378-93732fc614ef\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" Jul 01 16:59:46.315321 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-snapshots\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.315471 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315335 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.315471 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315357 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-serving-cert\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.315471 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-service-ca-bundle\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.315471 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-tmp\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.315623 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzd7\" (UniqueName: \"kubernetes.io/projected/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-kube-api-access-nxzd7\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.315989 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.315970 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-tmp\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.316076 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.316049 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-snapshots\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.316192 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.316175 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-service-ca-bundle\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.316228 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.316213 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.317653 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.317636 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-serving-cert\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.329320 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.329303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzd7\" (UniqueName: \"kubernetes.io/projected/9e66216d-d0e1-4e9e-ba95-9019e44a67d9-kube-api-access-nxzd7\") pod \"insights-operator-5f67b55555-fssvm\" (UID: \"9e66216d-d0e1-4e9e-ba95-9019e44a67d9\") " pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.451795 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.451720 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fssvm" Jul 01 16:59:46.465562 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.465530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:46.517554 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.517529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:46.517708 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:46.517674 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:59:46.517773 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:46.517764 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert podName:416ae2ab-ce08-4f58-a386-de02775bf210 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:47.51774751 +0000 UTC m=+59.355092242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-zbcl7" (UID: "416ae2ab-ce08-4f58-a386-de02775bf210") : secret "networking-console-plugin-cert" not found Jul 01 16:59:46.583076 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.583043 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fssvm"] Jul 01 16:59:46.586553 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:59:46.586526 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e66216d_d0e1_4e9e_ba95_9019e44a67d9.slice/crio-1d1679e52be466b0c07b2c83cdb0760b166b41719325380def890d6cc7e5a72d WatchSource:0}: Error finding container 1d1679e52be466b0c07b2c83cdb0760b166b41719325380def890d6cc7e5a72d: Status 404 returned error can't find the container with id 1d1679e52be466b0c07b2c83cdb0760b166b41719325380def890d6cc7e5a72d Jul 01 16:59:46.609031 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.609002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:46.973971 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:46.973942 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fssvm" event={"ID":"9e66216d-d0e1-4e9e-ba95-9019e44a67d9","Type":"ContainerStarted","Data":"1d1679e52be466b0c07b2c83cdb0760b166b41719325380def890d6cc7e5a72d"} Jul 01 16:59:47.328875 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:47.328841 2572 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 01 16:59:47.329061 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:47.328916 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" Jul 01 16:59:47.371890 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:47.371858 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zzj4h\"" Jul 01 16:59:47.469389 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:47.469359 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-vrs8b"] Jul 01 16:59:47.475000 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:59:47.474966 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9878225_f12d_48ff_9378_93732fc614ef.slice/crio-96197727ac60148e81363dfe42382034d68081eda888e8cc81c7ff6f8192e2bb WatchSource:0}: Error finding container 96197727ac60148e81363dfe42382034d68081eda888e8cc81c7ff6f8192e2bb: Status 404 returned error can't find the container with id 96197727ac60148e81363dfe42382034d68081eda888e8cc81c7ff6f8192e2bb Jul 01 16:59:47.524608 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:47.524578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:47.524782 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:47.524763 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:59:47.524864 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:47.524851 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert podName:416ae2ab-ce08-4f58-a386-de02775bf210 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:49.524826636 +0000 UTC m=+61.362171382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-zbcl7" (UID: "416ae2ab-ce08-4f58-a386-de02775bf210") : secret "networking-console-plugin-cert" not found Jul 01 16:59:47.978111 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:47.978080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" event={"ID":"f9878225-f12d-48ff-9378-93732fc614ef","Type":"ContainerStarted","Data":"96197727ac60148e81363dfe42382034d68081eda888e8cc81c7ff6f8192e2bb"} Jul 01 16:59:48.078856 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:48.078820 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:48.173977 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:48.173940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:48.982437 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:48.982398 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fssvm" event={"ID":"9e66216d-d0e1-4e9e-ba95-9019e44a67d9","Type":"ContainerStarted","Data":"037447b068e5a272e6a65024f477b90a7ab0c76da2c8c2735a280e2103ae491d"} Jul 01 16:59:49.005621 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.005570 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-fssvm" podStartSLOduration=0.819661163 podStartE2EDuration="3.005556333s" totalImagesPullingTime="2.18589517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:49.004880983 +0000 UTC m=+60.842225754" watchObservedRunningTime="2026-07-01 16:59:49.005556333 +0000 UTC m=+60.842901083" Jul 01 16:59:49.545037 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.544996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:49.545217 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:49.545171 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:59:49.545287 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:49.545249 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert podName:416ae2ab-ce08-4f58-a386-de02775bf210 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:53.545232317 +0000 UTC m=+65.382577046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-zbcl7" (UID: "416ae2ab-ce08-4f58-a386-de02775bf210") : secret "networking-console-plugin-cert" not found Jul 01 16:59:49.549733 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.549605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:49.656788 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.656735 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:49.858589 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.858510 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8ww9j"] Jul 01 16:59:49.893237 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.892957 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8ww9j"] Jul 01 16:59:49.893237 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.893101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:49.896875 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.896848 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:59:49.897561 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.897535 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:59:49.897730 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.897547 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9w45h\"" Jul 01 16:59:49.918233 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.918208 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdwc" Jul 01 16:59:49.949699 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.949652 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-data-volume\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:49.949853 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.949775 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-crio-socket\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:49.949853 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.949841 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkhk\" (UniqueName: \"kubernetes.io/projected/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-api-access-bjkhk\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:49.949971 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.949869 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:49.949971 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.949933 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:49.965114 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:49.965082 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:50.051065 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.051159 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051199 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-data-volume\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.051230 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:50.551211013 +0000 UTC m=+62.388555747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : configmap "kube-rbac-proxy" not found Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051324 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-crio-socket\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkhk\" (UniqueName: \"kubernetes.io/projected/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-api-access-bjkhk\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051511 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-data-volume\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.051560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-crio-socket\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.051808 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.051759 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:50.052523 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.051822 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:50.55180225 +0000 UTC m=+62.389146996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:50.076182 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.076157 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkhk\" (UniqueName: \"kubernetes.io/projected/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-api-access-bjkhk\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.187625 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.187545 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:50.329905 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.329864 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:50.482044 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.481902 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:50.555803 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.555764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.555977 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.555827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:50.555977 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.555896 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:50.555977 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.555959 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:51.55594444 +0000 UTC m=+63.393289174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : configmap "kube-rbac-proxy" not found Jul 01 16:59:50.556170 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.556008 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:50.556170 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:50.556069 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:51.556052876 +0000 UTC m=+63.393397606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:50.902750 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:50.902656 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:51.056017 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.055981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:51.564270 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.564233 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:51.564451 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.564283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:51.564451 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:51.564377 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:51.564451 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:51.564374 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:51.564451 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:51.564427 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:53.564415156 +0000 UTC m=+65.401759885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:51.564592 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:51.564460 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:53.564441437 +0000 UTC m=+65.401786175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : configmap "kube-rbac-proxy" not found Jul 01 16:59:51.720949 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.720914 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:51.840262 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.840176 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:51.849912 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.849889 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nq7gd_0151a307-6783-4944-af20-6a5161ab3c01/dns-node-resolver/0.log" Jul 01 16:59:51.882240 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.882207 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5"] Jul 01 16:59:51.887226 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.887202 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:51.890222 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.890198 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 01 16:59:51.890335 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.890249 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ct8cv\"" Jul 01 16:59:51.891181 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.891152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 01 16:59:51.891275 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.891223 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 01 16:59:51.891275 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.891248 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 01 16:59:51.898845 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.898825 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5"] Jul 01 16:59:51.968167 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.968130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/faada1aa-9760-4e60-ac74-a4f4630c751b-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:51.968344 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.968191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/faada1aa-9760-4e60-ac74-a4f4630c751b-signing-key\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:51.968344 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.968245 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hrxj\" (UniqueName: \"kubernetes.io/projected/faada1aa-9760-4e60-ac74-a4f4630c751b-kube-api-access-7hrxj\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:51.990777 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:51.990740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" event={"ID":"f9878225-f12d-48ff-9378-93732fc614ef","Type":"ContainerStarted","Data":"6d67eb7664f82911a73a5386763e267e73ddf262ea0dd5968d55184a1f8f451b"} Jul 01 16:59:52.005838 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.005804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:52.069432 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.069395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/faada1aa-9760-4e60-ac74-a4f4630c751b-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.069891 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.069538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/faada1aa-9760-4e60-ac74-a4f4630c751b-signing-key\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.069891 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.069576 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hrxj\" (UniqueName: \"kubernetes.io/projected/faada1aa-9760-4e60-ac74-a4f4630c751b-kube-api-access-7hrxj\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.070122 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.070104 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/faada1aa-9760-4e60-ac74-a4f4630c751b-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.072042 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.072009 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/faada1aa-9760-4e60-ac74-a4f4630c751b-signing-key\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.080967 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.080936 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hrxj\" (UniqueName: \"kubernetes.io/projected/faada1aa-9760-4e60-ac74-a4f4630c751b-kube-api-access-7hrxj\") pod \"service-ca-7bb4f4bcc7-6cvb5\" (UID: \"faada1aa-9760-4e60-ac74-a4f4630c751b\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.195914 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.195830 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" Jul 01 16:59:52.335545 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.335486 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-vrs8b" podStartSLOduration=3.645755831 podStartE2EDuration="7.335462289s" totalImagesPullingTime="3.689706458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:52.017839383 +0000 UTC m=+63.855184135" watchObservedRunningTime="2026-07-01 16:59:52.335462289 +0000 UTC m=+64.172807041" Jul 01 16:59:52.336252 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.336165 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5"] Jul 01 16:59:52.338619 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:59:52.338595 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaada1aa_9760_4e60_ac74_a4f4630c751b.slice/crio-2f182a974a61748b559561f009d3a5eee29d910acd954ccae6451abb7cc319b0 WatchSource:0}: Error finding container 2f182a974a61748b559561f009d3a5eee29d910acd954ccae6451abb7cc319b0: Status 404 returned error can't find the container with id 2f182a974a61748b559561f009d3a5eee29d910acd954ccae6451abb7cc319b0 Jul 01 16:59:52.655266 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.655239 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75f85_e89d2d88-82af-497b-8b9a-12d3506dd7a7/node-ca/0.log" Jul 01 16:59:52.995525 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:52.995488 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" event={"ID":"faada1aa-9760-4e60-ac74-a4f4630c751b","Type":"ContainerStarted","Data":"2f182a974a61748b559561f009d3a5eee29d910acd954ccae6451abb7cc319b0"} Jul 01 16:59:53.582791 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:53.582752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:53.582816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:53.582849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:53.582893 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:53.582977 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:57.582955963 +0000 UTC m=+69.420300704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : configmap "kube-rbac-proxy" not found Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:53.582989 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:53.583045 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert podName:416ae2ab-ce08-4f58-a386-de02775bf210 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:01.583029769 +0000 UTC m=+73.420374498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-zbcl7" (UID: "416ae2ab-ce08-4f58-a386-de02775bf210") : secret "networking-console-plugin-cert" not found Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:53.583046 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:53.583311 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:53.583099 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 16:59:57.583084168 +0000 UTC m=+69.420428910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:53.662042 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:53.661997 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f6mwq_f13ea006-473a-4736-94b6-3e7c7f780e29/serve-healthcheck-canary/0.log" Jul 01 16:59:53.662365 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:53.662332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:54.391100 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.391066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 16:59:54.394246 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.394227 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:59:54.402192 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:54.402176 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 16:59:54.402282 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:54.402229 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs podName:68d0cc90-fdbf-4842-a2f1-963f5d70d845 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:58.402213227 +0000 UTC m=+130.239557957 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs") pod "network-metrics-daemon-66nq9" (UID: "68d0cc90-fdbf-4842-a2f1-963f5d70d845") : secret "metrics-daemon-secret" not found Jul 01 16:59:54.492302 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.492271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:54.492425 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.492351 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:54.494922 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.494894 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dks8v\" (UniqueName: \"kubernetes.io/projected/23565b87-1958-4f42-8a4c-8f5feae959b4-kube-api-access-dks8v\") pod \"network-check-target-ts2zp\" (UID: \"23565b87-1958-4f42-8a4c-8f5feae959b4\") " pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:54.498750 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.498730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:59:54.504566 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.504544 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dfa80559-5b81-4609-bf42-c0dfcbbb2624-original-pull-secret\") pod \"global-pull-secret-syncer-jxl5v\" (UID: \"dfa80559-5b81-4609-bf42-c0dfcbbb2624\") " pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:54.667767 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.667735 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jxl5v" Jul 01 16:59:54.683539 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.683513 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nt4t9\"" Jul 01 16:59:54.683817 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.683803 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:54.821714 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.821666 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jxl5v"] Jul 01 16:59:54.824178 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:54.824150 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ts2zp"] Jul 01 16:59:54.825390 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:59:54.825368 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa80559_5b81_4609_bf42_c0dfcbbb2624.slice/crio-659c9869a661d92bc50f919803cfd89e3395f7e8f51489ae96b7d542d277a805 WatchSource:0}: Error finding container 659c9869a661d92bc50f919803cfd89e3395f7e8f51489ae96b7d542d277a805: Status 404 returned error can't find the container with id 659c9869a661d92bc50f919803cfd89e3395f7e8f51489ae96b7d542d277a805 Jul 01 16:59:54.827810 ip-10-0-139-133 kubenswrapper[2572]: W0701 16:59:54.827780 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23565b87_1958_4f42_8a4c_8f5feae959b4.slice/crio-ad16d18509a119cdb41802b71d938444620b2687bc6794e5534787157ca619d4 WatchSource:0}: Error finding container ad16d18509a119cdb41802b71d938444620b2687bc6794e5534787157ca619d4: Status 404 returned error can't find the container with id ad16d18509a119cdb41802b71d938444620b2687bc6794e5534787157ca619d4 Jul 01 16:59:55.003623 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.003460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ts2zp" event={"ID":"23565b87-1958-4f42-8a4c-8f5feae959b4","Type":"ContainerStarted","Data":"d139ec6638ca3b88cc3dabf929635d2511326ab0287e6a427425ee76a9573fab"} Jul 01 16:59:55.003623 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.003520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ts2zp" event={"ID":"23565b87-1958-4f42-8a4c-8f5feae959b4","Type":"ContainerStarted","Data":"ad16d18509a119cdb41802b71d938444620b2687bc6794e5534787157ca619d4"} Jul 01 16:59:55.003623 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.003550 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 16:59:55.005014 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.004987 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" event={"ID":"faada1aa-9760-4e60-ac74-a4f4630c751b","Type":"ContainerStarted","Data":"fa028e53b0b26069f04c8fe9cca452912d0c825eba50796aa63a2b6f84ac9c02"} Jul 01 16:59:55.006045 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.006027 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxl5v" event={"ID":"dfa80559-5b81-4609-bf42-c0dfcbbb2624","Type":"ContainerStarted","Data":"659c9869a661d92bc50f919803cfd89e3395f7e8f51489ae96b7d542d277a805"} Jul 01 16:59:55.057824 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.057777 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ts2zp" podStartSLOduration=66.057763973 podStartE2EDuration="1m6.057763973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:55.035592155 +0000 UTC m=+66.872936906" watchObservedRunningTime="2026-07-01 16:59:55.057763973 +0000 UTC m=+66.895108724" Jul 01 16:59:55.336309 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.336216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:55.693772 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.693578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:55.906341 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:55.906309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 16:59:55.906534 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:55.906431 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:59:55.906534 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:55.906444 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4555c9b9-wlmt4: secret "image-registry-tls" not found Jul 01 16:59:55.906534 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:55.906495 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls podName:a204b28c-0c5a-4711-a78b-3da18dbe9536 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:27.906481699 +0000 UTC m=+99.743826428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls") pod "image-registry-5b4555c9b9-wlmt4" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536") : secret "image-registry-tls" not found Jul 01 16:59:56.007057 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:56.007018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 16:59:56.007262 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:56.007175 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:59:56.007262 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:56.007240 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls podName:5cf44b14-3dbc-4ecc-881e-3f8253c0862f nodeName:}" failed. No retries permitted until 2026-07-01 17:00:28.007219962 +0000 UTC m=+99.844564705 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls") pod "dns-default-zlz2t" (UID: "5cf44b14-3dbc-4ecc-881e-3f8253c0862f") : secret "dns-default-metrics-tls" not found Jul 01 16:59:56.104265 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:56.104172 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:56.524043 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:56.524003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:56.755251 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:56.755215 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:57.416737 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:57.416697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:57.622507 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:57.622470 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:57.622752 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:57.622600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 16:59:57.622752 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:57.622664 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:59:57.622752 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:57.622694 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:59:57.622922 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:57.622767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:05.622743424 +0000 UTC m=+77.460088160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : secret "insights-runtime-extractor-tls" not found Jul 01 16:59:57.622922 ip-10-0-139-133 kubenswrapper[2572]: E0701 16:59:57.622794 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm podName:be278cfb-f22d-4714-ab31-f8d12a1e1ff2 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:05.622782077 +0000 UTC m=+77.460126807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8ww9j" (UID: "be278cfb-f22d-4714-ab31-f8d12a1e1ff2") : configmap "kube-rbac-proxy" not found Jul 01 16:59:57.732398 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:57.732367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:58.083312 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:58.083216 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:58.358887 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:58.358772 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:58.555936 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:58.555891 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:58.745377 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:58.745344 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:59.104369 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:59.104334 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:59.249125 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:59.249084 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 16:59:59.852009 ip-10-0-139-133 kubenswrapper[2572]: I0701 16:59:59.851973 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:00.025163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:00.025128 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jxl5v" event={"ID":"dfa80559-5b81-4609-bf42-c0dfcbbb2624","Type":"ContainerStarted","Data":"17ba306cce61f46f05825f23253b30d84eba275da54c11bacbf3c8ea29ec1637"} Jul 01 17:00:00.062882 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:00.062833 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jxl5v" podStartSLOduration=66.884628905 podStartE2EDuration="1m11.062818499s" totalImagesPullingTime="4.178189594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:00.06171899 +0000 UTC m=+71.899063758" watchObservedRunningTime="2026-07-01 17:00:00.062818499 +0000 UTC m=+71.900163250" Jul 01 17:00:00.063067 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:00.063048 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-6cvb5" podStartSLOduration=7.239647485 podStartE2EDuration="9.06304208s" totalImagesPullingTime="1.823394595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:59:55.057573441 +0000 UTC m=+66.894918192" watchObservedRunningTime="2026-07-01 17:00:00.06304208 +0000 UTC m=+71.900386831" Jul 01 17:00:00.098514 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:00.098479 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:00.249801 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:00.249727 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:00.664009 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:00.663928 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:01.439022 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:01.438986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:01.613469 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:01.613437 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:01.654583 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:01.654552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 17:00:01.654760 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:01.654699 2572 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 17:00:01.654760 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:01.654753 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert podName:416ae2ab-ce08-4f58-a386-de02775bf210 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:17.654738981 +0000 UTC m=+89.492083710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-zbcl7" (UID: "416ae2ab-ce08-4f58-a386-de02775bf210") : secret "networking-console-plugin-cert" not found Jul 01 17:00:01.936955 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:01.936924 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:02.181952 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:02.181916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:02.510892 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:02.510855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:02.879666 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:02.879578 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:03.271132 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:03.271089 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:03.447724 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:03.447691 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:03.651709 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:03.651616 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:03.837706 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:03.837662 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:04.129592 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:04.129547 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:05.013237 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.013205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:05.593607 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.593568 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:05.690098 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.690057 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 17:00:05.690279 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.690111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 17:00:05.690598 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.690577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 17:00:05.692391 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.692372 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/be278cfb-f22d-4714-ab31-f8d12a1e1ff2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8ww9j\" (UID: \"be278cfb-f22d-4714-ab31-f8d12a1e1ff2\") " pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 17:00:05.714724 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.714671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:05.804601 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.804568 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8ww9j" Jul 01 17:00:05.888324 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.888280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:05.948941 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:05.948913 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8ww9j"] Jul 01 17:00:05.951211 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:05.951186 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe278cfb_f22d_4714_ab31_f8d12a1e1ff2.slice/crio-bc935df814cf121b998814861597e8a90e2c617be6428a9295f5687938ae5d61 WatchSource:0}: Error finding container bc935df814cf121b998814861597e8a90e2c617be6428a9295f5687938ae5d61: Status 404 returned error can't find the container with id bc935df814cf121b998814861597e8a90e2c617be6428a9295f5687938ae5d61 Jul 01 17:00:06.044481 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:06.044445 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ww9j" event={"ID":"be278cfb-f22d-4714-ab31-f8d12a1e1ff2","Type":"ContainerStarted","Data":"bc935df814cf121b998814861597e8a90e2c617be6428a9295f5687938ae5d61"} Jul 01 17:00:06.181378 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:06.181295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:07.761395 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:07.761345 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:07.857452 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:07.857410 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:10.063793 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:10.063756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ww9j" event={"ID":"be278cfb-f22d-4714-ab31-f8d12a1e1ff2","Type":"ContainerStarted","Data":"241d047b04d588181c591f6eb383e54d2202d7492ed3e2c1095d1712c1ae0c9d"} Jul 01 17:00:10.581781 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:10.581748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:13.076021 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:13.075938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ww9j" event={"ID":"be278cfb-f22d-4714-ab31-f8d12a1e1ff2","Type":"ContainerStarted","Data":"9dae949f9a27a61dacb2858141c05f01c254acac0184d679c7f85932d2acfa62"} Jul 01 17:00:14.203360 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:14.203324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:14.566768 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:14.566732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:14.820412 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:14.820320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:15.810602 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:15.810569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:16.088033 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:16.087959 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8ww9j" event={"ID":"be278cfb-f22d-4714-ab31-f8d12a1e1ff2","Type":"ContainerStarted","Data":"b18f0483aca20ad0d3001031ef8f697120d986cb5e50be315add6c7178e69f1c"} Jul 01 17:00:16.095163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:16.095128 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:16.122774 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:16.122729 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8ww9j" podStartSLOduration=17.210906101 podStartE2EDuration="27.122713706s" totalImagesPullingTime="9.911807605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:59:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:16.12221264 +0000 UTC m=+87.959557392" watchObservedRunningTime="2026-07-01 17:00:16.122713706 +0000 UTC m=+87.960058458" Jul 01 17:00:16.291723 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:16.291669 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:16.413809 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:16.413724 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:17.683528 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:17.683488 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 17:00:17.685862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:17.685838 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/416ae2ab-ce08-4f58-a386-de02775bf210-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-zbcl7\" (UID: \"416ae2ab-ce08-4f58-a386-de02775bf210\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 17:00:17.906154 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:17.906127 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-csl2d\"" Jul 01 17:00:17.913808 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:17.913778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" Jul 01 17:00:18.043263 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:18.043239 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7"] Jul 01 17:00:18.045583 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:18.045557 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416ae2ab_ce08_4f58_a386_de02775bf210.slice/crio-74ec8219a69150f20ba0a4b0f1c3a7aa49d4184e01e86ecf07852d0a1ba3d35d WatchSource:0}: Error finding container 74ec8219a69150f20ba0a4b0f1c3a7aa49d4184e01e86ecf07852d0a1ba3d35d: Status 404 returned error can't find the container with id 74ec8219a69150f20ba0a4b0f1c3a7aa49d4184e01e86ecf07852d0a1ba3d35d Jul 01 17:00:18.098661 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:18.098624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" event={"ID":"416ae2ab-ce08-4f58-a386-de02775bf210","Type":"ContainerStarted","Data":"74ec8219a69150f20ba0a4b0f1c3a7aa49d4184e01e86ecf07852d0a1ba3d35d"} Jul 01 17:00:19.835094 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:19.835057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:19.970086 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:19.970054 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:20.106504 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.106435 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" event={"ID":"416ae2ab-ce08-4f58-a386-de02775bf210","Type":"ContainerStarted","Data":"f84dc3386b976235fd8722da3ac9fa45b90839474f970dc2f925672c00913d84"} Jul 01 17:00:20.128720 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.128661 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-zbcl7" podStartSLOduration=33.821874375 podStartE2EDuration="35.128647648s" totalImagesPullingTime="1.306773273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:20.128093698 +0000 UTC m=+91.965438468" watchObservedRunningTime="2026-07-01 17:00:20.128647648 +0000 UTC m=+91.965992426" Jul 01 17:00:20.275293 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.275268 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b"] Jul 01 17:00:20.281251 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.281233 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.285370 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.285350 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 17:00:20.285575 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.285561 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 17:00:20.287973 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.287775 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 17:00:20.289227 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.289205 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 17:00:20.305550 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.305523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.305649 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.305563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckpt\" (UniqueName: \"kubernetes.io/projected/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-kube-api-access-9ckpt\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.305744 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.305724 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-tmp\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.307782 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.307760 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b"] Jul 01 17:00:20.404263 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.404179 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:20.406112 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.406090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-tmp\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.406199 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.406137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.406199 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.406167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckpt\" (UniqueName: \"kubernetes.io/projected/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-kube-api-access-9ckpt\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.406563 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.406498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-tmp\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.408763 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.408738 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.438247 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.438222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckpt\" (UniqueName: \"kubernetes.io/projected/5a2ba598-fbe5-408b-9d14-fe95cfbfa25f-kube-api-access-9ckpt\") pod \"klusterlet-addon-workmgr-6f96c68f7b-clz8b\" (UID: \"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.591212 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.591182 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:20.699551 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.699524 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:20.817191 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:20.817138 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b"] Jul 01 17:00:20.820397 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:20.820371 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2ba598_fbe5_408b_9d14_fe95cfbfa25f.slice/crio-b33a74971beebdc04806bb8bc68070b10f18f7bda66743d9f0563992a8cfe90a WatchSource:0}: Error finding container b33a74971beebdc04806bb8bc68070b10f18f7bda66743d9f0563992a8cfe90a: Status 404 returned error can't find the container with id b33a74971beebdc04806bb8bc68070b10f18f7bda66743d9f0563992a8cfe90a Jul 01 17:00:21.028142 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:21.028110 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:21.110611 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:21.110580 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" event={"ID":"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f","Type":"ContainerStarted","Data":"b33a74971beebdc04806bb8bc68070b10f18f7bda66743d9f0563992a8cfe90a"} Jul 01 17:00:21.207016 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:21.206983 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:21.419900 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:21.419817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:23.207956 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.207818 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-866b664f4d-s8x5c"] Jul 01 17:00:23.216622 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.216600 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.220037 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.219875 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 17:00:23.220037 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.219898 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 17:00:23.220037 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.219903 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 17:00:23.220037 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.219941 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 17:00:23.221047 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.220851 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 17:00:23.221047 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.220861 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4nn42\"" Jul 01 17:00:23.221047 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.220866 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 17:00:23.221539 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.221374 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 17:00:23.225886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.225150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-service-ca\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.225886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.225189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg4z9\" (UniqueName: \"kubernetes.io/projected/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-kube-api-access-tg4z9\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.225886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.225273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-oauth-serving-cert\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.225886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.225312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-serving-cert\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.225886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.225346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-config\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.225886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.225371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-oauth-config\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.238339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.238278 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866b664f4d-s8x5c"] Jul 01 17:00:23.325854 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.325825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-oauth-config\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.326032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.325903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-service-ca\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.326032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.325945 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg4z9\" (UniqueName: \"kubernetes.io/projected/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-kube-api-access-tg4z9\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.326806 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.326289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-oauth-serving-cert\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.326806 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.326341 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-serving-cert\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.326806 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.326377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-config\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.327052 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.326859 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-service-ca\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.327052 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.326957 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-oauth-serving-cert\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.327052 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.326970 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-config\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.329320 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.329274 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-oauth-config\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.329431 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.329345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-serving-cert\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.337495 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.337447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg4z9\" (UniqueName: \"kubernetes.io/projected/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-kube-api-access-tg4z9\") pod \"console-866b664f4d-s8x5c\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:23.530025 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:23.529988 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:24.005031 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.004994 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-866b664f4d-s8x5c"] Jul 01 17:00:24.008095 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:24.008051 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3ee7f1_d939_4833_96e3_9fe94fd58e75.slice/crio-0d5ec557b8fa2a3d9778b60403040e16681e1d9ed973a8172ec6087e526f5a49 WatchSource:0}: Error finding container 0d5ec557b8fa2a3d9778b60403040e16681e1d9ed973a8172ec6087e526f5a49: Status 404 returned error can't find the container with id 0d5ec557b8fa2a3d9778b60403040e16681e1d9ed973a8172ec6087e526f5a49 Jul 01 17:00:24.123888 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.123815 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866b664f4d-s8x5c" event={"ID":"fa3ee7f1-d939-4833-96e3-9fe94fd58e75","Type":"ContainerStarted","Data":"0d5ec557b8fa2a3d9778b60403040e16681e1d9ed973a8172ec6087e526f5a49"} Jul 01 17:00:24.147130 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.147104 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:24.301021 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.300987 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-pn4lf"] Jul 01 17:00:24.304446 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.304422 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.309794 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.309772 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 17:00:24.309970 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.309778 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nh875\"" Jul 01 17:00:24.309970 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.309798 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 17:00:24.310100 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.310080 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 17:00:24.311193 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.311172 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 17:00:24.312509 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.312361 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 17:00:24.329219 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.329190 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-pn4lf"] Jul 01 17:00:24.333314 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.333288 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26a983aa-84f8-414f-ae72-2d2d285e9518-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.333434 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.333338 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26a983aa-84f8-414f-ae72-2d2d285e9518-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.333434 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.333398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26a983aa-84f8-414f-ae72-2d2d285e9518-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.333550 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.333484 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42jqw\" (UniqueName: \"kubernetes.io/projected/26a983aa-84f8-414f-ae72-2d2d285e9518-kube-api-access-42jqw\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.402612 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.402509 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:24.433823 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.433792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26a983aa-84f8-414f-ae72-2d2d285e9518-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.433983 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.433843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26a983aa-84f8-414f-ae72-2d2d285e9518-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.433983 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.433951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42jqw\" (UniqueName: \"kubernetes.io/projected/26a983aa-84f8-414f-ae72-2d2d285e9518-kube-api-access-42jqw\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.434143 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.433989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26a983aa-84f8-414f-ae72-2d2d285e9518-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.434714 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.434667 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26a983aa-84f8-414f-ae72-2d2d285e9518-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.436385 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.436365 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/26a983aa-84f8-414f-ae72-2d2d285e9518-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.436588 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.436568 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/26a983aa-84f8-414f-ae72-2d2d285e9518-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.445652 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.445627 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42jqw\" (UniqueName: \"kubernetes.io/projected/26a983aa-84f8-414f-ae72-2d2d285e9518-kube-api-access-42jqw\") pod \"prometheus-operator-7b7d896497-pn4lf\" (UID: \"26a983aa-84f8-414f-ae72-2d2d285e9518\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.615306 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.615269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" Jul 01 17:00:24.666355 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:24.666242 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:25.397939 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:25.397905 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-pn4lf"] Jul 01 17:00:25.400407 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:25.400378 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a983aa_84f8_414f_ae72_2d2d285e9518.slice/crio-e211514299d10ffb3dfcbbfebce393c06beaca17fb6825634f9f7b1b5a3bb7b3 WatchSource:0}: Error finding container e211514299d10ffb3dfcbbfebce393c06beaca17fb6825634f9f7b1b5a3bb7b3: Status 404 returned error can't find the container with id e211514299d10ffb3dfcbbfebce393c06beaca17fb6825634f9f7b1b5a3bb7b3 Jul 01 17:00:26.012658 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:26.012624 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ts2zp" Jul 01 17:00:26.134379 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:26.134345 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" event={"ID":"5a2ba598-fbe5-408b-9d14-fe95cfbfa25f","Type":"ContainerStarted","Data":"ac01fb4b7ab9924ff5550c2e50e4a1aa720bbe82615d4add0ef54f5d7d9dda1f"} Jul 01 17:00:26.134930 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:26.134905 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:26.136580 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:26.136543 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" event={"ID":"26a983aa-84f8-414f-ae72-2d2d285e9518","Type":"ContainerStarted","Data":"e211514299d10ffb3dfcbbfebce393c06beaca17fb6825634f9f7b1b5a3bb7b3"} Jul 01 17:00:26.136938 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:26.136892 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" Jul 01 17:00:26.157253 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:26.157198 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f96c68f7b-clz8b" podStartSLOduration=1.640559474 podStartE2EDuration="6.157178579s" totalImagesPullingTime="4.516619105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:26.154768011 +0000 UTC m=+97.992112789" watchObservedRunningTime="2026-07-01 17:00:26.157178579 +0000 UTC m=+97.994523331" Jul 01 17:00:27.959905 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:27.959881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:00:27.961958 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:27.961937 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"image-registry-5b4555c9b9-wlmt4\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:00:27.969382 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:27.969362 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5lvm2\"" Jul 01 17:00:27.977309 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:27.977289 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:00:28.061787 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.061673 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 17:00:28.064275 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.064251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5cf44b14-3dbc-4ecc-881e-3f8253c0862f-metrics-tls\") pod \"dns-default-zlz2t\" (UID: \"5cf44b14-3dbc-4ecc-881e-3f8253c0862f\") " pod="openshift-dns/dns-default-zlz2t" Jul 01 17:00:28.124285 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.124199 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b4555c9b9-wlmt4"] Jul 01 17:00:28.128340 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:28.128310 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda204b28c_0c5a_4711_a78b_3da18dbe9536.slice/crio-3356f9a673e3b7353ddc5080aa3b54dea43b12abd91a75b0815b5c7f9db75904 WatchSource:0}: Error finding container 3356f9a673e3b7353ddc5080aa3b54dea43b12abd91a75b0815b5c7f9db75904: Status 404 returned error can't find the container with id 3356f9a673e3b7353ddc5080aa3b54dea43b12abd91a75b0815b5c7f9db75904 Jul 01 17:00:28.150231 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.150192 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" event={"ID":"26a983aa-84f8-414f-ae72-2d2d285e9518","Type":"ContainerStarted","Data":"87a4351815f4a3df57a50505609704dd0774c7449d503822b8e925af9996d2df"} Jul 01 17:00:28.150344 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.150259 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" event={"ID":"26a983aa-84f8-414f-ae72-2d2d285e9518","Type":"ContainerStarted","Data":"1075ae678268eabda65a1350a2da1db13440761862342501f7ad22f9027d7048"} Jul 01 17:00:28.151922 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.151897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866b664f4d-s8x5c" event={"ID":"fa3ee7f1-d939-4833-96e3-9fe94fd58e75","Type":"ContainerStarted","Data":"c11f6a7ef64328d516a396b899d8e56a012001829b78536d1d7d95dff6033841"} Jul 01 17:00:28.153059 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.153036 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" event={"ID":"a204b28c-0c5a-4711-a78b-3da18dbe9536","Type":"ContainerStarted","Data":"3356f9a673e3b7353ddc5080aa3b54dea43b12abd91a75b0815b5c7f9db75904"} Jul 01 17:00:28.173867 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.173820 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-pn4lf" podStartSLOduration=1.642315717 podStartE2EDuration="4.173806153s" totalImagesPullingTime="2.531490436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:28.173194031 +0000 UTC m=+100.010538779" watchObservedRunningTime="2026-07-01 17:00:28.173806153 +0000 UTC m=+100.011150904" Jul 01 17:00:28.176575 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.176548 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:28.201917 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.201876 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-866b664f4d-s8x5c" podStartSLOduration=1.272148386 podStartE2EDuration="5.201858733s" totalImagesPullingTime="3.929710347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:28.200008368 +0000 UTC m=+100.037353140" watchObservedRunningTime="2026-07-01 17:00:28.201858733 +0000 UTC m=+100.039203484" Jul 01 17:00:28.286169 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.286139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:28.304271 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.304248 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-96p59\"" Jul 01 17:00:28.311543 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.311524 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zlz2t" Jul 01 17:00:28.385527 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.385494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:28.441675 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:28.441650 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zlz2t"] Jul 01 17:00:28.443933 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:28.443902 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf44b14_3dbc_4ecc_881e_3f8253c0862f.slice/crio-bfb47c12359cac2c4ca3c8fb81d49a6bc62861924f0dc38ef37c489219e2710f WatchSource:0}: Error finding container bfb47c12359cac2c4ca3c8fb81d49a6bc62861924f0dc38ef37c489219e2710f: Status 404 returned error can't find the container with id bfb47c12359cac2c4ca3c8fb81d49a6bc62861924f0dc38ef37c489219e2710f Jul 01 17:00:29.157980 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.157936 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" event={"ID":"a204b28c-0c5a-4711-a78b-3da18dbe9536","Type":"ContainerStarted","Data":"38591f2bad6265bc6ca65f2d57297676edeee81e7bd1be5fcafff0e55762fbd8"} Jul 01 17:00:29.158419 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.158054 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:00:29.159205 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.159184 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zlz2t" event={"ID":"5cf44b14-3dbc-4ecc-881e-3f8253c0862f","Type":"ContainerStarted","Data":"bfb47c12359cac2c4ca3c8fb81d49a6bc62861924f0dc38ef37c489219e2710f"} Jul 01 17:00:29.184457 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.184414 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" podStartSLOduration=100.184400583 podStartE2EDuration="1m40.184400583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:29.182732952 +0000 UTC m=+101.020077700" watchObservedRunningTime="2026-07-01 17:00:29.184400583 +0000 UTC m=+101.021745312" Jul 01 17:00:29.439663 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.439584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:29.566291 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.566253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:29.742451 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.742417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:29.788450 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.788423 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4"] Jul 01 17:00:29.791887 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.791865 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.795063 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.794850 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 17:00:29.795063 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.794868 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-mc58x\"" Jul 01 17:00:29.795063 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.794985 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:00:29.812406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.812386 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4"] Jul 01 17:00:29.847327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.847301 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n4tk7"] Jul 01 17:00:29.849691 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.849655 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-cksr2"] Jul 01 17:00:29.849835 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.849816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.853583 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.851864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.853583 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.852577 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 17:00:29.853583 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.852754 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 17:00:29.853583 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.852944 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-djdgq\"" Jul 01 17:00:29.853583 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.853186 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 17:00:29.862481 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.862461 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 17:00:29.862746 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.862728 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5zcwz\"" Jul 01 17:00:29.862914 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.862897 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 17:00:29.863189 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.863169 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 17:00:29.875603 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.875580 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-cksr2"] Jul 01 17:00:29.875937 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.875916 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-tls\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876020 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.875997 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.876098 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k7tt\" (UniqueName: \"kubernetes.io/projected/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-api-access-4k7tt\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.876159 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876119 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.876159 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876146 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.876266 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876167 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-textfile\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876266 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.876266 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-sys\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e58c8c6-f996-4733-82e7-8eab74e00ae7-metrics-client-ca\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3771fe5-dd5d-42f0-98fa-e889ed83f526-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876374 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v6vv\" (UniqueName: \"kubernetes.io/projected/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-kube-api-access-6v6vv\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876444 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3771fe5-dd5d-42f0-98fa-e889ed83f526-metrics-client-ca\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.876470 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-root\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876917 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-wtmp\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.876917 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.876520 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cktsj\" (UniqueName: \"kubernetes.io/projected/9e58c8c6-f996-4733-82e7-8eab74e00ae7-kube-api-access-cktsj\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.878343 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.878314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:29.977837 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-sys\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e58c8c6-f996-4733-82e7-8eab74e00ae7-metrics-client-ca\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3771fe5-dd5d-42f0-98fa-e889ed83f526-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.978019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977943 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.978019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977977 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-sys\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.977995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v6vv\" (UniqueName: \"kubernetes.io/projected/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-kube-api-access-6v6vv\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:29.978087 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978104 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3771fe5-dd5d-42f0-98fa-e889ed83f526-metrics-client-ca\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:29.978144 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-tls podName:a3771fe5-dd5d-42f0-98fa-e889ed83f526 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:30.478127346 +0000 UTC m=+102.315472079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-cksr2" (UID: "a3771fe5-dd5d-42f0-98fa-e889ed83f526") : secret "kube-state-metrics-tls" not found Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-root\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-wtmp\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978214 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cktsj\" (UniqueName: \"kubernetes.io/projected/9e58c8c6-f996-4733-82e7-8eab74e00ae7-kube-api-access-cktsj\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978257 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-tls\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978289 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.978784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k7tt\" (UniqueName: \"kubernetes.io/projected/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-api-access-4k7tt\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.978784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978360 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.978784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.978784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-textfile\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.978784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.979026 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:29.978817 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 17:00:29.979026 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978831 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3771fe5-dd5d-42f0-98fa-e889ed83f526-metrics-client-ca\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.979026 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:29.978866 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-tls podName:9e58c8c6-f996-4733-82e7-8eab74e00ae7 nodeName:}" failed. No retries permitted until 2026-07-01 17:00:30.478850262 +0000 UTC m=+102.316195005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-tls") pod "node-exporter-n4tk7" (UID: "9e58c8c6-f996-4733-82e7-8eab74e00ae7") : secret "node-exporter-tls" not found Jul 01 17:00:29.979026 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:29.978883 2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 01 17:00:29.979026 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978911 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-root\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.979026 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:00:29.978941 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-tls podName:5e10893b-df7a-4b2e-b8e6-54ad4acd177b nodeName:}" failed. No retries permitted until 2026-07-01 17:00:30.478924128 +0000 UTC m=+102.316268870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-d64j4" (UID: "5e10893b-df7a-4b2e-b8e6-54ad4acd177b") : secret "openshift-state-metrics-tls" not found Jul 01 17:00:29.979369 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.979042 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-wtmp\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.979369 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.979119 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a3771fe5-dd5d-42f0-98fa-e889ed83f526-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.979369 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.978423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.979369 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.979237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e58c8c6-f996-4733-82e7-8eab74e00ae7-metrics-client-ca\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.979718 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.979670 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-textfile\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.979816 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.979724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.980796 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.979921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.981471 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.981389 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:29.989211 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.989060 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.989309 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.989218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.991929 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.991723 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k7tt\" (UniqueName: \"kubernetes.io/projected/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-api-access-4k7tt\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:29.991929 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.991877 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v6vv\" (UniqueName: \"kubernetes.io/projected/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-kube-api-access-6v6vv\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:29.992383 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:29.992363 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cktsj\" (UniqueName: \"kubernetes.io/projected/9e58c8c6-f996-4733-82e7-8eab74e00ae7-kube-api-access-cktsj\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:30.140726 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.140619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:30.243655 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.243609 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:30.412257 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.412148 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:30.483796 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.483765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-tls\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:30.483956 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.483806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:30.483956 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.483864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:30.486164 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.486134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e58c8c6-f996-4733-82e7-8eab74e00ae7-node-exporter-tls\") pod \"node-exporter-n4tk7\" (UID: \"9e58c8c6-f996-4733-82e7-8eab74e00ae7\") " pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:30.486324 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.486303 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a3771fe5-dd5d-42f0-98fa-e889ed83f526-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-cksr2\" (UID: \"a3771fe5-dd5d-42f0-98fa-e889ed83f526\") " pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:30.486386 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.486334 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e10893b-df7a-4b2e-b8e6-54ad4acd177b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-d64j4\" (UID: \"5e10893b-df7a-4b2e-b8e6-54ad4acd177b\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:30.704012 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.703927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" Jul 01 17:00:30.764149 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.764095 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n4tk7" Jul 01 17:00:30.771032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.770969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" Jul 01 17:00:30.787248 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.786161 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:00:30.795887 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.795809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.799525 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.799488 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 17:00:30.799525 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.799518 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 17:00:30.800084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.799905 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 17:00:30.800436 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.800281 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 17:00:30.803213 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.802894 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 17:00:30.803213 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.802976 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 17:00:30.803213 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.803004 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 17:00:30.803411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.803222 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 17:00:30.804107 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.804086 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 17:00:30.805218 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.804356 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vqjkg\"" Jul 01 17:00:30.831035 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.829724 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:00:30.887775 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.887742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.887978 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.887941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.888281 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.888000 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.888281 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.888040 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.888508 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.888356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrncg\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-kube-api-access-hrncg\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.888905 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.888858 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-web-config\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889022 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.888924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889078 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889154 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889130 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-out\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889224 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889275 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889233 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889318 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889446 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.889817 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.889742 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4"] Jul 01 17:00:30.893345 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:30.893320 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e10893b_df7a_4b2e_b8e6_54ad4acd177b.slice/crio-5eb34c156199dfa20ffd67e00c3f2f0e45547c5ff440323e85467631f9b004ad WatchSource:0}: Error finding container 5eb34c156199dfa20ffd67e00c3f2f0e45547c5ff440323e85467631f9b004ad: Status 404 returned error can't find the container with id 5eb34c156199dfa20ffd67e00c3f2f0e45547c5ff440323e85467631f9b004ad Jul 01 17:00:30.945665 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.945634 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-cksr2"] Jul 01 17:00:30.947486 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:30.947457 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3771fe5_dd5d_42f0_98fa_e889ed83f526.slice/crio-044386a835860d9b3157957f8ee6dccc1076dd755dfb8c06ea69f8330bb7c888 WatchSource:0}: Error finding container 044386a835860d9b3157957f8ee6dccc1076dd755dfb8c06ea69f8330bb7c888: Status 404 returned error can't find the container with id 044386a835860d9b3157957f8ee6dccc1076dd755dfb8c06ea69f8330bb7c888 Jul 01 17:00:30.990157 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990285 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-out\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990285 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990285 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990453 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990453 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990453 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990453 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990453 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990446 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990714 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990714 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrncg\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-kube-api-access-hrncg\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990714 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990561 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-web-config\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.990714 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.990592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.991515 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.991434 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.992768 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.992100 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.993170 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.992976 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.996008 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.995951 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-web-config\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.996354 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.996314 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.996598 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.996550 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.997196 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.996988 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-volume\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.997196 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.996998 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.997196 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.997149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.997877 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.997835 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:30.999845 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:30.999797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-out\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:31.001582 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.001548 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:31.004646 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.004624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrncg\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-kube-api-access-hrncg\") pod \"alertmanager-main-0\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:31.112822 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.112785 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:00:31.172347 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.172224 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" event={"ID":"5e10893b-df7a-4b2e-b8e6-54ad4acd177b","Type":"ContainerStarted","Data":"fbc55542512187a815249904a0de2e70469a8ea996b30acc510b34b3b017bb85"} Jul 01 17:00:31.172347 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.172290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" event={"ID":"5e10893b-df7a-4b2e-b8e6-54ad4acd177b","Type":"ContainerStarted","Data":"a7b87a6ff3d265e298e9bb46f003c7d0ac4a1b6fbef95d8fd4a14be3d93c3b0e"} Jul 01 17:00:31.172347 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.172309 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" event={"ID":"5e10893b-df7a-4b2e-b8e6-54ad4acd177b","Type":"ContainerStarted","Data":"5eb34c156199dfa20ffd67e00c3f2f0e45547c5ff440323e85467631f9b004ad"} Jul 01 17:00:31.173945 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.173913 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4tk7" event={"ID":"9e58c8c6-f996-4733-82e7-8eab74e00ae7","Type":"ContainerStarted","Data":"73935cb6032798dc6292d22bc8ec5d54daac0ffac90f879588e3be05bafed030"} Jul 01 17:00:31.175600 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.175566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" event={"ID":"a3771fe5-dd5d-42f0-98fa-e889ed83f526","Type":"ContainerStarted","Data":"044386a835860d9b3157957f8ee6dccc1076dd755dfb8c06ea69f8330bb7c888"} Jul 01 17:00:31.267573 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:31.267537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:00:31.270664 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:31.270640 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7f50fb_814e_4fb2_9c76_7c9d2e3d7285.slice/crio-d1164f75a14f0d34fda4d978dba0171cdbbd6018164da58d5048ff4b560e826b WatchSource:0}: Error finding container d1164f75a14f0d34fda4d978dba0171cdbbd6018164da58d5048ff4b560e826b: Status 404 returned error can't find the container with id d1164f75a14f0d34fda4d978dba0171cdbbd6018164da58d5048ff4b560e826b Jul 01 17:00:32.086396 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:32.086359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:32.180499 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:32.180459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"d1164f75a14f0d34fda4d978dba0171cdbbd6018164da58d5048ff4b560e826b"} Jul 01 17:00:33.157568 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.157499 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:33.187980 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.187933 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zlz2t" event={"ID":"5cf44b14-3dbc-4ecc-881e-3f8253c0862f","Type":"ContainerStarted","Data":"a34604af4ffabd704aca42a3bafaa5ee8a49b6160f0991a93bf0216f9d0899e7"} Jul 01 17:00:33.188171 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.188012 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zlz2t" event={"ID":"5cf44b14-3dbc-4ecc-881e-3f8253c0862f","Type":"ContainerStarted","Data":"da782b0a6606c09d4b855e6dd42954c10df9961d52e427efac866c120628afab"} Jul 01 17:00:33.188171 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.188048 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zlz2t" Jul 01 17:00:33.190316 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.190281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" event={"ID":"a3771fe5-dd5d-42f0-98fa-e889ed83f526","Type":"ContainerStarted","Data":"ca8dbba6f4fbb5fc0d2747478b0789aea503a7e1c871e2a1ca150f6a64d6697d"} Jul 01 17:00:33.190421 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.190342 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" event={"ID":"a3771fe5-dd5d-42f0-98fa-e889ed83f526","Type":"ContainerStarted","Data":"153ffef93bfdb9b32982869bc50bc07b849d458ebf40584d0636a6606e0bb0fc"} Jul 01 17:00:33.190421 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.190376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" event={"ID":"a3771fe5-dd5d-42f0-98fa-e889ed83f526","Type":"ContainerStarted","Data":"b35b74cff09639b6bd1768037986f0cf05f8d69485820a40cac074c8e33181db"} Jul 01 17:00:33.287937 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.287876 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zlz2t" podStartSLOduration=65.537959092 podStartE2EDuration="1m9.287855213s" totalImagesPullingTime="3.749896121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:33.284324462 +0000 UTC m=+105.121669240" watchObservedRunningTime="2026-07-01 17:00:33.287855213 +0000 UTC m=+105.125199967" Jul 01 17:00:33.288511 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.288468 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:33.320558 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.320515 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-cksr2" podStartSLOduration=3.076015635 podStartE2EDuration="4.320500221s" totalImagesPullingTime="1.244484586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:33.31878113 +0000 UTC m=+105.156125902" watchObservedRunningTime="2026-07-01 17:00:33.320500221 +0000 UTC m=+105.157844972" Jul 01 17:00:33.530718 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.530649 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:33.530891 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.530755 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:00:33.532361 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.532323 2572 patch_prober.go:28] interesting pod/console-866b664f4d-s8x5c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" start-of-body= Jul 01 17:00:33.532454 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:33.532369 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-866b664f4d-s8x5c" podUID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" containerName="console" probeResult="failure" output="Get \"https://10.132.0.15:8443/health\": dial tcp 10.132.0.15:8443: connect: connection refused" Jul 01 17:00:34.199303 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.199276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" event={"ID":"5e10893b-df7a-4b2e-b8e6-54ad4acd177b","Type":"ContainerStarted","Data":"48bbe27f2846fc794df378b75e3e562104b301dda085b44e15ef4c7a62f4c727"} Jul 01 17:00:34.201084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.201058 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4tk7" event={"ID":"9e58c8c6-f996-4733-82e7-8eab74e00ae7","Type":"ContainerStarted","Data":"1482302f6162e284ead1fe89e8a6eb79d52b20216bb71e64c677a9d409b5ae38"} Jul 01 17:00:34.202737 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.202714 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="3906c17d6dc0aa7303b54452de740f71066eabea8344a418f1e66a71edf625cf" exitCode=0 Jul 01 17:00:34.202815 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.202796 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"3906c17d6dc0aa7303b54452de740f71066eabea8344a418f1e66a71edf625cf"} Jul 01 17:00:34.229448 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.229427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:34.237039 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.236967 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-d64j4" podStartSLOduration=2.6255504629999997 podStartE2EDuration="5.236953332s" totalImagesPullingTime="2.611402869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:34.236579816 +0000 UTC m=+106.073924584" watchObservedRunningTime="2026-07-01 17:00:34.236953332 +0000 UTC m=+106.074298083" Jul 01 17:00:34.379862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.379819 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:34.533580 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.533497 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:34.800260 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:34.800170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:35.209877 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:35.209789 2572 generic.go:356] "Generic (PLEG): container finished" podID="9e58c8c6-f996-4733-82e7-8eab74e00ae7" containerID="1482302f6162e284ead1fe89e8a6eb79d52b20216bb71e64c677a9d409b5ae38" exitCode=0 Jul 01 17:00:35.210315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:35.209875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4tk7" event={"ID":"9e58c8c6-f996-4733-82e7-8eab74e00ae7","Type":"ContainerDied","Data":"1482302f6162e284ead1fe89e8a6eb79d52b20216bb71e64c677a9d409b5ae38"} Jul 01 17:00:35.210315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:35.209938 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4tk7" event={"ID":"9e58c8c6-f996-4733-82e7-8eab74e00ae7","Type":"ContainerStarted","Data":"0182a2fa9431d0933bf34954d538f194780415bf9327ab872299ec70b04e6c0d"} Jul 01 17:00:35.210315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:35.209965 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4tk7" event={"ID":"9e58c8c6-f996-4733-82e7-8eab74e00ae7","Type":"ContainerStarted","Data":"cfaf8fde84a8ceaed0a05f13dfb54f11b7fffad5d88447889b66153e4e295ef0"} Jul 01 17:00:35.247427 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:35.247374 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n4tk7" podStartSLOduration=2.918538384 podStartE2EDuration="6.247358602s" totalImagesPullingTime="3.264670807s" totalInitContainerRuntime="64.149411ms" isStatefulPod=true podCreationTimestamp="2026-07-01 17:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:35.247057785 +0000 UTC m=+107.084402538" watchObservedRunningTime="2026-07-01 17:00:35.247358602 +0000 UTC m=+107.084703353" Jul 01 17:00:36.158571 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.158539 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:00:36.163058 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.163040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.169121 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:00:36.169385 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169367 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:00:36.169477 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169462 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:00:36.169598 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169535 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:00:36.169598 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169593 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:00:36.169747 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169367 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:00:36.169976 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.169957 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-59d9flulgg980\"" Jul 01 17:00:36.170113 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.170097 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:00:36.170315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.170297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:00:36.170315 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.170312 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s77xh\"" Jul 01 17:00:36.170576 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.170558 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:00:36.170639 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.170596 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:00:36.171921 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.171901 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:00:36.172017 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.171925 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:00:36.173701 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.172951 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:00:36.174914 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.174892 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:00:36.177732 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.177708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:36.188327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.188302 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:00:36.191790 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.191766 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:00:36.216460 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.216428 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"83c89e22b5f12171fdf7903a73b08c9db7cd0b3ac95e6dbd87ca8c80c47ca45d"} Jul 01 17:00:36.216759 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.216520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"84ff7300e17a4075c1fd5e7be6b980da6ebc0c0cc0faccf93fcb94b95c86e66e"} Jul 01 17:00:36.244487 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244620 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244492 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244620 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244620 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244620 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244620 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244892 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244892 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244892 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244892 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244798 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.244892 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245102 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244898 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99nd4\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-kube-api-access-99nd4\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245102 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244929 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-config\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245102 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.244979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245102 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.245003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245102 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.245087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245296 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.245123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245296 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.245139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245296 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.245187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.245296 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.245234 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.345765 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.345742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.345862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.345771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.345862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.345790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.345959 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.345926 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346017 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.345979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346068 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346068 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346164 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346164 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346262 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346262 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346202 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99nd4\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-kube-api-access-99nd4\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346262 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346250 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-config\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346282 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346643 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346643 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346643 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.346817 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.346729 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.347739 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.347379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.348907 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.348767 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.349667 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.349304 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.349667 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.349542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.349667 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.349552 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.349667 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.349673 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.350134 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.350085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.350656 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.350447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.350656 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.350613 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.350865 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.350963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.351113 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.351167 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.351213 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351520 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.351272 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-config\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351520 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.351496 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.351657 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.351627 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.352260 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.352234 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.356880 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.356862 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99nd4\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-kube-api-access-99nd4\") pod \"prometheus-k8s-0\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.492672 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.492636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:36.645349 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:36.645309 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:00:36.648448 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:36.648422 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc156baf_15cb_485c_9f98_5b05f3251f73.slice/crio-fe76abeb3de45240ec6590459dfc0c3c3ac0b6ec3d4489643caf6c3dccba1c55 WatchSource:0}: Error finding container fe76abeb3de45240ec6590459dfc0c3c3ac0b6ec3d4489643caf6c3dccba1c55: Status 404 returned error can't find the container with id fe76abeb3de45240ec6590459dfc0c3c3ac0b6ec3d4489643caf6c3dccba1c55 Jul 01 17:00:37.148775 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.148739 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-866b664f4d-s8x5c"] Jul 01 17:00:37.222876 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.222840 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"c6654d57870d18389c6382b366736e53e85c5cea98942626323a0a475d94148e"} Jul 01 17:00:37.223291 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.222921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"514e28f72c2f7bd6d95e40e568675de526ecb9b5f9abd30ca24a4c8625f3d041"} Jul 01 17:00:37.223291 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.222963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"a69d299baed38b311696237b1972e48a16a4b494537587c236a9fe4ae3c569cd"} Jul 01 17:00:37.224251 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.224224 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05" exitCode=0 Jul 01 17:00:37.224327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.224261 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05"} Jul 01 17:00:37.224327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.224307 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"fe76abeb3de45240ec6590459dfc0c3c3ac0b6ec3d4489643caf6c3dccba1c55"} Jul 01 17:00:37.764258 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.764222 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:37.869903 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:37.869863 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:39.428077 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:39.428041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:39.491390 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:39.491353 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:41.246934 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:41.246907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f"} Jul 01 17:00:41.247205 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:41.246979 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828"} Jul 01 17:00:42.253881 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:42.253845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerStarted","Data":"0e6dd894d8fc5164451d9056b8054e826a3ea938a6d57ca059e57c35f2d485da"} Jul 01 17:00:42.289010 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:42.288958 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.163187511 podStartE2EDuration="12.288939265s" totalImagesPullingTime="9.098035862s" totalInitContainerRuntime="27.715892ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:42.287381801 +0000 UTC m=+114.124726552" watchObservedRunningTime="2026-07-01 17:00:42.288939265 +0000 UTC m=+114.126284017" Jul 01 17:00:43.205361 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:43.205331 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zlz2t" Jul 01 17:00:43.265373 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:43.265335 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280"} Jul 01 17:00:43.265769 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:43.265426 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc"} Jul 01 17:00:43.265769 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:43.265471 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e"} Jul 01 17:00:43.265769 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:43.265521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerStarted","Data":"c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16"} Jul 01 17:00:43.313042 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:43.312980 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.871493966 podStartE2EDuration="7.312962359s" totalImagesPullingTime="5.419829583s" totalInitContainerRuntime="21.63881ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:43.311758565 +0000 UTC m=+115.149103337" watchObservedRunningTime="2026-07-01 17:00:43.312962359 +0000 UTC m=+115.150307109" Jul 01 17:00:44.175700 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:44.175649 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b4555c9b9-wlmt4"] Jul 01 17:00:44.179969 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:44.179939 2572 patch_prober.go:28] interesting pod/image-registry-5b4555c9b9-wlmt4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 17:00:44.180084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:44.179984 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" podUID="a204b28c-0c5a-4711-a78b-3da18dbe9536" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 17:00:44.300917 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:44.300886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:44.375998 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:44.375959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:46.493377 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:46.493343 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:00:47.720224 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:47.720180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:47.871412 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:47.871366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:48.016551 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:48.016521 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:48.115285 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:48.115245 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:48.215743 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:48.215708 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:48.315898 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:48.315817 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:51.018893 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:51.018858 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:51.117097 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:51.117059 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:52.388268 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.388222 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5c766d94-gr4xz"] Jul 01 17:00:52.398148 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.398122 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.412932 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.412901 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 17:00:52.413356 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.413329 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5c766d94-gr4xz"] Jul 01 17:00:52.457560 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.457530 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:52.504660 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504626 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-oauth-config\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.504830 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-trusted-ca-bundle\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.504830 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504780 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f996f\" (UniqueName: \"kubernetes.io/projected/490640ab-d78b-4ef0-b42a-779a8caf2fd7-kube-api-access-f996f\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.504830 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504829 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-serving-cert\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.504936 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-oauth-serving-cert\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.504936 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-service-ca\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.505001 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.504935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-config\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.572047 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.572011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:52.606355 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-config\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.606533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606371 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-oauth-config\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.606533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-trusted-ca-bundle\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.606533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f996f\" (UniqueName: \"kubernetes.io/projected/490640ab-d78b-4ef0-b42a-779a8caf2fd7-kube-api-access-f996f\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.606533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-serving-cert\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.606533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-oauth-serving-cert\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.606818 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.606551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-service-ca\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.607254 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.607228 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-config\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.607425 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.607277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-service-ca\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.607425 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.607297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-trusted-ca-bundle\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.607866 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.607839 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-oauth-serving-cert\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.610207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.610183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-oauth-config\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.610299 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.610183 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-serving-cert\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.615562 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.615542 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f996f\" (UniqueName: \"kubernetes.io/projected/490640ab-d78b-4ef0-b42a-779a8caf2fd7-kube-api-access-f996f\") pod \"console-5f5c766d94-gr4xz\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.715252 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.715158 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:00:52.738048 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.738007 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:52.822821 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.822786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:52.848457 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:52.848277 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5c766d94-gr4xz"] Jul 01 17:00:52.851386 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:52.851357 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490640ab_d78b_4ef0_b42a_779a8caf2fd7.slice/crio-731834dfbf2073525273888e8943708cde2d06c93c6d2926115287337b80ce82 WatchSource:0}: Error finding container 731834dfbf2073525273888e8943708cde2d06c93c6d2926115287337b80ce82: Status 404 returned error can't find the container with id 731834dfbf2073525273888e8943708cde2d06c93c6d2926115287337b80ce82 Jul 01 17:00:53.308402 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:53.308367 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5c766d94-gr4xz" event={"ID":"490640ab-d78b-4ef0-b42a-779a8caf2fd7","Type":"ContainerStarted","Data":"986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb"} Jul 01 17:00:53.308579 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:53.308418 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5c766d94-gr4xz" event={"ID":"490640ab-d78b-4ef0-b42a-779a8caf2fd7","Type":"ContainerStarted","Data":"731834dfbf2073525273888e8943708cde2d06c93c6d2926115287337b80ce82"} Jul 01 17:00:53.332296 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:53.332134 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5c766d94-gr4xz" podStartSLOduration=1.332117982 podStartE2EDuration="1.332117982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:00:53.33196392 +0000 UTC m=+125.169308693" watchObservedRunningTime="2026-07-01 17:00:53.332117982 +0000 UTC m=+125.169462733" Jul 01 17:00:54.180823 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:54.180798 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:00:57.089669 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:57.089630 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:57.344537 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:57.344446 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:00:58.456743 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:58.456710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 17:00:58.459073 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:58.459050 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68d0cc90-fdbf-4842-a2f1-963f5d70d845-metrics-certs\") pod \"network-metrics-daemon-66nq9\" (UID: \"68d0cc90-fdbf-4842-a2f1-963f5d70d845\") " pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 17:00:58.563570 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:58.563544 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rp97d\"" Jul 01 17:00:58.571020 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:58.570999 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-66nq9" Jul 01 17:00:58.734665 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:58.734641 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-66nq9"] Jul 01 17:00:58.737143 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:00:58.737115 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d0cc90_fdbf_4842_a2f1_963f5d70d845.slice/crio-0c9d94239b6ac6a77147e93b84c235a19ad8e0367288d96fe15c9286d2c9d015 WatchSource:0}: Error finding container 0c9d94239b6ac6a77147e93b84c235a19ad8e0367288d96fe15c9286d2c9d015: Status 404 returned error can't find the container with id 0c9d94239b6ac6a77147e93b84c235a19ad8e0367288d96fe15c9286d2c9d015 Jul 01 17:00:59.334218 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:00:59.334187 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66nq9" event={"ID":"68d0cc90-fdbf-4842-a2f1-963f5d70d845","Type":"ContainerStarted","Data":"0c9d94239b6ac6a77147e93b84c235a19ad8e0367288d96fe15c9286d2c9d015"} Jul 01 17:01:00.911121 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:00.911075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:00.981599 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:00.981571 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:01.343602 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:01.343561 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66nq9" event={"ID":"68d0cc90-fdbf-4842-a2f1-963f5d70d845","Type":"ContainerStarted","Data":"31b3bca159f31f2e4163e941cde93900b12286f20545d9358c283a3300a7da99"} Jul 01 17:01:01.343808 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:01.343626 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-66nq9" event={"ID":"68d0cc90-fdbf-4842-a2f1-963f5d70d845","Type":"ContainerStarted","Data":"487918230e7613146565bdef761517fd4013b6254551e0685eda106a683f6a0f"} Jul 01 17:01:01.369757 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:01.369710 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-66nq9" podStartSLOduration=130.569854353 podStartE2EDuration="2m12.369671141s" totalImagesPullingTime="1.799816788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:01:01.367997278 +0000 UTC m=+133.205342055" watchObservedRunningTime="2026-07-01 17:01:01.369671141 +0000 UTC m=+133.207015928" Jul 01 17:01:01.385455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:01.385425 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:01.610110 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:01.610027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:01.788445 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:01.788401 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:02.168893 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.168856 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-866b664f4d-s8x5c" podUID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" containerName="console" containerID="cri-o://c11f6a7ef64328d516a396b899d8e56a012001829b78536d1d7d95dff6033841" gracePeriod=15 Jul 01 17:01:02.349693 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.349653 2572 generic.go:356] "Generic (PLEG): container finished" podID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" containerID="c11f6a7ef64328d516a396b899d8e56a012001829b78536d1d7d95dff6033841" exitCode=0 Jul 01 17:01:02.349841 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.349712 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866b664f4d-s8x5c" event={"ID":"fa3ee7f1-d939-4833-96e3-9fe94fd58e75","Type":"ContainerDied","Data":"c11f6a7ef64328d516a396b899d8e56a012001829b78536d1d7d95dff6033841"} Jul 01 17:01:02.454373 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.454349 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:01:02.493630 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.493604 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-config\") pod \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " Jul 01 17:01:02.493784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.493645 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg4z9\" (UniqueName: \"kubernetes.io/projected/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-kube-api-access-tg4z9\") pod \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " Jul 01 17:01:02.493784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.493713 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-serving-cert\") pod \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " Jul 01 17:01:02.493784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.493736 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-service-ca\") pod \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " Jul 01 17:01:02.493784 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.493768 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-oauth-serving-cert\") pod \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " Jul 01 17:01:02.494016 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.493839 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-oauth-config\") pod \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\" (UID: \"fa3ee7f1-d939-4833-96e3-9fe94fd58e75\") " Jul 01 17:01:02.494165 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.494102 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-config" (OuterVolumeSpecName: "console-config") pod "fa3ee7f1-d939-4833-96e3-9fe94fd58e75" (UID: "fa3ee7f1-d939-4833-96e3-9fe94fd58e75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:02.494251 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.494168 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-service-ca" (OuterVolumeSpecName: "service-ca") pod "fa3ee7f1-d939-4833-96e3-9fe94fd58e75" (UID: "fa3ee7f1-d939-4833-96e3-9fe94fd58e75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:02.494251 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.494238 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fa3ee7f1-d939-4833-96e3-9fe94fd58e75" (UID: "fa3ee7f1-d939-4833-96e3-9fe94fd58e75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:02.495953 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.495930 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-kube-api-access-tg4z9" (OuterVolumeSpecName: "kube-api-access-tg4z9") pod "fa3ee7f1-d939-4833-96e3-9fe94fd58e75" (UID: "fa3ee7f1-d939-4833-96e3-9fe94fd58e75"). InnerVolumeSpecName "kube-api-access-tg4z9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:02.496058 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.496023 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fa3ee7f1-d939-4833-96e3-9fe94fd58e75" (UID: "fa3ee7f1-d939-4833-96e3-9fe94fd58e75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:02.496223 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.496197 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fa3ee7f1-d939-4833-96e3-9fe94fd58e75" (UID: "fa3ee7f1-d939-4833-96e3-9fe94fd58e75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:02.594961 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.594928 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:02.594961 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.594958 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:02.594961 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.594967 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:02.595163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.594976 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:02.595163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.594984 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:02.595163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.594993 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg4z9\" (UniqueName: \"kubernetes.io/projected/fa3ee7f1-d939-4833-96e3-9fe94fd58e75-kube-api-access-tg4z9\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:02.716147 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.716069 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:01:02.716147 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.716138 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:01:02.720932 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:02.720910 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:01:03.355573 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:03.355544 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-866b664f4d-s8x5c" Jul 01 17:01:03.355573 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:03.355563 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-866b664f4d-s8x5c" event={"ID":"fa3ee7f1-d939-4833-96e3-9fe94fd58e75","Type":"ContainerDied","Data":"0d5ec557b8fa2a3d9778b60403040e16681e1d9ed973a8172ec6087e526f5a49"} Jul 01 17:01:03.356122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:03.355673 2572 scope.go:117] "RemoveContainer" containerID="c11f6a7ef64328d516a396b899d8e56a012001829b78536d1d7d95dff6033841" Jul 01 17:01:03.359991 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:03.359969 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:01:03.373853 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:03.373828 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-866b664f4d-s8x5c"] Jul 01 17:01:03.378230 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:03.378211 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-866b664f4d-s8x5c"] Jul 01 17:01:04.651265 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:04.651234 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" path="/var/lib/kubelet/pods/fa3ee7f1-d939-4833-96e3-9fe94fd58e75/volumes" Jul 01 17:01:04.777807 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:04.777768 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:04.871192 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:04.871155 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:07.735659 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:07.735627 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:07.836026 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:07.835992 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:09.196045 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.195995 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" podUID="a204b28c-0c5a-4711-a78b-3da18dbe9536" containerName="registry" containerID="cri-o://38591f2bad6265bc6ca65f2d57297676edeee81e7bd1be5fcafff0e55762fbd8" gracePeriod=30 Jul 01 17:01:09.382495 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.382459 2572 generic.go:356] "Generic (PLEG): container finished" podID="a204b28c-0c5a-4711-a78b-3da18dbe9536" containerID="38591f2bad6265bc6ca65f2d57297676edeee81e7bd1be5fcafff0e55762fbd8" exitCode=0 Jul 01 17:01:09.382722 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.382497 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" event={"ID":"a204b28c-0c5a-4711-a78b-3da18dbe9536","Type":"ContainerDied","Data":"38591f2bad6265bc6ca65f2d57297676edeee81e7bd1be5fcafff0e55762fbd8"} Jul 01 17:01:09.450046 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.449992 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:01:09.554181 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554148 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-trusted-ca\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554181 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554182 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-image-registry-private-configuration\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554209 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4j47\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-kube-api-access-x4j47\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554274 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554312 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-certificates\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554342 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a204b28c-0c5a-4711-a78b-3da18dbe9536-ca-trust-extracted\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554364 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-bound-sa-token\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554391 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-installation-pull-secrets\") pod \"a204b28c-0c5a-4711-a78b-3da18dbe9536\" (UID: \"a204b28c-0c5a-4711-a78b-3da18dbe9536\") " Jul 01 17:01:09.554754 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554728 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:09.554828 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.554799 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:09.556712 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.556662 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:09.556977 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.556953 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:09.557062 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.557010 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-kube-api-access-x4j47" (OuterVolumeSpecName: "kube-api-access-x4j47") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "kube-api-access-x4j47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:09.557062 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.557041 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:09.557223 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.557209 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:09.563263 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.563241 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a204b28c-0c5a-4711-a78b-3da18dbe9536-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a204b28c-0c5a-4711-a78b-3da18dbe9536" (UID: "a204b28c-0c5a-4711-a78b-3da18dbe9536"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:09.655670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655644 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-certificates\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655669 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a204b28c-0c5a-4711-a78b-3da18dbe9536-ca-trust-extracted\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655695 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-bound-sa-token\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655705 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-installation-pull-secrets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655713 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a204b28c-0c5a-4711-a78b-3da18dbe9536-trusted-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655723 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a204b28c-0c5a-4711-a78b-3da18dbe9536-image-registry-private-configuration\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655731 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4j47\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-kube-api-access-x4j47\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:09.655848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:09.655739 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a204b28c-0c5a-4711-a78b-3da18dbe9536-registry-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:10.389034 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:10.388998 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" Jul 01 17:01:10.389034 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:10.389030 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4555c9b9-wlmt4" event={"ID":"a204b28c-0c5a-4711-a78b-3da18dbe9536","Type":"ContainerDied","Data":"3356f9a673e3b7353ddc5080aa3b54dea43b12abd91a75b0815b5c7f9db75904"} Jul 01 17:01:10.389523 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:10.389078 2572 scope.go:117] "RemoveContainer" containerID="38591f2bad6265bc6ca65f2d57297676edeee81e7bd1be5fcafff0e55762fbd8" Jul 01 17:01:10.413971 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:10.413941 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b4555c9b9-wlmt4"] Jul 01 17:01:10.417532 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:10.417512 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b4555c9b9-wlmt4"] Jul 01 17:01:10.651050 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:10.650980 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a204b28c-0c5a-4711-a78b-3da18dbe9536" path="/var/lib/kubelet/pods/a204b28c-0c5a-4711-a78b-3da18dbe9536/volumes" Jul 01 17:01:12.142246 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:12.142204 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:20.428911 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:20.428878 2572 generic.go:356] "Generic (PLEG): container finished" podID="9e66216d-d0e1-4e9e-ba95-9019e44a67d9" containerID="037447b068e5a272e6a65024f477b90a7ab0c76da2c8c2735a280e2103ae491d" exitCode=0 Jul 01 17:01:20.429415 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:20.428953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fssvm" event={"ID":"9e66216d-d0e1-4e9e-ba95-9019e44a67d9","Type":"ContainerDied","Data":"037447b068e5a272e6a65024f477b90a7ab0c76da2c8c2735a280e2103ae491d"} Jul 01 17:01:20.429415 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:20.429316 2572 scope.go:117] "RemoveContainer" containerID="037447b068e5a272e6a65024f477b90a7ab0c76da2c8c2735a280e2103ae491d" Jul 01 17:01:21.199013 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:21.198982 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f6mwq_f13ea006-473a-4736-94b6-3e7c7f780e29/serve-healthcheck-canary/0.log" Jul 01 17:01:21.434318 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:21.434286 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fssvm" event={"ID":"9e66216d-d0e1-4e9e-ba95-9019e44a67d9","Type":"ContainerStarted","Data":"13a3d3d48a4bdb238a72af1b34e25df1aa1ae052cb9c17a603c5db50c89160c8"} Jul 01 17:01:30.161373 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:30.161331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:30.261561 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:30.261528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:30.363884 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:30.363850 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:36.493605 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:36.493562 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:36.512498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:36.512469 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:37.514163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:37.514134 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:46.005981 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:46.005887 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:46.105065 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:46.105032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:50.327614 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327579 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:50.328061 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327904 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="alertmanager" containerID="cri-o://84ff7300e17a4075c1fd5e7be6b980da6ebc0c0cc0faccf93fcb94b95c86e66e" gracePeriod=120 Jul 01 17:01:50.328061 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327957 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="config-reloader" containerID="cri-o://83c89e22b5f12171fdf7903a73b08c9db7cd0b3ac95e6dbd87ca8c80c47ca45d" gracePeriod=120 Jul 01 17:01:50.328061 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327969 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-web" containerID="cri-o://a69d299baed38b311696237b1972e48a16a4b494537587c236a9fe4ae3c569cd" gracePeriod=120 Jul 01 17:01:50.328061 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327977 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="prom-label-proxy" containerID="cri-o://0e6dd894d8fc5164451d9056b8054e826a3ea938a6d57ca059e57c35f2d485da" gracePeriod=120 Jul 01 17:01:50.328256 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327948 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy" containerID="cri-o://514e28f72c2f7bd6d95e40e568675de526ecb9b5f9abd30ca24a4c8625f3d041" gracePeriod=120 Jul 01 17:01:50.328256 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.327999 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-metric" containerID="cri-o://c6654d57870d18389c6382b366736e53e85c5cea98942626323a0a475d94148e" gracePeriod=120 Jul 01 17:01:50.552042 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552011 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="0e6dd894d8fc5164451d9056b8054e826a3ea938a6d57ca059e57c35f2d485da" exitCode=0 Jul 01 17:01:50.552042 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552034 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="c6654d57870d18389c6382b366736e53e85c5cea98942626323a0a475d94148e" exitCode=0 Jul 01 17:01:50.552042 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552040 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="514e28f72c2f7bd6d95e40e568675de526ecb9b5f9abd30ca24a4c8625f3d041" exitCode=0 Jul 01 17:01:50.552042 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552047 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="83c89e22b5f12171fdf7903a73b08c9db7cd0b3ac95e6dbd87ca8c80c47ca45d" exitCode=0 Jul 01 17:01:50.552042 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552052 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="84ff7300e17a4075c1fd5e7be6b980da6ebc0c0cc0faccf93fcb94b95c86e66e" exitCode=0 Jul 01 17:01:50.552327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"0e6dd894d8fc5164451d9056b8054e826a3ea938a6d57ca059e57c35f2d485da"} Jul 01 17:01:50.552327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552141 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"c6654d57870d18389c6382b366736e53e85c5cea98942626323a0a475d94148e"} Jul 01 17:01:50.552327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552167 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"514e28f72c2f7bd6d95e40e568675de526ecb9b5f9abd30ca24a4c8625f3d041"} Jul 01 17:01:50.552327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552190 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"83c89e22b5f12171fdf7903a73b08c9db7cd0b3ac95e6dbd87ca8c80c47ca45d"} Jul 01 17:01:50.552327 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:50.552213 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"84ff7300e17a4075c1fd5e7be6b980da6ebc0c0cc0faccf93fcb94b95c86e66e"} Jul 01 17:01:51.561320 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.561292 2572 generic.go:356] "Generic (PLEG): container finished" podID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerID="a69d299baed38b311696237b1972e48a16a4b494537587c236a9fe4ae3c569cd" exitCode=0 Jul 01 17:01:51.561732 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.561364 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"a69d299baed38b311696237b1972e48a16a4b494537587c236a9fe4ae3c569cd"} Jul 01 17:01:51.584967 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.584947 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:51.611452 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611431 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-web-config\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611554 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611470 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611554 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611499 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrncg\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-kube-api-access-hrncg\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611554 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611525 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-trusted-ca-bundle\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611710 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611559 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-out\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611710 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611588 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-tls-assets\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611710 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611614 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611710 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611646 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-main-db\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.611710 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611670 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-cluster-tls-config\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.612032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611721 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-volume\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.612032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611784 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-web\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.612032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611808 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-main-tls\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.612032 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.611842 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-metrics-client-ca\") pod \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\" (UID: \"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285\") " Jul 01 17:01:51.612474 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.612425 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:51.612560 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.612466 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:51.613324 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.613273 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:51.614386 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.614359 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.615011 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.614986 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-out" (OuterVolumeSpecName: "config-out") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:51.615599 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.615557 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.616214 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.616165 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.616316 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.616207 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-kube-api-access-hrncg" (OuterVolumeSpecName: "kube-api-access-hrncg") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "kube-api-access-hrncg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:51.617151 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.617113 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:51.619399 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.619300 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-volume" (OuterVolumeSpecName: "config-volume") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.619399 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.619357 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.622914 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.622867 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.630366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.630342 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-web-config" (OuterVolumeSpecName: "web-config") pod "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" (UID: "cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712421 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712446 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-main-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712460 2572 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-metrics-client-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712470 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-web-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712478 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712487 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrncg\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-kube-api-access-hrncg\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712495 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712498 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712503 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-out\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712511 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-tls-assets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712519 2572 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712527 2572 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-alertmanager-main-db\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712536 2572 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-cluster-tls-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:51.712862 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:51.712545 2572 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285-config-volume\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:52.569041 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.569003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285","Type":"ContainerDied","Data":"d1164f75a14f0d34fda4d978dba0171cdbbd6018164da58d5048ff4b560e826b"} Jul 01 17:01:52.569458 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.569062 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 17:01:52.569458 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.569096 2572 scope.go:117] "RemoveContainer" containerID="0e6dd894d8fc5164451d9056b8054e826a3ea938a6d57ca059e57c35f2d485da" Jul 01 17:01:52.576852 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.576835 2572 scope.go:117] "RemoveContainer" containerID="c6654d57870d18389c6382b366736e53e85c5cea98942626323a0a475d94148e" Jul 01 17:01:52.583747 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.583732 2572 scope.go:117] "RemoveContainer" containerID="514e28f72c2f7bd6d95e40e568675de526ecb9b5f9abd30ca24a4c8625f3d041" Jul 01 17:01:52.589993 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.589977 2572 scope.go:117] "RemoveContainer" containerID="a69d299baed38b311696237b1972e48a16a4b494537587c236a9fe4ae3c569cd" Jul 01 17:01:52.596428 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.596414 2572 scope.go:117] "RemoveContainer" containerID="83c89e22b5f12171fdf7903a73b08c9db7cd0b3ac95e6dbd87ca8c80c47ca45d" Jul 01 17:01:52.600766 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.600743 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:52.604736 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.604713 2572 scope.go:117] "RemoveContainer" containerID="84ff7300e17a4075c1fd5e7be6b980da6ebc0c0cc0faccf93fcb94b95c86e66e" Jul 01 17:01:52.605070 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.605048 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 17:01:52.611389 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.611370 2572 scope.go:117] "RemoveContainer" containerID="3906c17d6dc0aa7303b54452de740f71066eabea8344a418f1e66a71edf625cf" Jul 01 17:01:52.655001 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:52.652811 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" path="/var/lib/kubelet/pods/cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285/volumes" Jul 01 17:01:54.405165 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.405127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:54.493474 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.493431 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:54.578833 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.578804 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:54.579156 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.579095 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="prometheus" containerID="cri-o://34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828" gracePeriod=600 Jul 01 17:01:54.579248 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.579166 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280" gracePeriod=600 Jul 01 17:01:54.579248 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.579162 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-web" containerID="cri-o://1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e" gracePeriod=600 Jul 01 17:01:54.579371 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.579148 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="config-reloader" containerID="cri-o://51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f" gracePeriod=600 Jul 01 17:01:54.579371 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.579118 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="thanos-sidecar" containerID="cri-o://c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16" gracePeriod=600 Jul 01 17:01:54.579371 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:54.579097 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy" containerID="cri-o://16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc" gracePeriod=600 Jul 01 17:01:55.585456 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585426 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280" exitCode=0 Jul 01 17:01:55.585456 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585450 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc" exitCode=0 Jul 01 17:01:55.585456 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585457 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16" exitCode=0 Jul 01 17:01:55.585456 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585463 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f" exitCode=0 Jul 01 17:01:55.585916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585468 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828" exitCode=0 Jul 01 17:01:55.585916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585493 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280"} Jul 01 17:01:55.585916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585553 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc"} Jul 01 17:01:55.585916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16"} Jul 01 17:01:55.585916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585605 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f"} Jul 01 17:01:55.585916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.585626 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828"} Jul 01 17:01:55.822492 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.822467 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:55.850231 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850175 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-metrics-client-ca\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850231 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850210 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-kube-rbac-proxy\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850231 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850228 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-1\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850441 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850248 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850441 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850270 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850441 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850287 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-config-out\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850441 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850302 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99nd4\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-kube-api-access-99nd4\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850441 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850320 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-serving-certs-ca-bundle\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850441 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850338 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-tls\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.850801 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850563 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.850801 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850581 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.850944 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850915 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-db\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851013 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850991 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-kubelet-serving-ca-bundle\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851013 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.850986 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.851172 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851021 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-2\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851172 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851054 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-trusted-ca-bundle\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851172 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851081 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-config\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851172 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851117 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-0\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851172 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851155 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-grpc-tls\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851424 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851188 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-metrics-client-certs\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851424 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851225 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-tls-assets\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851424 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851257 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-thanos-prometheus-http-client-file\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851424 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851304 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-web-config\") pod \"fc156baf-15cb-485c-9f98-5b05f3251f73\" (UID: \"fc156baf-15cb-485c-9f98-5b05f3251f73\") " Jul 01 17:01:55.851613 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851549 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-metrics-client-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.851613 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851567 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.851613 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.851581 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.853897 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.852287 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.853897 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.852337 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.853897 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.853791 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:55.853897 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.853855 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.854291 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.854252 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:01:55.854575 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.854547 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.854655 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.854594 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-config-out" (OuterVolumeSpecName: "config-out") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:01:55.854739 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.854657 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.855035 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.855006 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.855191 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.855153 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-kube-api-access-99nd4" (OuterVolumeSpecName: "kube-api-access-99nd4") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "kube-api-access-99nd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:55.855289 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.855238 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-config" (OuterVolumeSpecName: "config") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.855523 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.855460 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.855893 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.855763 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.856293 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.856232 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.856382 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.856347 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.857024 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.857000 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:01:55.874300 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.874256 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-web-config" (OuterVolumeSpecName: "web-config") pod "fc156baf-15cb-485c-9f98-5b05f3251f73" (UID: "fc156baf-15cb-485c-9f98-5b05f3251f73"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:01:55.952516 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952488 2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952516 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952513 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952516 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952524 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952533 2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952542 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952550 2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-grpc-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952559 2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-metrics-client-certs\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952569 2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-tls-assets\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952578 2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952586 2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-web-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952596 2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-kube-rbac-proxy\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952604 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952612 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952622 2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-config-out\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952632 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99nd4\" (UniqueName: \"kubernetes.io/projected/fc156baf-15cb-485c-9f98-5b05f3251f73-kube-api-access-99nd4\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952641 2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc156baf-15cb-485c-9f98-5b05f3251f73-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:55.952755 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:55.952649 2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc156baf-15cb-485c-9f98-5b05f3251f73-prometheus-k8s-db\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:01:56.595072 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.595042 2572 generic.go:356] "Generic (PLEG): container finished" podID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerID="1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e" exitCode=0 Jul 01 17:01:56.595448 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.595120 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.595448 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.595124 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e"} Jul 01 17:01:56.595448 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.595194 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc156baf-15cb-485c-9f98-5b05f3251f73","Type":"ContainerDied","Data":"fe76abeb3de45240ec6590459dfc0c3c3ac0b6ec3d4489643caf6c3dccba1c55"} Jul 01 17:01:56.595448 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.595228 2572 scope.go:117] "RemoveContainer" containerID="b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280" Jul 01 17:01:56.603832 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.603815 2572 scope.go:117] "RemoveContainer" containerID="16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc" Jul 01 17:01:56.610692 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.610664 2572 scope.go:117] "RemoveContainer" containerID="1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e" Jul 01 17:01:56.617531 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.617518 2572 scope.go:117] "RemoveContainer" containerID="c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16" Jul 01 17:01:56.624077 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.624062 2572 scope.go:117] "RemoveContainer" containerID="51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f" Jul 01 17:01:56.626942 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.626919 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:56.631095 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.631076 2572 scope.go:117] "RemoveContainer" containerID="34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828" Jul 01 17:01:56.635008 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.634986 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:56.638532 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.638517 2572 scope.go:117] "RemoveContainer" containerID="3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05" Jul 01 17:01:56.644935 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.644920 2572 scope.go:117] "RemoveContainer" containerID="b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280" Jul 01 17:01:56.645176 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.645155 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280\": container with ID starting with b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280 not found: ID does not exist" containerID="b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280" Jul 01 17:01:56.645231 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.645184 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280"} err="failed to get container status \"b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280\": rpc error: code = NotFound desc = could not find container \"b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280\": container with ID starting with b71514bdf0b376f295cab64419ade9ca23ac5d060276198cc782b07aa280f280 not found: ID does not exist" Jul 01 17:01:56.645272 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.645233 2572 scope.go:117] "RemoveContainer" containerID="16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc" Jul 01 17:01:56.645514 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.645497 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc\": container with ID starting with 16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc not found: ID does not exist" containerID="16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc" Jul 01 17:01:56.645582 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.645522 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc"} err="failed to get container status \"16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc\": rpc error: code = NotFound desc = could not find container \"16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc\": container with ID starting with 16c5ab99c820c3e30b3f426168c501d217f5980b1c71ba6a4298463f074e1ecc not found: ID does not exist" Jul 01 17:01:56.645582 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.645543 2572 scope.go:117] "RemoveContainer" containerID="1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e" Jul 01 17:01:56.645854 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.645833 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e\": container with ID starting with 1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e not found: ID does not exist" containerID="1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e" Jul 01 17:01:56.645928 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.645868 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e"} err="failed to get container status \"1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e\": rpc error: code = NotFound desc = could not find container \"1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e\": container with ID starting with 1ae24c75ae7ddd0f13cdc19257d96e648b586c6d6b7c0682b77521aec4294c0e not found: ID does not exist" Jul 01 17:01:56.645928 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.645889 2572 scope.go:117] "RemoveContainer" containerID="c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16" Jul 01 17:01:56.646196 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.646175 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16\": container with ID starting with c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16 not found: ID does not exist" containerID="c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16" Jul 01 17:01:56.646241 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.646202 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16"} err="failed to get container status \"c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16\": rpc error: code = NotFound desc = could not find container \"c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16\": container with ID starting with c4436b32265ddf9b31fcecee1ad458500bf7b9b42d74c3339067e45bcabb3c16 not found: ID does not exist" Jul 01 17:01:56.646241 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.646220 2572 scope.go:117] "RemoveContainer" containerID="51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f" Jul 01 17:01:56.646476 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.646458 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f\": container with ID starting with 51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f not found: ID does not exist" containerID="51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f" Jul 01 17:01:56.646549 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.646482 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f"} err="failed to get container status \"51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f\": rpc error: code = NotFound desc = could not find container \"51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f\": container with ID starting with 51eae9599d294b8d7ff6bc479d057a1d2709bcb5e98eca0cc66ad134cb6d0e4f not found: ID does not exist" Jul 01 17:01:56.646549 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.646501 2572 scope.go:117] "RemoveContainer" containerID="34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828" Jul 01 17:01:56.646763 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.646745 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828\": container with ID starting with 34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828 not found: ID does not exist" containerID="34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828" Jul 01 17:01:56.646811 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.646768 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828"} err="failed to get container status \"34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828\": rpc error: code = NotFound desc = could not find container \"34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828\": container with ID starting with 34e384a358b73d1a1179b106501bb21991508d7cd17dc853f5dcb7a6472e9828 not found: ID does not exist" Jul 01 17:01:56.646811 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.646785 2572 scope.go:117] "RemoveContainer" containerID="3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05" Jul 01 17:01:56.647009 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:01:56.646993 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05\": container with ID starting with 3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05 not found: ID does not exist" containerID="3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05" Jul 01 17:01:56.647061 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.647014 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05"} err="failed to get container status \"3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05\": rpc error: code = NotFound desc = could not find container \"3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05\": container with ID starting with 3bacb4361f15855079557e9d21e961446486640a3c4ce5b77dfece6bdc11fe05 not found: ID does not exist" Jul 01 17:01:56.650411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.650393 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" path="/var/lib/kubelet/pods/fc156baf-15cb-485c-9f98-5b05f3251f73/volumes" Jul 01 17:01:56.664912 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.664892 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:56.665148 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665137 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="alertmanager" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665151 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="alertmanager" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665163 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="prometheus" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665169 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="prometheus" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665178 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-metric" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665183 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-metric" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665191 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="init-config-reloader" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665196 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="init-config-reloader" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665202 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-web" Jul 01 17:01:56.665207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665208 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-web" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665215 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665220 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665227 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="prom-label-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665232 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="prom-label-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665240 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" containerName="console" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665245 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" containerName="console" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665251 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a204b28c-0c5a-4711-a78b-3da18dbe9536" containerName="registry" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665256 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a204b28c-0c5a-4711-a78b-3da18dbe9536" containerName="registry" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665261 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665265 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665269 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-thanos" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665274 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-thanos" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665281 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665286 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665291 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-web" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665296 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-web" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665303 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="init-config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665307 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="init-config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665312 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665317 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665324 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="thanos-sidecar" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665329 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="thanos-sidecar" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665368 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-thanos" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665375 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665381 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="alertmanager" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665388 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa3ee7f1-d939-4833-96e3-9fe94fd58e75" containerName="console" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665393 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="config-reloader" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665399 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-metric" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665403 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="thanos-sidecar" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665408 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="prom-label-proxy" Jul 01 17:01:56.665455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665414 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="config-reloader" Jul 01 17:01:56.666362 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665419 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy-web" Jul 01 17:01:56.666362 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665425 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf7f50fb-814e-4fb2-9c76-7c9d2e3d7285" containerName="kube-rbac-proxy-web" Jul 01 17:01:56.666362 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665431 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a204b28c-0c5a-4711-a78b-3da18dbe9536" containerName="registry" Jul 01 17:01:56.666362 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665435 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="prometheus" Jul 01 17:01:56.666362 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.665439 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc156baf-15cb-485c-9f98-5b05f3251f73" containerName="kube-rbac-proxy" Jul 01 17:01:56.668857 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.668838 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.671600 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.671578 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 17:01:56.673344 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.673325 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 17:01:56.674670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.674648 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s77xh\"" Jul 01 17:01:56.674670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.674668 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 17:01:56.674670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.674655 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-59d9flulgg980\"" Jul 01 17:01:56.674935 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.674907 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 17:01:56.674935 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.674921 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 17:01:56.675843 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.675710 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 17:01:56.675942 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.675927 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 17:01:56.676410 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.676387 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 17:01:56.678217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.678191 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 17:01:56.678922 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.678903 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 17:01:56.680281 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.680268 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 17:01:56.682162 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.682149 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 17:01:56.683410 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.683396 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 17:01:56.702704 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.699493 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 17:01:56.706586 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.706562 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:56.706713 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.706574 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 17:01:56.758927 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.758892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.758943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.758974 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759032 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c75e2ce-1396-4582-b9a0-5e153cba9573-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759183 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759206 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759265 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759298 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c75e2ce-1396-4582-b9a0-5e153cba9573-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759833 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759833 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759395 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w97tl\" (UniqueName: \"kubernetes.io/projected/2c75e2ce-1396-4582-b9a0-5e153cba9573-kube-api-access-w97tl\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759833 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759423 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.759833 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.759446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-config\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860093 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c75e2ce-1396-4582-b9a0-5e153cba9573-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860093 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860093 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860069 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860361 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860338 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w97tl\" (UniqueName: \"kubernetes.io/projected/2c75e2ce-1396-4582-b9a0-5e153cba9573-kube-api-access-w97tl\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860421 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860381 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860421 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-config\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860513 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860513 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860607 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860607 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860547 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860607 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860774 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860774 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c75e2ce-1396-4582-b9a0-5e153cba9573-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860774 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860774 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.860774 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860764 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.861012 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.861012 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860840 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.861012 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.861012 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.860915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.861214 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.861016 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.861665 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.861323 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.863158 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.863128 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c75e2ce-1396-4582-b9a0-5e153cba9573-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.863417 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.863326 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.863708 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.863646 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.863797 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.863749 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.863797 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.863756 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.863921 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.863824 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864243 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864073 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864243 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864120 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864243 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864217 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-config\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864491 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864345 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864582 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864557 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864639 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864603 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.864770 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.864749 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.865876 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.865852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c75e2ce-1396-4582-b9a0-5e153cba9573-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.866459 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.866441 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.866766 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.866750 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c75e2ce-1396-4582-b9a0-5e153cba9573-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.866931 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.866913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c75e2ce-1396-4582-b9a0-5e153cba9573-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.870668 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.870652 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w97tl\" (UniqueName: \"kubernetes.io/projected/2c75e2ce-1396-4582-b9a0-5e153cba9573-kube-api-access-w97tl\") pod \"prometheus-k8s-0\" (UID: \"2c75e2ce-1396-4582-b9a0-5e153cba9573\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:56.978928 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:56.978889 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:01:57.115751 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:57.115716 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 17:01:57.117950 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:01:57.117914 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c75e2ce_1396_4582_b9a0_5e153cba9573.slice/crio-c23c57de6126340d8941046e9dfe0950e567a3ecedde4c989028abd828a20af8 WatchSource:0}: Error finding container c23c57de6126340d8941046e9dfe0950e567a3ecedde4c989028abd828a20af8: Status 404 returned error can't find the container with id c23c57de6126340d8941046e9dfe0950e567a3ecedde4c989028abd828a20af8 Jul 01 17:01:57.601003 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:57.600967 2572 generic.go:356] "Generic (PLEG): container finished" podID="2c75e2ce-1396-4582-b9a0-5e153cba9573" containerID="403a6df1e64c61db81f49c63780d864994d161bb4e0cf42866c04c1ada04a8ed" exitCode=0 Jul 01 17:01:57.601366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:57.601009 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerDied","Data":"403a6df1e64c61db81f49c63780d864994d161bb4e0cf42866c04c1ada04a8ed"} Jul 01 17:01:57.601366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:57.601072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"c23c57de6126340d8941046e9dfe0950e567a3ecedde4c989028abd828a20af8"} Jul 01 17:01:58.608381 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.608344 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"20b621ba517a346b50683e3e88b3f78173ac1875eb0eea7bf9d92cc57e050c59"} Jul 01 17:01:58.608851 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.608422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"69b559145fef2eabaa29ed7994f6d61e9958cfcbcbb71a890b10b3f090f13a0a"} Jul 01 17:01:58.608851 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.608463 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"2e2eb3eb190aeb107ba0f034a86176ec0b7fded15b40ffabde6bb2d94909450f"} Jul 01 17:01:58.608851 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.608503 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"cac6d6edd7a7baa80e2f62571fc447f54e017b268788a8588833ac182e2ab696"} Jul 01 17:01:58.608851 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.608546 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"85403192d6ff3a681046ddf30f19078556d037c959ae73bbab7ac1c59c75a7d9"} Jul 01 17:01:58.608851 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.608583 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c75e2ce-1396-4582-b9a0-5e153cba9573","Type":"ContainerStarted","Data":"7a49d7a04eee77cee229e4d3d804d159e319a9626e3d7a48d2bef34a0d086767"} Jul 01 17:01:58.653783 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.653721 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.636007521 podStartE2EDuration="2.653700718s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.693197ms" isStatefulPod=false podCreationTimestamp="2026-07-01 17:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:01:58.64890731 +0000 UTC m=+190.486252096" watchObservedRunningTime="2026-07-01 17:01:58.653700718 +0000 UTC m=+190.491045462" Jul 01 17:01:58.686851 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.686818 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:01:58.747064 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:01:58.747032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:01.979936 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:01.979904 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:02:05.050591 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:05.050556 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5c766d94-gr4xz"] Jul 01 17:02:05.167358 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:05.167320 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:05.268093 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:05.268062 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:06.678153 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:06.678122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:07.728336 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:07.728290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:08.014268 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:08.014176 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:08.130105 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:08.130071 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:30.070493 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.070453 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f5c766d94-gr4xz" podUID="490640ab-d78b-4ef0-b42a-779a8caf2fd7" containerName="console" containerID="cri-o://986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb" gracePeriod=15 Jul 01 17:02:30.314886 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.314863 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:02:30.441670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441600 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-serving-cert\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.441670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441636 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-service-ca\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.441670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441661 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-trusted-ca-bundle\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.441954 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441717 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-oauth-config\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.441954 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441764 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f996f\" (UniqueName: \"kubernetes.io/projected/490640ab-d78b-4ef0-b42a-779a8caf2fd7-kube-api-access-f996f\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.441954 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441790 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-oauth-serving-cert\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.441954 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.441840 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-config\") pod \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\" (UID: \"490640ab-d78b-4ef0-b42a-779a8caf2fd7\") " Jul 01 17:02:30.442157 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.442006 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-service-ca" (OuterVolumeSpecName: "service-ca") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:02:30.442211 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.442176 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:02:30.442427 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.442397 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-config" (OuterVolumeSpecName: "console-config") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:02:30.442525 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.442402 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 17:02:30.444035 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.444012 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490640ab-d78b-4ef0-b42a-779a8caf2fd7-kube-api-access-f996f" (OuterVolumeSpecName: "kube-api-access-f996f") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "kube-api-access-f996f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:02:30.444035 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.444019 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:02:30.444174 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.444084 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "490640ab-d78b-4ef0-b42a-779a8caf2fd7" (UID: "490640ab-d78b-4ef0-b42a-779a8caf2fd7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 17:02:30.542585 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542551 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-trusted-ca-bundle\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.542585 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542576 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-oauth-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.542585 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542589 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f996f\" (UniqueName: \"kubernetes.io/projected/490640ab-d78b-4ef0-b42a-779a8caf2fd7-kube-api-access-f996f\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.542823 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542604 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-oauth-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.542823 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542617 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-config\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.542823 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542628 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/490640ab-d78b-4ef0-b42a-779a8caf2fd7-console-serving-cert\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.542823 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.542639 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/490640ab-d78b-4ef0-b42a-779a8caf2fd7-service-ca\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:02:30.731191 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.731163 2572 generic.go:356] "Generic (PLEG): container finished" podID="490640ab-d78b-4ef0-b42a-779a8caf2fd7" containerID="986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb" exitCode=0 Jul 01 17:02:30.731366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.731217 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5c766d94-gr4xz" Jul 01 17:02:30.731366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.731219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5c766d94-gr4xz" event={"ID":"490640ab-d78b-4ef0-b42a-779a8caf2fd7","Type":"ContainerDied","Data":"986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb"} Jul 01 17:02:30.731366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.731328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5c766d94-gr4xz" event={"ID":"490640ab-d78b-4ef0-b42a-779a8caf2fd7","Type":"ContainerDied","Data":"731834dfbf2073525273888e8943708cde2d06c93c6d2926115287337b80ce82"} Jul 01 17:02:30.731366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.731349 2572 scope.go:117] "RemoveContainer" containerID="986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb" Jul 01 17:02:30.739190 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.739178 2572 scope.go:117] "RemoveContainer" containerID="986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb" Jul 01 17:02:30.739456 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:02:30.739438 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb\": container with ID starting with 986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb not found: ID does not exist" containerID="986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb" Jul 01 17:02:30.739499 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.739463 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb"} err="failed to get container status \"986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb\": rpc error: code = NotFound desc = could not find container \"986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb\": container with ID starting with 986a3f017630a02a2091b9b41055ae68a84742f25a3030eae0ec42b7e68374fb not found: ID does not exist" Jul 01 17:02:30.750366 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.750342 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5c766d94-gr4xz"] Jul 01 17:02:30.756242 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:30.756222 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5c766d94-gr4xz"] Jul 01 17:02:32.649923 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:32.649885 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490640ab-d78b-4ef0-b42a-779a8caf2fd7" path="/var/lib/kubelet/pods/490640ab-d78b-4ef0-b42a-779a8caf2fd7/volumes" Jul 01 17:02:51.315358 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:51.315317 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:51.379140 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:51.379105 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:56.762625 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:56.762589 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:02:56.979630 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:56.979598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:02:56.994324 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:56.994300 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:02:57.845586 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:02:57.845556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 17:03:09.271398 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:09.271363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:09.364962 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:09.364927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:09.586460 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:09.586350 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:09.692221 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:09.692183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:09.952816 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:09.952725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:26.734643 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:26.734605 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:32.432242 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:32.432200 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:32.575701 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:32.575651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:37.554819 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:37.554778 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:38.143922 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:38.143884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:38.276344 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:38.276314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:38.899259 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:38.899224 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.105935 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.105898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.204443 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.204354 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.303462 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.303428 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.405164 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.405124 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.601873 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.601837 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.701841 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.701810 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:39.802474 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:39.802445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:03:48.581246 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:48.581217 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:03:48.581842 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:48.581338 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:03:48.586574 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:03:48.586558 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 17:04:38.081246 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:04:38.081210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:04:40.529109 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:04:40.529032 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:01.203222 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:01.203185 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:01.316984 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:01.316946 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:01.417533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:01.417494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:01.518397 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:01.518361 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:01.756690 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:01.756655 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:02.028314 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:02.028267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:05:02.111122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:05:02.111081 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:04.678013 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:04.677974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:14.939575 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:14.939486 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:15.039648 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.039610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:15.143169 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.143138 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:15.679816 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.679781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:15.778326 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.778289 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:15.894644 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.894610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:15.918464 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.918433 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-pfg7r"] Jul 01 17:06:15.918865 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.918838 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490640ab-d78b-4ef0-b42a-779a8caf2fd7" containerName="console" Jul 01 17:06:15.918865 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.918860 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="490640ab-d78b-4ef0-b42a-779a8caf2fd7" containerName="console" Jul 01 17:06:15.919064 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.918920 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="490640ab-d78b-4ef0-b42a-779a8caf2fd7" containerName="console" Jul 01 17:06:15.921840 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.921820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:15.924377 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.924354 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 17:06:15.924484 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.924357 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 17:06:15.925349 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.925333 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-rjntg\"" Jul 01 17:06:15.925446 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.925349 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 01 17:06:15.939084 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.938988 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-pfg7r"] Jul 01 17:06:15.979208 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:15.979151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:16.039302 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.039277 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zlzq\" (UniqueName: \"kubernetes.io/projected/66b310f3-2447-476a-ae78-d56894a8be7d-kube-api-access-2zlzq\") pod \"odh-model-controller-84b54b7f97-pfg7r\" (UID: \"66b310f3-2447-476a-ae78-d56894a8be7d\") " pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.039409 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.039326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b310f3-2447-476a-ae78-d56894a8be7d-cert\") pod \"odh-model-controller-84b54b7f97-pfg7r\" (UID: \"66b310f3-2447-476a-ae78-d56894a8be7d\") " pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.078719 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.078668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:16.140398 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.140377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b310f3-2447-476a-ae78-d56894a8be7d-cert\") pod \"odh-model-controller-84b54b7f97-pfg7r\" (UID: \"66b310f3-2447-476a-ae78-d56894a8be7d\") " pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.140513 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.140431 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zlzq\" (UniqueName: \"kubernetes.io/projected/66b310f3-2447-476a-ae78-d56894a8be7d-kube-api-access-2zlzq\") pod \"odh-model-controller-84b54b7f97-pfg7r\" (UID: \"66b310f3-2447-476a-ae78-d56894a8be7d\") " pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.142754 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.142734 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66b310f3-2447-476a-ae78-d56894a8be7d-cert\") pod \"odh-model-controller-84b54b7f97-pfg7r\" (UID: \"66b310f3-2447-476a-ae78-d56894a8be7d\") " pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.155163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.155139 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zlzq\" (UniqueName: \"kubernetes.io/projected/66b310f3-2447-476a-ae78-d56894a8be7d-kube-api-access-2zlzq\") pod \"odh-model-controller-84b54b7f97-pfg7r\" (UID: \"66b310f3-2447-476a-ae78-d56894a8be7d\") " pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.231288 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.231264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:16.361177 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.361148 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-pfg7r"] Jul 01 17:06:16.364139 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:06:16.364107 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b310f3_2447_476a_ae78_d56894a8be7d.slice/crio-f8c26a194cd08905f5c5e549d3f9c5316df631e28bcf36cbfe4ceb365c1d2fac WatchSource:0}: Error finding container f8c26a194cd08905f5c5e549d3f9c5316df631e28bcf36cbfe4ceb365c1d2fac: Status 404 returned error can't find the container with id f8c26a194cd08905f5c5e549d3f9c5316df631e28bcf36cbfe4ceb365c1d2fac Jul 01 17:06:16.365412 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.365396 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:06:16.562956 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.562879 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" event={"ID":"66b310f3-2447-476a-ae78-d56894a8be7d","Type":"ContainerStarted","Data":"f8c26a194cd08905f5c5e549d3f9c5316df631e28bcf36cbfe4ceb365c1d2fac"} Jul 01 17:06:16.701135 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.701094 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:16.799596 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:16.799536 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:20.586766 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:20.586727 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" event={"ID":"66b310f3-2447-476a-ae78-d56894a8be7d","Type":"ContainerStarted","Data":"248c30f254ba5699c0973e67d3482866a09a989bd6c8174eb2f044c14ce4f9ce"} Jul 01 17:06:20.587161 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:20.586862 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:20.606099 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:20.606058 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" podStartSLOduration=2.110953694 podStartE2EDuration="5.606046651s" totalImagesPullingTime="3.495092957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:06:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:06:20.605233783 +0000 UTC m=+452.442578559" watchObservedRunningTime="2026-07-01 17:06:20.606046651 +0000 UTC m=+452.443391402" Jul 01 17:06:25.874602 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:25.874542 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:25.978058 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:25.978022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:06:31.592661 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:31.592630 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-pfg7r" Jul 01 17:06:32.540335 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.540302 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-plkbr"] Jul 01 17:06:32.543740 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.543722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-plkbr" Jul 01 17:06:32.546418 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.546397 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mwfdx\"" Jul 01 17:06:32.546535 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.546519 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 17:06:32.557732 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.557707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-plkbr"] Jul 01 17:06:32.680038 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.680004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5xj\" (UniqueName: \"kubernetes.io/projected/735da0c7-baf7-40eb-9dc4-e63bb099518b-kube-api-access-dz5xj\") pod \"s3-init-plkbr\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " pod="kserve/s3-init-plkbr" Jul 01 17:06:32.680459 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.680063 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/735da0c7-baf7-40eb-9dc4-e63bb099518b-model-cache\") pod \"s3-init-plkbr\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " pod="kserve/s3-init-plkbr" Jul 01 17:06:32.780622 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.780588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5xj\" (UniqueName: \"kubernetes.io/projected/735da0c7-baf7-40eb-9dc4-e63bb099518b-kube-api-access-dz5xj\") pod \"s3-init-plkbr\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " pod="kserve/s3-init-plkbr" Jul 01 17:06:32.780975 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.780949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/735da0c7-baf7-40eb-9dc4-e63bb099518b-model-cache\") pod \"s3-init-plkbr\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " pod="kserve/s3-init-plkbr" Jul 01 17:06:32.781538 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.781517 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/735da0c7-baf7-40eb-9dc4-e63bb099518b-model-cache\") pod \"s3-init-plkbr\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " pod="kserve/s3-init-plkbr" Jul 01 17:06:32.792846 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.792785 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5xj\" (UniqueName: \"kubernetes.io/projected/735da0c7-baf7-40eb-9dc4-e63bb099518b-kube-api-access-dz5xj\") pod \"s3-init-plkbr\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " pod="kserve/s3-init-plkbr" Jul 01 17:06:32.865299 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:32.865269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-plkbr" Jul 01 17:06:33.005824 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:33.005793 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-plkbr"] Jul 01 17:06:33.009413 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:06:33.009383 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod735da0c7_baf7_40eb_9dc4_e63bb099518b.slice/crio-c6a93cf16f37ee56ab085232fecb03de5e49ff0fdd1a21d559157e7544995e65 WatchSource:0}: Error finding container c6a93cf16f37ee56ab085232fecb03de5e49ff0fdd1a21d559157e7544995e65: Status 404 returned error can't find the container with id c6a93cf16f37ee56ab085232fecb03de5e49ff0fdd1a21d559157e7544995e65 Jul 01 17:06:33.636699 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:33.636647 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-plkbr" event={"ID":"735da0c7-baf7-40eb-9dc4-e63bb099518b","Type":"ContainerStarted","Data":"c6a93cf16f37ee56ab085232fecb03de5e49ff0fdd1a21d559157e7544995e65"} Jul 01 17:06:37.656475 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:37.656376 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-plkbr" event={"ID":"735da0c7-baf7-40eb-9dc4-e63bb099518b","Type":"ContainerStarted","Data":"ed33423d56f0c397400999d387b8fdfc97eb0c343ec2908fac99050d44a3c70b"} Jul 01 17:06:39.665728 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:39.665673 2572 generic.go:356] "Generic (PLEG): container finished" podID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerID="ed33423d56f0c397400999d387b8fdfc97eb0c343ec2908fac99050d44a3c70b" exitCode=0 Jul 01 17:06:39.666094 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:39.665747 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-plkbr" event={"ID":"735da0c7-baf7-40eb-9dc4-e63bb099518b","Type":"ContainerDied","Data":"ed33423d56f0c397400999d387b8fdfc97eb0c343ec2908fac99050d44a3c70b"} Jul 01 17:06:44.688487 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:44.688451 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-plkbr" event={"ID":"735da0c7-baf7-40eb-9dc4-e63bb099518b","Type":"ContainerStarted","Data":"19488ba8e0d6fa7b603beaef6b3b654986e0d3d84c44354e9031f485132d3e13"} Jul 01 17:06:44.712019 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:06:44.711964 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-plkbr" podStartSLOduration=1.908131825 podStartE2EDuration="12.711946054s" totalImagesPullingTime="9.120457162s" totalInitContainerRuntime="1.683357067s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:06:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:06:44.710182085 +0000 UTC m=+476.547526836" watchObservedRunningTime="2026-07-01 17:06:44.711946054 +0000 UTC m=+476.549290815" Jul 01 17:07:46.471267 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:46.471174 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:07:48.117788 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:48.117753 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:07:49.938173 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:49.938094 2572 generic.go:356] "Generic (PLEG): container finished" podID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerID="19488ba8e0d6fa7b603beaef6b3b654986e0d3d84c44354e9031f485132d3e13" exitCode=0 Jul 01 17:07:49.938549 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:49.938165 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-plkbr" event={"ID":"735da0c7-baf7-40eb-9dc4-e63bb099518b","Type":"ContainerDied","Data":"19488ba8e0d6fa7b603beaef6b3b654986e0d3d84c44354e9031f485132d3e13"} Jul 01 17:07:51.064247 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.064215 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-plkbr" Jul 01 17:07:51.104412 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.104390 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz5xj\" (UniqueName: \"kubernetes.io/projected/735da0c7-baf7-40eb-9dc4-e63bb099518b-kube-api-access-dz5xj\") pod \"735da0c7-baf7-40eb-9dc4-e63bb099518b\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " Jul 01 17:07:51.104551 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.104469 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/735da0c7-baf7-40eb-9dc4-e63bb099518b-model-cache\") pod \"735da0c7-baf7-40eb-9dc4-e63bb099518b\" (UID: \"735da0c7-baf7-40eb-9dc4-e63bb099518b\") " Jul 01 17:07:51.106443 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.106419 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735da0c7-baf7-40eb-9dc4-e63bb099518b-kube-api-access-dz5xj" (OuterVolumeSpecName: "kube-api-access-dz5xj") pod "735da0c7-baf7-40eb-9dc4-e63bb099518b" (UID: "735da0c7-baf7-40eb-9dc4-e63bb099518b"). InnerVolumeSpecName "kube-api-access-dz5xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:07:51.123343 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.123316 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/735da0c7-baf7-40eb-9dc4-e63bb099518b-model-cache" (OuterVolumeSpecName: "model-cache") pod "735da0c7-baf7-40eb-9dc4-e63bb099518b" (UID: "735da0c7-baf7-40eb-9dc4-e63bb099518b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:07:51.205030 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.204974 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/735da0c7-baf7-40eb-9dc4-e63bb099518b-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:07:51.205030 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.205000 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz5xj\" (UniqueName: \"kubernetes.io/projected/735da0c7-baf7-40eb-9dc4-e63bb099518b-kube-api-access-dz5xj\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:07:51.946770 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.946735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-plkbr" event={"ID":"735da0c7-baf7-40eb-9dc4-e63bb099518b","Type":"ContainerDied","Data":"c6a93cf16f37ee56ab085232fecb03de5e49ff0fdd1a21d559157e7544995e65"} Jul 01 17:07:51.946770 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.946763 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-plkbr" Jul 01 17:07:51.947031 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:51.946772 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6a93cf16f37ee56ab085232fecb03de5e49ff0fdd1a21d559157e7544995e65" Jul 01 17:07:52.852155 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:07:52.852116 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:13.966128 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:13.966087 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:25.820649 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.820614 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-8tqsj"] Jul 01 17:08:25.821122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.820962 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerName="s3-init" Jul 01 17:08:25.821122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.820977 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerName="s3-init" Jul 01 17:08:25.821122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.820994 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerName="download-hf-model" Jul 01 17:08:25.821122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.820999 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerName="download-hf-model" Jul 01 17:08:25.821122 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.821059 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="735da0c7-baf7-40eb-9dc4-e63bb099518b" containerName="s3-init" Jul 01 17:08:25.824086 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.824062 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:25.827041 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.827021 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 01 17:08:25.827518 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.827492 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mwfdx\"" Jul 01 17:08:25.839816 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.839792 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-8tqsj"] Jul 01 17:08:25.986804 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.986759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5jx\" (UniqueName: \"kubernetes.io/projected/1cc0836d-9a5e-4649-b7f6-f055de8541dd-kube-api-access-lg5jx\") pod \"s3-tls-init-custom-8tqsj\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:25.986970 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:25.986826 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc0836d-9a5e-4649-b7f6-f055de8541dd-model-cache\") pod \"s3-tls-init-custom-8tqsj\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:26.087500 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:26.087407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5jx\" (UniqueName: \"kubernetes.io/projected/1cc0836d-9a5e-4649-b7f6-f055de8541dd-kube-api-access-lg5jx\") pod \"s3-tls-init-custom-8tqsj\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:26.087500 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:26.087467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc0836d-9a5e-4649-b7f6-f055de8541dd-model-cache\") pod \"s3-tls-init-custom-8tqsj\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:26.087878 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:26.087858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc0836d-9a5e-4649-b7f6-f055de8541dd-model-cache\") pod \"s3-tls-init-custom-8tqsj\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:26.097088 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:26.097065 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5jx\" (UniqueName: \"kubernetes.io/projected/1cc0836d-9a5e-4649-b7f6-f055de8541dd-kube-api-access-lg5jx\") pod \"s3-tls-init-custom-8tqsj\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:26.144733 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:26.144706 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:26.277219 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:26.277197 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-8tqsj"] Jul 01 17:08:26.279404 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:08:26.279375 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1cc0836d_9a5e_4649_b7f6_f055de8541dd.slice/crio-a0773ece3b2176ccd95cc9bb02e41d7f696806d87baa0d1c9f520f89f17a3bb0 WatchSource:0}: Error finding container a0773ece3b2176ccd95cc9bb02e41d7f696806d87baa0d1c9f520f89f17a3bb0: Status 404 returned error can't find the container with id a0773ece3b2176ccd95cc9bb02e41d7f696806d87baa0d1c9f520f89f17a3bb0 Jul 01 17:08:27.082133 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:27.082090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-8tqsj" event={"ID":"1cc0836d-9a5e-4649-b7f6-f055de8541dd","Type":"ContainerStarted","Data":"036edf940cd1066353266dc7d1edd92338d8a48763ffa052aea2ce58e8ab70fa"} Jul 01 17:08:27.082759 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:27.082144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-8tqsj" event={"ID":"1cc0836d-9a5e-4649-b7f6-f055de8541dd","Type":"ContainerStarted","Data":"a0773ece3b2176ccd95cc9bb02e41d7f696806d87baa0d1c9f520f89f17a3bb0"} Jul 01 17:08:28.086948 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:28.086865 2572 generic.go:356] "Generic (PLEG): container finished" podID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerID="036edf940cd1066353266dc7d1edd92338d8a48763ffa052aea2ce58e8ab70fa" exitCode=0 Jul 01 17:08:28.086948 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:28.086930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-8tqsj" event={"ID":"1cc0836d-9a5e-4649-b7f6-f055de8541dd","Type":"ContainerDied","Data":"036edf940cd1066353266dc7d1edd92338d8a48763ffa052aea2ce58e8ab70fa"} Jul 01 17:08:29.092775 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:29.092739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-8tqsj" event={"ID":"1cc0836d-9a5e-4649-b7f6-f055de8541dd","Type":"ContainerStarted","Data":"2f1bdc2381f95e3291f6876f45b30d31c75c76b71f8ef34aa48249f841d5fa32"} Jul 01 17:08:29.116879 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:29.115564 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-8tqsj" podStartSLOduration=2.664785026 podStartE2EDuration="4.115541215s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.450756189s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:08:29.115166199 +0000 UTC m=+580.952510950" watchObservedRunningTime="2026-07-01 17:08:29.115541215 +0000 UTC m=+580.952885966" Jul 01 17:08:35.117753 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:35.117718 2572 generic.go:356] "Generic (PLEG): container finished" podID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerID="2f1bdc2381f95e3291f6876f45b30d31c75c76b71f8ef34aa48249f841d5fa32" exitCode=0 Jul 01 17:08:35.118150 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:35.117759 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-8tqsj" event={"ID":"1cc0836d-9a5e-4649-b7f6-f055de8541dd","Type":"ContainerDied","Data":"2f1bdc2381f95e3291f6876f45b30d31c75c76b71f8ef34aa48249f841d5fa32"} Jul 01 17:08:36.261936 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.261912 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:36.375908 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.375826 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc0836d-9a5e-4649-b7f6-f055de8541dd-model-cache\") pod \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " Jul 01 17:08:36.375908 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.375869 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg5jx\" (UniqueName: \"kubernetes.io/projected/1cc0836d-9a5e-4649-b7f6-f055de8541dd-kube-api-access-lg5jx\") pod \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\" (UID: \"1cc0836d-9a5e-4649-b7f6-f055de8541dd\") " Jul 01 17:08:36.377934 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.377907 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc0836d-9a5e-4649-b7f6-f055de8541dd-kube-api-access-lg5jx" (OuterVolumeSpecName: "kube-api-access-lg5jx") pod "1cc0836d-9a5e-4649-b7f6-f055de8541dd" (UID: "1cc0836d-9a5e-4649-b7f6-f055de8541dd"). InnerVolumeSpecName "kube-api-access-lg5jx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:08:36.398268 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.398230 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc0836d-9a5e-4649-b7f6-f055de8541dd-model-cache" (OuterVolumeSpecName: "model-cache") pod "1cc0836d-9a5e-4649-b7f6-f055de8541dd" (UID: "1cc0836d-9a5e-4649-b7f6-f055de8541dd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:08:36.477088 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.477055 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1cc0836d-9a5e-4649-b7f6-f055de8541dd-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:08:36.477088 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:36.477084 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg5jx\" (UniqueName: \"kubernetes.io/projected/1cc0836d-9a5e-4649-b7f6-f055de8541dd-kube-api-access-lg5jx\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:08:37.127016 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:37.126991 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-8tqsj" Jul 01 17:08:37.127171 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:37.126988 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-8tqsj" event={"ID":"1cc0836d-9a5e-4649-b7f6-f055de8541dd","Type":"ContainerDied","Data":"a0773ece3b2176ccd95cc9bb02e41d7f696806d87baa0d1c9f520f89f17a3bb0"} Jul 01 17:08:37.127171 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:37.127103 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0773ece3b2176ccd95cc9bb02e41d7f696806d87baa0d1c9f520f89f17a3bb0" Jul 01 17:08:37.828264 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:37.828226 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:38.039254 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:38.039221 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:43.778328 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.778290 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-gzmmp"] Jul 01 17:08:43.778726 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.778587 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerName="download-hf-model" Jul 01 17:08:43.778726 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.778598 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerName="download-hf-model" Jul 01 17:08:43.778726 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.778613 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerName="s3-tls-init-custom" Jul 01 17:08:43.778726 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.778619 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerName="s3-tls-init-custom" Jul 01 17:08:43.778726 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.778693 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc0836d-9a5e-4649-b7f6-f055de8541dd" containerName="s3-tls-init-custom" Jul 01 17:08:43.781580 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.781562 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:43.784304 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.784281 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-mwfdx\"" Jul 01 17:08:43.784548 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.784529 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 01 17:08:43.794307 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.794281 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-gzmmp"] Jul 01 17:08:43.834185 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.834152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c37c9c0-b70e-408e-b32a-7832243c4c18-model-cache\") pod \"s3-tls-init-serving-gzmmp\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:43.834345 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.834203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mggpc\" (UniqueName: \"kubernetes.io/projected/6c37c9c0-b70e-408e-b32a-7832243c4c18-kube-api-access-mggpc\") pod \"s3-tls-init-serving-gzmmp\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:43.935256 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.935224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c37c9c0-b70e-408e-b32a-7832243c4c18-model-cache\") pod \"s3-tls-init-serving-gzmmp\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:43.935332 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.935268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mggpc\" (UniqueName: \"kubernetes.io/projected/6c37c9c0-b70e-408e-b32a-7832243c4c18-kube-api-access-mggpc\") pod \"s3-tls-init-serving-gzmmp\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:43.935724 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.935703 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c37c9c0-b70e-408e-b32a-7832243c4c18-model-cache\") pod \"s3-tls-init-serving-gzmmp\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:43.944757 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:43.944732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mggpc\" (UniqueName: \"kubernetes.io/projected/6c37c9c0-b70e-408e-b32a-7832243c4c18-kube-api-access-mggpc\") pod \"s3-tls-init-serving-gzmmp\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:44.097980 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:44.097883 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:44.226792 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:44.226769 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-gzmmp"] Jul 01 17:08:44.229287 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:08:44.229258 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c37c9c0_b70e_408e_b32a_7832243c4c18.slice/crio-a18d885798fa7d30f09d0d8cc05998fdf8da603e00c8ea467c867aa83c5a57b3 WatchSource:0}: Error finding container a18d885798fa7d30f09d0d8cc05998fdf8da603e00c8ea467c867aa83c5a57b3: Status 404 returned error can't find the container with id a18d885798fa7d30f09d0d8cc05998fdf8da603e00c8ea467c867aa83c5a57b3 Jul 01 17:08:45.164993 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:45.164951 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-gzmmp" event={"ID":"6c37c9c0-b70e-408e-b32a-7832243c4c18","Type":"ContainerStarted","Data":"02441eb6d5b17eacc0d1544881ca4f4d094e5faf9d733ab227eb20ff3d0397de"} Jul 01 17:08:45.165374 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:45.165002 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-gzmmp" event={"ID":"6c37c9c0-b70e-408e-b32a-7832243c4c18","Type":"ContainerStarted","Data":"a18d885798fa7d30f09d0d8cc05998fdf8da603e00c8ea467c867aa83c5a57b3"} Jul 01 17:08:46.170105 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:46.170069 2572 generic.go:356] "Generic (PLEG): container finished" podID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerID="02441eb6d5b17eacc0d1544881ca4f4d094e5faf9d733ab227eb20ff3d0397de" exitCode=0 Jul 01 17:08:46.170506 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:46.170123 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-gzmmp" event={"ID":"6c37c9c0-b70e-408e-b32a-7832243c4c18","Type":"ContainerDied","Data":"02441eb6d5b17eacc0d1544881ca4f4d094e5faf9d733ab227eb20ff3d0397de"} Jul 01 17:08:47.175565 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:47.175532 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-gzmmp" event={"ID":"6c37c9c0-b70e-408e-b32a-7832243c4c18","Type":"ContainerStarted","Data":"17f7342bc4da12c318a2cc11f3568c1f6a844de7d2f385c4264608e2600daa71"} Jul 01 17:08:47.196790 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:47.196734 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-gzmmp" podStartSLOduration=2.501295591 podStartE2EDuration="4.196714462s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.695418871s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:08:47.196253847 +0000 UTC m=+599.033598598" watchObservedRunningTime="2026-07-01 17:08:47.196714462 +0000 UTC m=+599.034059212" Jul 01 17:08:48.608756 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:48.608727 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:08:48.609439 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:48.609419 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:08:52.640916 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:52.640877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:52.741800 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:52.741761 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:53.201206 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:53.201173 2572 generic.go:356] "Generic (PLEG): container finished" podID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerID="17f7342bc4da12c318a2cc11f3568c1f6a844de7d2f385c4264608e2600daa71" exitCode=0 Jul 01 17:08:53.201386 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:53.201238 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-gzmmp" event={"ID":"6c37c9c0-b70e-408e-b32a-7832243c4c18","Type":"ContainerDied","Data":"17f7342bc4da12c318a2cc11f3568c1f6a844de7d2f385c4264608e2600daa71"} Jul 01 17:08:54.333840 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.333816 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:54.414123 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.414089 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c37c9c0-b70e-408e-b32a-7832243c4c18-model-cache\") pod \"6c37c9c0-b70e-408e-b32a-7832243c4c18\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " Jul 01 17:08:54.414298 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.414191 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mggpc\" (UniqueName: \"kubernetes.io/projected/6c37c9c0-b70e-408e-b32a-7832243c4c18-kube-api-access-mggpc\") pod \"6c37c9c0-b70e-408e-b32a-7832243c4c18\" (UID: \"6c37c9c0-b70e-408e-b32a-7832243c4c18\") " Jul 01 17:08:54.416220 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.416190 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c37c9c0-b70e-408e-b32a-7832243c4c18-kube-api-access-mggpc" (OuterVolumeSpecName: "kube-api-access-mggpc") pod "6c37c9c0-b70e-408e-b32a-7832243c4c18" (UID: "6c37c9c0-b70e-408e-b32a-7832243c4c18"). InnerVolumeSpecName "kube-api-access-mggpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:08:54.436072 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.436047 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c37c9c0-b70e-408e-b32a-7832243c4c18-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c37c9c0-b70e-408e-b32a-7832243c4c18" (UID: "6c37c9c0-b70e-408e-b32a-7832243c4c18"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:08:54.515630 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.515599 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mggpc\" (UniqueName: \"kubernetes.io/projected/6c37c9c0-b70e-408e-b32a-7832243c4c18-kube-api-access-mggpc\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:08:54.515630 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:54.515626 2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c37c9c0-b70e-408e-b32a-7832243c4c18-model-cache\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:08:55.210064 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:55.210031 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-gzmmp" event={"ID":"6c37c9c0-b70e-408e-b32a-7832243c4c18","Type":"ContainerDied","Data":"a18d885798fa7d30f09d0d8cc05998fdf8da603e00c8ea467c867aa83c5a57b3"} Jul 01 17:08:55.210064 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:55.210049 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-gzmmp" Jul 01 17:08:55.210064 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:55.210070 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a18d885798fa7d30f09d0d8cc05998fdf8da603e00c8ea467c867aa83c5a57b3" Jul 01 17:08:55.629198 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:55.629160 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:08:55.754233 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:08:55.754205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:09:06.946670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:09:06.946635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:09:07.298412 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:09:07.298376 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:11:02.211893 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:11:02.211859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:11:04.151139 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:11:04.151103 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:12:27.193410 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:12:27.193329 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:12:27.314370 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:12:27.314292 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:12:27.391030 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:12:27.390989 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:12:27.655394 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:12:27.655363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:12:47.402223 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:12:47.402187 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:12:47.602364 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:12:47.602328 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:13:07.547952 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:13:07.547908 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:13:48.634573 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:13:48.634495 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:13:48.636017 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:13:48.635998 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:14:12.686516 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:14:12.686477 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:14:12.751945 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:14:12.751904 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:17:33.000514 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:17:33.000478 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:17:38.195237 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:17:38.195188 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:17:38.617749 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:17:38.617711 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:18:25.676978 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:18:25.676885 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:18:25.737612 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:18:25.737580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:18:48.661300 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:18:48.661271 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:18:48.662221 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:18:48.662202 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:19:48.419703 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:19:48.419583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.436163 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:19:53.436115 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:19:53.712769 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:19:53.712659 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:23.531751 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:21:23.531645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:23.967864 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:21:23.967788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:53.669956 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:21:53.669922 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:58.746693 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:21:58.746638 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:21:59.001915 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:21:59.001813 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:23:48.685898 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:23:48.685867 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:23:48.687411 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:23:48.687391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:24:10.821781 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:10.821697 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:14.037876 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:14.037837 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:14.446067 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:14.445981 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:44.897368 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:44.897331 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:50.819696 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.819642 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ds7g7/must-gather-nbq58"] Jul 01 17:24:50.820055 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.819937 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerName="s3-tls-init-serving" Jul 01 17:24:50.820055 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.819948 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerName="s3-tls-init-serving" Jul 01 17:24:50.820055 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.819959 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerName="download-hf-model" Jul 01 17:24:50.820055 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.819965 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerName="download-hf-model" Jul 01 17:24:50.820055 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.820017 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c37c9c0-b70e-408e-b32a-7832243c4c18" containerName="s3-tls-init-serving" Jul 01 17:24:50.823008 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.822986 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:50.827596 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.827575 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ds7g7\"/\"openshift-service-ca.crt\"" Jul 01 17:24:50.827596 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.827580 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ds7g7\"/\"default-dockercfg-9d7hl\"" Jul 01 17:24:50.828626 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.828589 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ds7g7\"/\"kube-root-ca.crt\"" Jul 01 17:24:50.837191 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.837169 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds7g7/must-gather-nbq58"] Jul 01 17:24:50.889053 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.889020 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aeec5e06-9ee7-44bc-9d61-6055023e718d-must-gather-output\") pod \"must-gather-nbq58\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:50.889184 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.889075 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmt4b\" (UniqueName: \"kubernetes.io/projected/aeec5e06-9ee7-44bc-9d61-6055023e718d-kube-api-access-nmt4b\") pod \"must-gather-nbq58\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:50.989634 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.989598 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmt4b\" (UniqueName: \"kubernetes.io/projected/aeec5e06-9ee7-44bc-9d61-6055023e718d-kube-api-access-nmt4b\") pod \"must-gather-nbq58\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:50.989813 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.989676 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aeec5e06-9ee7-44bc-9d61-6055023e718d-must-gather-output\") pod \"must-gather-nbq58\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:50.990033 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.990014 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aeec5e06-9ee7-44bc-9d61-6055023e718d-must-gather-output\") pod \"must-gather-nbq58\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:50.999131 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:50.999098 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmt4b\" (UniqueName: \"kubernetes.io/projected/aeec5e06-9ee7-44bc-9d61-6055023e718d-kube-api-access-nmt4b\") pod \"must-gather-nbq58\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:51.142050 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:51.141978 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:24:51.266376 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:51.266347 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds7g7/must-gather-nbq58"] Jul 01 17:24:51.268955 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:24:51.268920 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeec5e06_9ee7_44bc_9d61_6055023e718d.slice/crio-cc3b3b6d4f953ec0ff8b8d49134d3b030046df2d1bde7bea4d0b735e261682c4 WatchSource:0}: Error finding container cc3b3b6d4f953ec0ff8b8d49134d3b030046df2d1bde7bea4d0b735e261682c4: Status 404 returned error can't find the container with id cc3b3b6d4f953ec0ff8b8d49134d3b030046df2d1bde7bea4d0b735e261682c4 Jul 01 17:24:51.270796 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:51.270780 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 17:24:51.704501 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:51.704467 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:51.913517 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:51.913481 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds7g7/must-gather-nbq58" event={"ID":"aeec5e06-9ee7-44bc-9d61-6055023e718d","Type":"ContainerStarted","Data":"cc3b3b6d4f953ec0ff8b8d49134d3b030046df2d1bde7bea4d0b735e261682c4"} Jul 01 17:24:52.083848 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:52.083811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:24:58.955215 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:58.955176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds7g7/must-gather-nbq58" event={"ID":"aeec5e06-9ee7-44bc-9d61-6055023e718d","Type":"ContainerStarted","Data":"f611ff945e4e7e03546e0dda670a3506cf1c531c69ff31e242211b7688a84fd2"} Jul 01 17:24:58.955215 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:24:58.955226 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds7g7/must-gather-nbq58" event={"ID":"aeec5e06-9ee7-44bc-9d61-6055023e718d","Type":"ContainerStarted","Data":"42d9657d0d717f8f6ee685779ca1a36be77c2c0a8322c715ff91fc006e251fa1"} Jul 01 17:25:19.042077 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:19.042043 2572 generic.go:356] "Generic (PLEG): container finished" podID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerID="42d9657d0d717f8f6ee685779ca1a36be77c2c0a8322c715ff91fc006e251fa1" exitCode=0 Jul 01 17:25:19.042537 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:19.042118 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds7g7/must-gather-nbq58" event={"ID":"aeec5e06-9ee7-44bc-9d61-6055023e718d","Type":"ContainerDied","Data":"42d9657d0d717f8f6ee685779ca1a36be77c2c0a8322c715ff91fc006e251fa1"} Jul 01 17:25:19.042537 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:19.042428 2572 scope.go:117] "RemoveContainer" containerID="42d9657d0d717f8f6ee685779ca1a36be77c2c0a8322c715ff91fc006e251fa1" Jul 01 17:25:19.568589 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:19.568563 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ds7g7_must-gather-nbq58_aeec5e06-9ee7-44bc-9d61-6055023e718d/gather/0.log" Jul 01 17:25:19.984789 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:19.984760 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:20.145595 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.145561 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4lxfx/must-gather-qr5fh"] Jul 01 17:25:20.148772 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.148756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.151891 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.151870 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4lxfx\"/\"kube-root-ca.crt\"" Jul 01 17:25:20.152000 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.151944 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4lxfx\"/\"default-dockercfg-wjjmk\"" Jul 01 17:25:20.153002 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.152984 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4lxfx\"/\"openshift-service-ca.crt\"" Jul 01 17:25:20.159408 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.159381 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:20.160606 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.160586 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lxfx/must-gather-qr5fh"] Jul 01 17:25:20.258480 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.258392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9ln\" (UniqueName: \"kubernetes.io/projected/8caec451-ce33-479e-9876-6767b1aca98d-kube-api-access-sc9ln\") pod \"must-gather-qr5fh\" (UID: \"8caec451-ce33-479e-9876-6767b1aca98d\") " pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.258480 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.258434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8caec451-ce33-479e-9876-6767b1aca98d-must-gather-output\") pod \"must-gather-qr5fh\" (UID: \"8caec451-ce33-479e-9876-6767b1aca98d\") " pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.262346 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.262322 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:20.359897 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.359868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9ln\" (UniqueName: \"kubernetes.io/projected/8caec451-ce33-479e-9876-6767b1aca98d-kube-api-access-sc9ln\") pod \"must-gather-qr5fh\" (UID: \"8caec451-ce33-479e-9876-6767b1aca98d\") " pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.360056 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.359904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8caec451-ce33-479e-9876-6767b1aca98d-must-gather-output\") pod \"must-gather-qr5fh\" (UID: \"8caec451-ce33-479e-9876-6767b1aca98d\") " pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.360185 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.360171 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8caec451-ce33-479e-9876-6767b1aca98d-must-gather-output\") pod \"must-gather-qr5fh\" (UID: \"8caec451-ce33-479e-9876-6767b1aca98d\") " pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.370157 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.370125 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9ln\" (UniqueName: \"kubernetes.io/projected/8caec451-ce33-479e-9876-6767b1aca98d-kube-api-access-sc9ln\") pod \"must-gather-qr5fh\" (UID: \"8caec451-ce33-479e-9876-6767b1aca98d\") " pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.457834 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.457801 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxfx/must-gather-qr5fh" Jul 01 17:25:20.586404 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:20.586372 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lxfx/must-gather-qr5fh"] Jul 01 17:25:20.590183 ip-10-0-139-133 kubenswrapper[2572]: W0701 17:25:20.590159 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8caec451_ce33_479e_9876_6767b1aca98d.slice/crio-a19786aa71ab284b735440fe9ec4efa8b8b93547ae9a98fffc25dd5578e31ee8 WatchSource:0}: Error finding container a19786aa71ab284b735440fe9ec4efa8b8b93547ae9a98fffc25dd5578e31ee8: Status 404 returned error can't find the container with id a19786aa71ab284b735440fe9ec4efa8b8b93547ae9a98fffc25dd5578e31ee8 Jul 01 17:25:21.052373 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:21.052338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxfx/must-gather-qr5fh" event={"ID":"8caec451-ce33-479e-9876-6767b1aca98d","Type":"ContainerStarted","Data":"a19786aa71ab284b735440fe9ec4efa8b8b93547ae9a98fffc25dd5578e31ee8"} Jul 01 17:25:22.060736 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:22.060666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxfx/must-gather-qr5fh" event={"ID":"8caec451-ce33-479e-9876-6767b1aca98d","Type":"ContainerStarted","Data":"958a3dfa042e9e71fbc1bdb42ffd4bb20c71e856cb8992a7b17dee0be0e2c587"} Jul 01 17:25:22.061194 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:22.060754 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxfx/must-gather-qr5fh" event={"ID":"8caec451-ce33-479e-9876-6767b1aca98d","Type":"ContainerStarted","Data":"73696e8dcca38b211c018f3922bbe5a63f7bb7b93b3b5a6bc25aca79800bb2f8"} Jul 01 17:25:22.087288 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:22.087236 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4lxfx/must-gather-qr5fh" podStartSLOduration=1.428214327 podStartE2EDuration="2.087219712s" totalImagesPullingTime="659.005385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 17:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:25:22.085857573 +0000 UTC m=+1593.923202321" watchObservedRunningTime="2026-07-01 17:25:22.087219712 +0000 UTC m=+1593.924564462" Jul 01 17:25:22.729228 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:22.729194 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jxl5v_dfa80559-5b81-4609-bf42-c0dfcbbb2624/global-pull-secret-syncer/0.log" Jul 01 17:25:22.857461 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:22.857429 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" Jul 01 17:25:23.030136 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:23.030055 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-133.ec2.internal_8db664b064a3ce5093dc28d017aa9152/haproxy/0.log" Jul 01 17:25:24.950547 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:24.950503 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ds7g7/must-gather-nbq58"] Jul 01 17:25:24.951061 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:24.950766 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-ds7g7/must-gather-nbq58" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="copy" containerID="cri-o://f611ff945e4e7e03546e0dda670a3506cf1c531c69ff31e242211b7688a84fd2" gracePeriod=2 Jul 01 17:25:24.955221 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:24.955192 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ds7g7/must-gather-nbq58"] Jul 01 17:25:25.114312 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.103758 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ds7g7_must-gather-nbq58_aeec5e06-9ee7-44bc-9d61-6055023e718d/copy/0.log" Jul 01 17:25:25.114312 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.104248 2572 generic.go:356] "Generic (PLEG): container finished" podID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerID="f611ff945e4e7e03546e0dda670a3506cf1c531c69ff31e242211b7688a84fd2" exitCode=143 Jul 01 17:25:25.336161 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.336109 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ds7g7_must-gather-nbq58_aeec5e06-9ee7-44bc-9d61-6055023e718d/copy/0.log" Jul 01 17:25:25.341026 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.340803 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:25:25.344702 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:25:25.344316 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nbq58\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ds7g7\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:25:25.511721 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.511654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmt4b\" (UniqueName: \"kubernetes.io/projected/aeec5e06-9ee7-44bc-9d61-6055023e718d-kube-api-access-nmt4b\") pod \"aeec5e06-9ee7-44bc-9d61-6055023e718d\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " Jul 01 17:25:25.512138 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.512116 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aeec5e06-9ee7-44bc-9d61-6055023e718d-must-gather-output\") pod \"aeec5e06-9ee7-44bc-9d61-6055023e718d\" (UID: \"aeec5e06-9ee7-44bc-9d61-6055023e718d\") " Jul 01 17:25:25.514110 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.514049 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeec5e06-9ee7-44bc-9d61-6055023e718d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "aeec5e06-9ee7-44bc-9d61-6055023e718d" (UID: "aeec5e06-9ee7-44bc-9d61-6055023e718d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 17:25:25.514879 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.514831 2572 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/aeec5e06-9ee7-44bc-9d61-6055023e718d-must-gather-output\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:25:25.517560 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.517536 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeec5e06-9ee7-44bc-9d61-6055023e718d-kube-api-access-nmt4b" (OuterVolumeSpecName: "kube-api-access-nmt4b") pod "aeec5e06-9ee7-44bc-9d61-6055023e718d" (UID: "aeec5e06-9ee7-44bc-9d61-6055023e718d"). InnerVolumeSpecName "kube-api-access-nmt4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 17:25:25.615989 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:25.615937 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmt4b\" (UniqueName: \"kubernetes.io/projected/aeec5e06-9ee7-44bc-9d61-6055023e718d-kube-api-access-nmt4b\") on node \"ip-10-0-139-133.ec2.internal\" DevicePath \"\"" Jul 01 17:25:26.111452 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.111417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ds7g7_must-gather-nbq58_aeec5e06-9ee7-44bc-9d61-6055023e718d/copy/0.log" Jul 01 17:25:26.112077 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.111986 2572 scope.go:117] "RemoveContainer" containerID="f611ff945e4e7e03546e0dda670a3506cf1c531c69ff31e242211b7688a84fd2" Jul 01 17:25:26.112174 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.112145 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:25:26.125274 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:25:26.125231 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nbq58\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ds7g7\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:25:26.128734 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.128711 2572 scope.go:117] "RemoveContainer" containerID="42d9657d0d717f8f6ee685779ca1a36be77c2c0a8322c715ff91fc006e251fa1" Jul 01 17:25:26.135212 ip-10-0-139-133 kubenswrapper[2572]: E0701 17:25:26.134782 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nbq58\" is forbidden: User \"system:node:ip-10-0-139-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ds7g7\": no relationship found between node 'ip-10-0-139-133.ec2.internal' and this object" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" pod="openshift-must-gather-ds7g7/must-gather-nbq58" Jul 01 17:25:26.259977 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.259765 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:26.358913 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.358723 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-djk5c_5b3a1960-c420-477f-97d3-407d0ed132e3/konnectivity-agent/0.log" limit=1024 Jul 01 17:25:26.653953 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:26.653490 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" path="/var/lib/kubelet/pods/aeec5e06-9ee7-44bc-9d61-6055023e718d/volumes" Jul 01 17:25:27.500965 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.500897 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-cksr2_a3771fe5-dd5d-42f0-98fa-e889ed83f526/kube-state-metrics/0.log" Jul 01 17:25:27.546333 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.546301 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-cksr2_a3771fe5-dd5d-42f0-98fa-e889ed83f526/kube-rbac-proxy-main/0.log" Jul 01 17:25:27.584108 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.584078 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-cksr2_a3771fe5-dd5d-42f0-98fa-e889ed83f526/kube-rbac-proxy-self/0.log" Jul 01 17:25:27.796730 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.796608 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4tk7_9e58c8c6-f996-4733-82e7-8eab74e00ae7/node-exporter/0.log" Jul 01 17:25:27.825098 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.825065 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4tk7_9e58c8c6-f996-4733-82e7-8eab74e00ae7/kube-rbac-proxy/0.log" Jul 01 17:25:27.849744 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.849708 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4tk7_9e58c8c6-f996-4733-82e7-8eab74e00ae7/init-textfile/0.log" Jul 01 17:25:27.995855 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:27.995821 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-d64j4_5e10893b-df7a-4b2e-b8e6-54ad4acd177b/kube-rbac-proxy-main/0.log" Jul 01 17:25:28.029939 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.029901 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-d64j4_5e10893b-df7a-4b2e-b8e6-54ad4acd177b/kube-rbac-proxy-self/0.log" Jul 01 17:25:28.064752 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.064641 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-d64j4_5e10893b-df7a-4b2e-b8e6-54ad4acd177b/openshift-state-metrics/0.log" Jul 01 17:25:28.112762 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.112732 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/prometheus/0.log" Jul 01 17:25:28.144964 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.144927 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/config-reloader/0.log" Jul 01 17:25:28.180444 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.180414 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/thanos-sidecar/0.log" Jul 01 17:25:28.216877 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.216845 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/kube-rbac-proxy-web/0.log" Jul 01 17:25:28.258311 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.258281 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/kube-rbac-proxy/0.log" Jul 01 17:25:28.313592 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.313559 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/kube-rbac-proxy-thanos/0.log" Jul 01 17:25:28.364400 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.364311 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c75e2ce-1396-4582-b9a0-5e153cba9573/init-config-reloader/0.log" Jul 01 17:25:28.414597 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.414563 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-pn4lf_26a983aa-84f8-414f-ae72-2d2d285e9518/prometheus-operator/0.log" Jul 01 17:25:28.451959 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:28.451921 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-pn4lf_26a983aa-84f8-414f-ae72-2d2d285e9518/kube-rbac-proxy/0.log" Jul 01 17:25:30.011530 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:30.011504 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-zbcl7_416ae2ab-ce08-4f58-a386-de02775bf210/networking-console-plugin/0.log" Jul 01 17:25:32.572619 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.572587 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zlz2t_5cf44b14-3dbc-4ecc-881e-3f8253c0862f/dns/0.log" Jul 01 17:25:32.590154 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590121 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc"] Jul 01 17:25:32.590455 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590438 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="gather" Jul 01 17:25:32.590524 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590459 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="gather" Jul 01 17:25:32.590524 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590473 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="copy" Jul 01 17:25:32.590524 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590482 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="copy" Jul 01 17:25:32.590670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590551 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="copy" Jul 01 17:25:32.590670 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.590560 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeec5e06-9ee7-44bc-9d61-6055023e718d" containerName="gather" Jul 01 17:25:32.597240 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.597212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.606301 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.606264 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc"] Jul 01 17:25:32.608102 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.608078 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zlz2t_5cf44b14-3dbc-4ecc-881e-3f8253c0862f/kube-rbac-proxy/0.log" Jul 01 17:25:32.680438 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.680405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nq7gd_0151a307-6783-4944-af20-6a5161ab3c01/dns-node-resolver/0.log" Jul 01 17:25:32.693235 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.693205 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-podres\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.693412 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.693247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmbh\" (UniqueName: \"kubernetes.io/projected/3795dc6e-4d15-434b-869f-0e791422172d-kube-api-access-hdmbh\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.693624 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.693597 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-sys\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.693738 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.693640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-proc\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.693738 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.693673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-lib-modules\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794220 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794187 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-sys\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794229 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-proc\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-lib-modules\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-podres\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794315 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-sys\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmbh\" (UniqueName: \"kubernetes.io/projected/3795dc6e-4d15-434b-869f-0e791422172d-kube-api-access-hdmbh\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794406 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794358 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-proc\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794619 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794417 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-lib-modules\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.794619 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.794475 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3795dc6e-4d15-434b-869f-0e791422172d-podres\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.803137 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.803113 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmbh\" (UniqueName: \"kubernetes.io/projected/3795dc6e-4d15-434b-869f-0e791422172d-kube-api-access-hdmbh\") pod \"perf-node-gather-daemonset-994rc\" (UID: \"3795dc6e-4d15-434b-869f-0e791422172d\") " pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:32.910368 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:32.910289 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:33.077888 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:33.076950 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc"] Jul 01 17:25:33.152713 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:33.152340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" event={"ID":"3795dc6e-4d15-434b-869f-0e791422172d","Type":"ContainerStarted","Data":"fb47cfab3665dc8f53d374042f0c05afe1765c0f5bf45e6672c5b6779301b2c0"} Jul 01 17:25:33.241926 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:33.241902 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-75f85_e89d2d88-82af-497b-8b9a-12d3506dd7a7/node-ca/0.log" Jul 01 17:25:34.159136 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:34.159096 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" event={"ID":"3795dc6e-4d15-434b-869f-0e791422172d","Type":"ContainerStarted","Data":"e495ec297bd86913ac0a6761f2ea6f7478da02b19c5cf6db1ffd851c7f90995e"} Jul 01 17:25:34.159838 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:34.159180 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:34.179279 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:34.179225 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" podStartSLOduration=2.179206489 podStartE2EDuration="2.179206489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 17:25:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 17:25:34.177313212 +0000 UTC m=+1606.014657964" watchObservedRunningTime="2026-07-01 17:25:34.179206489 +0000 UTC m=+1606.016551242" Jul 01 17:25:34.518169 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:34.518142 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f6mwq_f13ea006-473a-4736-94b6-3e7c7f780e29/serve-healthcheck-canary/0.log" Jul 01 17:25:34.959117 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:34.959013 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fssvm_9e66216d-d0e1-4e9e-ba95-9019e44a67d9/insights-operator/1.log" Jul 01 17:25:34.960669 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:34.960637 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fssvm_9e66216d-d0e1-4e9e-ba95-9019e44a67d9/insights-operator/0.log" Jul 01 17:25:35.050543 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:35.050510 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8ww9j_be278cfb-f22d-4714-ab31-f8d12a1e1ff2/kube-rbac-proxy/0.log" Jul 01 17:25:35.075021 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:35.074996 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8ww9j_be278cfb-f22d-4714-ab31-f8d12a1e1ff2/exporter/0.log" Jul 01 17:25:35.113252 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:35.113218 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8ww9j_be278cfb-f22d-4714-ab31-f8d12a1e1ff2/extractor/0.log" Jul 01 17:25:37.623488 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.623458 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-pfg7r_66b310f3-2447-476a-ae78-d56894a8be7d/manager/0.log" Jul 01 17:25:37.790217 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.790165 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-plkbr_735da0c7-baf7-40eb-9dc4-e63bb099518b/s3-init/0.log" Jul 01 17:25:37.822568 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.822535 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-plkbr_735da0c7-baf7-40eb-9dc4-e63bb099518b/download-hf-model/0.log" Jul 01 17:25:37.865898 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.865870 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-8tqsj_1cc0836d-9a5e-4649-b7f6-f055de8541dd/s3-tls-init-custom/0.log" Jul 01 17:25:37.904741 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.904651 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-8tqsj_1cc0836d-9a5e-4649-b7f6-f055de8541dd/download-hf-model/0.log" Jul 01 17:25:37.942113 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.942090 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-gzmmp_6c37c9c0-b70e-408e-b32a-7832243c4c18/s3-tls-init-serving/0.log" Jul 01 17:25:37.967140 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:37.967120 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-gzmmp_6c37c9c0-b70e-408e-b32a-7832243c4c18/download-hf-model/0.log" Jul 01 17:25:40.173883 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:40.173809 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4lxfx/perf-node-gather-daemonset-994rc" Jul 01 17:25:44.254599 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.254567 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/kube-multus-additional-cni-plugins/0.log" Jul 01 17:25:44.288339 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.288315 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/egress-router-binary-copy/0.log" Jul 01 17:25:44.319374 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.319353 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/cni-plugins/0.log" Jul 01 17:25:44.355789 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.355762 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/bond-cni-plugin/0.log" Jul 01 17:25:44.389715 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.389672 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/routeoverride-cni/0.log" Jul 01 17:25:44.417533 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.417485 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/whereabouts-cni-bincopy/0.log" Jul 01 17:25:44.446688 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.446657 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xpsb2_043d0318-2447-4ddd-8c21-2a4a4256706d/whereabouts-cni/0.log" Jul 01 17:25:44.574722 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.574698 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r7jmp_f0a2467a-6f91-490e-8f89-5d7d0b52dc05/kube-multus/0.log" Jul 01 17:25:44.609362 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.609332 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-66nq9_68d0cc90-fdbf-4842-a2f1-963f5d70d845/network-metrics-daemon/0.log" Jul 01 17:25:44.654322 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:44.652302 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-66nq9_68d0cc90-fdbf-4842-a2f1-963f5d70d845/kube-rbac-proxy/0.log" Jul 01 17:25:45.932478 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:45.932435 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-controller/0.log" Jul 01 17:25:45.973185 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:45.973149 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/0.log" Jul 01 17:25:45.973325 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:45.973190 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovn-acl-logging/1.log" Jul 01 17:25:45.997955 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:45.997928 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/kube-rbac-proxy-node/0.log" Jul 01 17:25:46.025207 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:46.025187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 17:25:46.054968 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:46.054946 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/northd/0.log" Jul 01 17:25:46.097759 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:46.097740 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/nbdb/0.log" Jul 01 17:25:46.141570 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:46.141544 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/sbdb/0.log" Jul 01 17:25:46.192608 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:46.192544 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdwc_b490022b-e429-4918-b569-714174b00688/ovnkube-controller/0.log" Jul 01 17:25:47.564804 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:47.564777 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56499946bc-vrs8b_f9878225-f12d-48ff-9378-93732fc614ef/check-endpoints/0.log" Jul 01 17:25:47.655504 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:47.655477 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-ts2zp_23565b87-1958-4f42-8a4c-8f5feae959b4/network-check-target-container/0.log" Jul 01 17:25:48.748357 ip-10-0-139-133 kubenswrapper[2572]: I0701 17:25:48.748322 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-m22mr_24ed4236-c948-4116-a87d-e1e66a32e922/iptables-alerter/0.log"