Jul 31 14:45:41.478494 ip-10-0-143-167 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 31 14:45:41.478505 ip-10-0-143-167 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 31 14:45:41.478514 ip-10-0-143-167 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 31 14:45:41.478819 ip-10-0-143-167 systemd[1]: Failed to start Kubernetes Kubelet. Jul 31 14:45:52.739188 ip-10-0-143-167 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 31 14:45:52.739204 ip-10-0-143-167 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 38ef00779e6543f6978448612ccc0ad4 -- Jul 31 14:47:24.029124 ip-10-0-143-167 systemd[1]: Starting Kubernetes Kubelet... Jul 31 14:47:24.459810 ip-10-0-143-167 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:24.459810 ip-10-0-143-167 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 14:47:24.459810 ip-10-0-143-167 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:24.459810 ip-10-0-143-167 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 14:47:24.459810 ip-10-0-143-167 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 14:47:24.461905 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.461809 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 14:47:24.469274 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469240 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:24.469274 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469275 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:24.469401 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469297 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469405 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469411 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469414 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469417 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469420 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469423 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469426 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:24.469433 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469432 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469438 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469441 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469444 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469447 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469450 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469453 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469456 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469459 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469462 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469465 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469467 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469470 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469472 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469475 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469477 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469480 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469482 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469485 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469488 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:24.469636 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469490 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469493 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469495 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469498 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469500 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469513 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469518 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469521 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469524 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469526 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469529 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469532 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469535 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469537 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469541 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469544 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469547 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469549 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469552 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469555 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:24.470122 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469557 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469560 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469562 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469565 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469567 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469570 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469573 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469575 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469578 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469581 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469584 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469587 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469589 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469592 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469594 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469597 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469600 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469604 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469607 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469610 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:24.470617 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469613 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469619 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469622 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469625 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469628 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469632 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469635 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469637 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469641 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469643 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469646 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469649 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469652 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469654 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469657 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469659 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469662 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469665 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469667 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:24.471123 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469670 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469673 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469675 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469678 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469680 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469683 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469685 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469688 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469691 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.469693 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470421 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470428 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470431 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470435 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470438 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470440 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470443 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470446 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470449 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470452 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:24.471587 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470455 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470457 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470460 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470463 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470465 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470468 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470471 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470475 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470478 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470480 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470483 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470485 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470488 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470490 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470493 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470496 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470498 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470501 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470503 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:24.472099 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470506 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470509 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470511 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470514 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470516 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470519 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470521 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470524 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470526 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470529 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470532 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470535 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470538 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470541 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470543 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470546 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470548 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470551 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470554 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470556 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:24.472619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470558 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470562 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470564 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470567 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470569 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470572 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470574 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470576 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470579 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470582 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470586 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470590 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470593 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470596 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470598 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470601 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470603 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470606 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470609 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:24.473140 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470612 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470616 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470621 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470624 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470627 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470630 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470633 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470637 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470641 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470643 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470646 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470649 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470652 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470655 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470657 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470660 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470663 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470666 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470669 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:24.473652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470671 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470674 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470676 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470678 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470681 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470684 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470686 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470689 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470692 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470694 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470697 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.470699 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471127 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471134 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471137 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471142 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471145 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471148 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471151 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471154 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:24.474152 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471157 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471159 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471162 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471164 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471168 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471171 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471173 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471176 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471179 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471181 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471184 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471186 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471189 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471191 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471194 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471196 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471199 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471202 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471204 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471207 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:24.474646 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471210 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471212 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471217 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471220 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471223 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471226 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471229 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471233 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471236 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471238 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471241 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471244 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471248 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471252 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471256 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471259 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471262 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471265 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471268 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:24.475149 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471271 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471273 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471276 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471280 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471282 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471285 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471288 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471290 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471293 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471295 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471298 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471300 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471302 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471305 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471308 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471310 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471313 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471315 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471318 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471320 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:24.475610 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471324 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471327 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471330 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471332 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471335 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471337 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471340 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471342 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471345 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471348 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471350 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471353 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471355 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471358 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471361 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471364 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471366 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471369 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471371 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471374 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:24.476098 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471378 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471380 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471383 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471385 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471388 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471390 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471393 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471395 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471397 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471400 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471402 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.471405 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471478 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471485 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471492 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471498 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471505 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471510 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471516 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471520 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471523 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 14:47:24.476578 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471526 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471530 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471533 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471536 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471539 2560 flags.go:64] FLAG: --cgroup-root="" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471542 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471545 2560 flags.go:64] FLAG: --client-ca-file="" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471549 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471552 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471556 2560 flags.go:64] FLAG: --cluster-domain="" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471559 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471562 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471565 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471569 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471572 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471575 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471579 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471582 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471585 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471588 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471591 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471594 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471597 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471601 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 14:47:24.477105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471604 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471607 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471610 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471613 2560 flags.go:64] FLAG: --enable-server="true" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471616 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471619 2560 flags.go:64] FLAG: --event-burst="100" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471622 2560 flags.go:64] FLAG: --event-qps="50" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471625 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471628 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471631 2560 flags.go:64] FLAG: --eviction-hard="" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471634 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471637 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471640 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471643 2560 flags.go:64] FLAG: --eviction-soft="" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471646 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471648 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471652 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471655 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471657 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471661 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471664 2560 flags.go:64] FLAG: --feature-gates="" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471667 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471670 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471673 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471676 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471679 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 31 14:47:24.477689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471682 2560 flags.go:64] FLAG: --help="false" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471685 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471688 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471691 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471694 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471698 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471702 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471704 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471707 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471710 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471713 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471716 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471719 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471722 2560 flags.go:64] FLAG: --kube-reserved="" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471724 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471727 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471730 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471733 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471736 2560 flags.go:64] FLAG: --lock-file="" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471740 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471743 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471746 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471751 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 14:47:24.478334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471755 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471757 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471760 2560 flags.go:64] FLAG: --logging-format="text" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471763 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471766 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471769 2560 flags.go:64] FLAG: --manifest-url="" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471772 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471776 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471779 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471783 2560 flags.go:64] FLAG: --max-pods="110" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471785 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471788 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471791 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471794 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471797 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471800 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471803 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471809 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471813 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471816 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471819 2560 flags.go:64] FLAG: --pod-cidr="" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471821 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471839 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471842 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 14:47:24.479028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471845 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471848 2560 flags.go:64] FLAG: --port="10250" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471857 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471861 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e7b2317b3a57973c" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471866 2560 flags.go:64] FLAG: --qos-reserved="" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471869 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471872 2560 flags.go:64] FLAG: --register-node="true" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471875 2560 flags.go:64] FLAG: --register-with-taints="" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471879 2560 flags.go:64] FLAG: --registry-burst="10" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471882 2560 flags.go:64] FLAG: --registry-qps="5" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471885 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471888 2560 flags.go:64] FLAG: --reserved-memory="" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471891 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471894 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471897 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471900 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471903 2560 flags.go:64] FLAG: --runonce="false" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471906 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471909 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471911 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471914 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471917 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471920 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471923 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471926 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471929 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 14:47:24.479630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471931 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471934 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471937 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471940 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471943 2560 flags.go:64] FLAG: --system-cgroups="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471946 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471951 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471954 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471957 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471962 2560 flags.go:64] FLAG: --tls-min-version="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471966 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471968 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471971 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471974 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471977 2560 flags.go:64] FLAG: --v="2" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471981 2560 flags.go:64] FLAG: --version="false" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471985 2560 flags.go:64] FLAG: --vmodule="" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471989 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.471992 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472101 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472105 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472109 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472111 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472114 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:24.480297 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472117 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472119 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472124 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472127 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472130 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472132 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472135 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472138 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472140 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472143 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472146 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472149 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472151 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472154 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472157 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472159 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472162 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472166 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472171 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:24.480896 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472174 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472177 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472179 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472182 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472185 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472187 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472190 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472193 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472196 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472198 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472201 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472203 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472206 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472208 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472211 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472215 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472218 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472220 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472223 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472225 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:24.481367 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472228 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472231 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472233 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472236 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472238 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472242 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472245 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472249 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472251 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472254 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472256 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472260 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472263 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472266 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472268 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472271 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472273 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472276 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472279 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:24.481870 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472282 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472285 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472288 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472290 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472294 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472298 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472301 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472303 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472308 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472310 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472313 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472316 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472318 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472321 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472324 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472326 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472329 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472331 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472334 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472337 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:24.482345 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472339 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472342 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472344 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472347 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472351 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472353 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472356 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472358 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472361 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472364 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472366 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472369 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472371 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472378 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472381 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:24.482973 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.472383 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.473169 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.480452 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.480466 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.480486 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.480491 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480544 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480549 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480552 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480556 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480559 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480562 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480565 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480568 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480571 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:24.483336 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480574 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480576 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480579 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480582 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480584 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480587 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480589 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480592 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480594 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480597 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480599 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480603 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480607 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480610 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480613 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480616 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480619 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480622 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480624 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480627 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:24.483713 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480631 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480634 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480637 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480639 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480642 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480645 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480647 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480650 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480652 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480655 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480658 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480660 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480663 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480666 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480668 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480671 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480674 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480677 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480679 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:24.484221 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480682 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480684 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480687 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480690 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480692 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480695 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480698 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480700 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480703 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480706 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480708 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480711 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480714 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480716 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480719 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480722 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480724 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480727 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480729 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:24.484685 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480731 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480734 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480737 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480740 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480742 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480744 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480747 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480750 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480752 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480755 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480757 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480760 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480763 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480765 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480769 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480773 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480776 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480778 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480781 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:24.485164 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480783 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480787 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480791 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480794 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480797 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480799 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480802 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480804 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480807 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480810 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480812 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480815 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480817 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.480822 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480943 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 14:47:24.485619 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480948 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480951 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480954 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480956 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480959 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480961 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480964 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480967 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480970 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480972 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480975 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480977 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480979 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480982 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480984 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480987 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480989 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480992 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480995 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 14:47:24.486037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.480999 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481003 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481006 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481009 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481011 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481014 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481016 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481019 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481022 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481025 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481027 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481030 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481032 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481035 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481037 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481040 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481042 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481044 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481047 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481049 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 14:47:24.486495 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481052 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481054 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481057 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481060 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481062 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481064 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481067 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481069 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481072 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481074 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481077 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481080 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481082 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481085 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481087 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481089 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481092 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481095 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481097 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481100 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 14:47:24.487037 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481103 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481107 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481110 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481113 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481116 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481119 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481122 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481124 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481127 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481129 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481132 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481135 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481138 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481141 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481143 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481146 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481148 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481151 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481154 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481156 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 14:47:24.487513 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481159 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481161 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481164 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481166 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481169 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481171 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481174 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481177 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481179 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481182 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481184 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481187 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481190 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481193 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481197 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481200 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481203 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481206 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 14:47:24.488015 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:24.481209 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.481214 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.481309 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.483768 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.485554 2560 server.go:1019] "Starting client certificate rotation" Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.485652 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.485718 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 14:47:24.488464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.488364 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:47:24.489486 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.489469 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 14:47:24.500932 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.500909 2560 log.go:25] "Validated CRI v1 runtime API" Jul 31 14:47:24.504203 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.504183 2560 log.go:25] "Validated CRI v1 image API" Jul 31 14:47:24.505877 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.505859 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 14:47:24.508461 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.508440 2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7e712594-416b-44d6-b262-b905cd38a30d:/dev/nvme0n1p4 84dcaa84-5de1-4aa6-949c-92d3bfd05323:/dev/nvme0n1p3] Jul 31 14:47:24.508518 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.508461 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 14:47:24.514438 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.514328 2560 manager.go:216] Machine: {Timestamp:2026-07-31 14:47:24.512901008 +0000 UTC m=+0.358589545 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100334 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f45788dde4084daa09f0338634af SystemUUID:ec24f457-88dd-e408-4daa-09f0338634af BootID:38ef0077-9e65-43f6-9784-48612ccc0ad4 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:4b:01:78:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:4b:01:78:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:fd:16:4d:f5:74 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 14:47:24.514438 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.514434 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 14:47:24.514561 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.514549 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 14:47:24.518378 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.518360 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:47:24.518444 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.518409 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 14:47:24.518589 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.518437 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 14:47:24.519977 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.519966 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 14:47:24.520028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.519980 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 14:47:24.520028 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.519988 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:47:24.520857 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.520847 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 14:47:24.522076 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.522066 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 14:47:24.527253 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527242 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:47:24.527375 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527364 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 14:47:24.527404 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527397 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 31 14:47:24.527437 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527408 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 14:47:24.527437 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527424 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 14:47:24.527437 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527434 2560 kubelet.go:398] "Adding apiserver pod source" Jul 31 14:47:24.527530 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527442 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 14:47:24.527842 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527817 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:47:24.527885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.527862 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 14:47:24.530938 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.530920 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 14:47:24.532534 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.532521 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 14:47:24.532573 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.532551 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 14:47:24.533948 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533937 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533953 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533960 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533965 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533974 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533980 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533988 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 14:47:24.533993 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.533994 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 14:47:24.534197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.534000 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 14:47:24.534197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.534005 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 14:47:24.534197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.534014 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 14:47:24.534197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.534019 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 14:47:24.535753 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.535739 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 14:47:24.535795 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.535757 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 14:47:24.539139 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.539125 2560 server.go:1268] "Started kubelet" Jul 31 14:47:24.539317 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.539214 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 14:47:24.539424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.539363 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 14:47:24.539490 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.539481 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 14:47:24.539652 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.539634 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 14:47:24.540171 ip-10-0-143-167 systemd[1]: Started Kubernetes Kubelet. Jul 31 14:47:24.544635 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.544606 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 14:47:24.544992 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.540532 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 14:47:24.545075 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.540529 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 14:47:24.545528 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.545507 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 14:47:24.546411 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.546390 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 31 14:47:24.551637 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.550474 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a7edd385 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.539097989 +0000 UTC m=+0.384786539,LastTimestamp:2026-07-31 14:47:24.539097989 +0000 UTC m=+0.384786539,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.552372 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.552349 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 14:47:24.552372 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.552359 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 14:47:24.552510 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.552449 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:24.553121 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553103 2560 factory.go:55] Registering systemd factory Jul 31 14:47:24.553217 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553130 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 14:47:24.553217 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553131 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 14:47:24.553217 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553156 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 14:47:24.553217 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553144 2560 factory.go:223] Registration of the systemd container factory successfully Jul 31 14:47:24.553399 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553275 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 31 14:47:24.553399 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553283 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 31 14:47:24.553399 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553390 2560 factory.go:153] Registering CRI-O factory Jul 31 14:47:24.553531 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553404 2560 factory.go:223] Registration of the crio container factory successfully Jul 31 14:47:24.553531 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553454 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 14:47:24.553531 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553483 2560 factory.go:103] Registering Raw factory Jul 31 14:47:24.553531 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553497 2560 manager.go:1196] Started watching for new ooms in manager Jul 31 14:47:24.553910 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.553893 2560 manager.go:349] Starting recovery of all containers Jul 31 14:47:24.559184 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.559151 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 14:47:24.559333 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.559311 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 14:47:24.564228 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.564211 2560 manager.go:354] Recovery completed Jul 31 14:47:24.569227 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.569209 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.570986 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.570969 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.571040 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.571001 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.571040 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.571014 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.571505 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.571490 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 14:47:24.571505 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.571504 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 14:47:24.571618 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.571491 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.571618 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.571520 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 31 14:47:24.572434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.572349 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.572518 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.572457 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.572518 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.572473 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.573459 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.573372 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d469da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.57098697 +0000 UTC m=+0.416675507,LastTimestamp:2026-07-31 14:47:24.57098697 +0000 UTC m=+0.416675507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.573804 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.573792 2560 policy_none.go:49] "None policy: Start" Jul 31 14:47:24.573855 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.573809 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 14:47:24.573855 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.573819 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 14:47:24.575867 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.575849 2560 policy_none.go:47] "Start" Jul 31 14:47:24.584818 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.584671 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d4bc84 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.571008132 +0000 UTC m=+0.416696668,LastTimestamp:2026-07-31 14:47:24.571008132 +0000 UTC m=+0.416696668,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.590681 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.590659 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nztv" Jul 31 14:47:24.594575 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.594481 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d4e558 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.571018584 +0000 UTC m=+0.416707124,LastTimestamp:2026-07-31 14:47:24.571018584 +0000 UTC m=+0.416707124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.601177 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.601158 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nztv" Jul 31 14:47:24.603000 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.602935 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-167.ec2.internal.18c76732a9d469da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d469da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.57098697 +0000 UTC m=+0.416675507,LastTimestamp:2026-07-31 14:47:24.572431182 +0000 UTC m=+0.418119718,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.606400 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606389 2560 manager.go:337] "Starting Device Plugin manager" Jul 31 14:47:24.606461 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.606416 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 14:47:24.606461 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606425 2560 server.go:87] "Starting device plugin registration server" Jul 31 14:47:24.606646 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606630 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 14:47:24.606735 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606645 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 14:47:24.606824 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606805 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 14:47:24.606945 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606896 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 14:47:24.606945 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.606909 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 14:47:24.607315 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.607299 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 14:47:24.607379 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.607338 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:24.614299 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.614243 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-167.ec2.internal.18c76732a9d4bc84\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d4bc84 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.571008132 +0000 UTC m=+0.416696668,LastTimestamp:2026-07-31 14:47:24.572462845 +0000 UTC m=+0.418151380,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.625385 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.625321 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-167.ec2.internal.18c76732a9d4e558\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d4e558 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.571018584 +0000 UTC m=+0.416707124,LastTimestamp:2026-07-31 14:47:24.57247723 +0000 UTC m=+0.418165765,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.636727 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.636673 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732ac19861d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.609070621 +0000 UTC m=+0.454759147,LastTimestamp:2026-07-31 14:47:24.609070621 +0000 UTC m=+0.454759147,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.707066 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.707030 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.708131 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.708114 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.708205 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.708150 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.708205 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.708165 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.708205 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.708197 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.717391 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.717266 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-167.ec2.internal.18c76732a9d469da\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d469da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.57098697 +0000 UTC m=+0.416675507,LastTimestamp:2026-07-31 14:47:24.708133145 +0000 UTC m=+0.553821684,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.720695 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.720609 2560 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-167.ec2.internal.18c76732a9d4bc84\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-167.ec2.internal.18c76732a9d4bc84 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-167.ec2.internal,UID:ip-10-0-143-167.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-167.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-167.ec2.internal,},FirstTimestamp:2026-07-31 14:47:24.571008132 +0000 UTC m=+0.416696668,LastTimestamp:2026-07-31 14:47:24.70815667 +0000 UTC m=+0.553845208,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-167.ec2.internal,}" Jul 31 14:47:24.720814 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.720754 2560 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-143-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.766233 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.766205 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-167.ec2.internal\" not found" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.769921 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.769899 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 14:47:24.771123 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.771098 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 14:47:24.771193 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.771147 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 14:47:24.771193 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.771173 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 14:47:24.771256 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.771214 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 14:47:24.773814 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.773800 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:24.871593 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.871556 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal"] Jul 31 14:47:24.871732 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.871648 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.872873 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.872858 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.872932 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.872886 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.872932 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.872896 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.875155 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875142 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.875323 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875309 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.875358 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875341 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.875931 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875912 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.875931 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875921 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.876092 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875942 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.876092 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875943 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.876092 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875958 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.876092 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.875965 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.878256 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.878239 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.878354 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.878262 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.878907 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.878891 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.878975 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.878917 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.878975 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.878931 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.901370 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.901351 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-167.ec2.internal\" not found" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.905662 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.905646 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-167.ec2.internal\" not found" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.921522 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.921502 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 14:47:24.922230 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.922207 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientMemory" Jul 31 14:47:24.922296 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.922234 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 14:47:24.922296 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.922248 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeHasSufficientPID" Jul 31 14:47:24.922296 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.922269 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.931012 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.930996 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.931082 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.931014 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-167.ec2.internal\": node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:24.956360 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.956339 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbcff475c53247a65714e24c94325920-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal\" (UID: \"fbcff475c53247a65714e24c94325920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.956452 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.956360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbcff475c53247a65714e24c94325920-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal\" (UID: \"fbcff475c53247a65714e24c94325920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.956452 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:24.956379 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d7885553df81411020fc4e03d6f8d97-config\") pod \"kube-apiserver-proxy-ip-10-0-143-167.ec2.internal\" (UID: \"1d7885553df81411020fc4e03d6f8d97\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" Jul 31 14:47:24.956538 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:24.956468 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:25.057013 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.056955 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:25.057013 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.056990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbcff475c53247a65714e24c94325920-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal\" (UID: \"fbcff475c53247a65714e24c94325920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.057144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.057021 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbcff475c53247a65714e24c94325920-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal\" (UID: \"fbcff475c53247a65714e24c94325920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.057144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.057047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d7885553df81411020fc4e03d6f8d97-config\") pod \"kube-apiserver-proxy-ip-10-0-143-167.ec2.internal\" (UID: \"1d7885553df81411020fc4e03d6f8d97\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.057144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.057055 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fbcff475c53247a65714e24c94325920-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal\" (UID: \"fbcff475c53247a65714e24c94325920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.057144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.057083 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbcff475c53247a65714e24c94325920-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal\" (UID: \"fbcff475c53247a65714e24c94325920\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.057144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.057086 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1d7885553df81411020fc4e03d6f8d97-config\") pod \"kube-apiserver-proxy-ip-10-0-143-167.ec2.internal\" (UID: \"1d7885553df81411020fc4e03d6f8d97\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.157400 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.157374 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:25.203480 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.203458 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.208201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.208183 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.258230 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.258206 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:25.359129 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.359108 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-167.ec2.internal\" not found" Jul 31 14:47:25.403722 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.403705 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:25.453395 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.453363 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.469736 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.469715 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:47:25.471329 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.471315 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" Jul 31 14:47:25.481974 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.481961 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 14:47:25.484226 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.484207 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 14:47:25.484353 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.484332 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:25.484403 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.484366 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 14:47:25.529911 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.529886 2560 apiserver.go:52] "Watching apiserver" Jul 31 14:47:25.545954 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.545232 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 14:47:25.546563 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.546538 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-xqtm4","openshift-multus/multus-xgg6x","openshift-network-operator/iptables-alerter-7jdz2","kube-system/global-pull-secret-syncer-s9kc6","kube-system/konnectivity-agent-jlpsd","openshift-cluster-node-tuning-operator/tuned-jfkdk","openshift-multus/network-metrics-daemon-tfmsm","openshift-network-diagnostics/network-check-target-rdv99","openshift-ovn-kubernetes/ovnkube-node-76j6l","kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf","openshift-dns/node-resolver-n6mxj","openshift-image-registry/node-ca-rmk2d"] Jul 31 14:47:25.549374 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.549351 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.551667 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.551627 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.551749 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.551682 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.551749 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.551682 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6qvcc\"" Jul 31 14:47:25.551848 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.551682 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.552483 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.552466 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 14:47:25.553986 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.553968 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.554531 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.554509 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.554639 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.554547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 14:47:25.554639 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.554582 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.554639 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.554612 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 14:47:25.554793 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.554587 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-svgjl\"" Jul 31 14:47:25.554793 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.554582 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 14:47:25.556033 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.556010 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 14:47:25.556142 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.556127 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-84vkd\"" Jul 31 14:47:25.556376 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.556356 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.558390 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.558372 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.558491 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.558449 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.558491 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.558460 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 14:47:25.558648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.558632 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fj6w9\"" Jul 31 14:47:25.558697 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.558691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.560234 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560211 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8whlk\" (UniqueName: \"kubernetes.io/projected/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-kube-api-access-8whlk\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560337 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-cni-bin\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560337 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-cni-multus\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560337 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-tmp\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560337 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-socket-dir-parent\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-netns\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysconfig\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-host\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560468 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cnibin\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-system-cni-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560558 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-cnibin\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-kubernetes\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-sys\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-kubelet\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-hostroot\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560714 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-multus-certs\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysctl-d\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-var-lib-kubelet\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kks55\" (UniqueName: \"kubernetes.io/projected/215ceb81-5dd4-4903-821f-97e22caec11d-kube-api-access-kks55\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560850 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-systemd\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.560885 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njj6n\" (UniqueName: \"kubernetes.io/projected/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-kube-api-access-njj6n\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-os-release\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.560986 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/215ceb81-5dd4-4903-821f-97e22caec11d-multus-daemon-config\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-k8s-cni-cncf-io\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-conf-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-etc-kubernetes\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-cni-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561166 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-lib-modules\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561124 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561206 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-tuned\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-system-cni-dir\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.561281 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-os-release\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561314 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 14:47:25.561349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.562133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/215ceb81-5dd4-4903-821f-97e22caec11d-cni-binary-copy\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.562133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-modprobe-d\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.562133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561410 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rh68j\"" Jul 31 14:47:25.562133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561428 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysctl-conf\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.562133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561456 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-run\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.562133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.561577 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.563423 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.563407 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:25.563502 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.563479 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:25.564382 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.564361 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 14:47:25.565921 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.565890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.568001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.567984 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x7fl2\"" Jul 31 14:47:25.568078 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.568019 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.568078 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.568030 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.568364 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.568352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.568419 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.568404 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:25.570798 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.570781 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.573100 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.573082 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 14:47:25.573350 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.573330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.573716 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.573699 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.573808 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.573757 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ckbcj\"" Jul 31 14:47:25.573880 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.573853 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 14:47:25.574317 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.574302 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 14:47:25.574317 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.574304 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 14:47:25.574708 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.574689 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.575488 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.575472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 14:47:25.575488 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.575485 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 14:47:25.575622 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.575555 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 14:47:25.575734 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.575696 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6tqvx\"" Jul 31 14:47:25.575957 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.575942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.579777 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.579580 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6pgft\"" Jul 31 14:47:25.579777 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.579735 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 14:47:25.581202 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.581154 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 14:47:25.608294 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.608275 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5fctx" Jul 31 14:47:25.619199 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.619176 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5fctx" Jul 31 14:47:25.654369 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.654348 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 14:47:25.661722 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661696 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysctl-d\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.661847 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-var-lib-kubelet\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.661847 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edb11af6-61e7-46ee-869b-43e5f2d58470-ovn-node-metrics-cert\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.661847 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnvd\" (UniqueName: \"kubernetes.io/projected/edb11af6-61e7-46ee-869b-43e5f2d58470-kube-api-access-gnnvd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.661847 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-device-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysctl-d\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661856 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-var-lib-kubelet\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e238aea-d9ad-4890-b118-90a93f997c34-iptables-alerter-script\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661908 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-systemd\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njj6n\" (UniqueName: \"kubernetes.io/projected/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-kube-api-access-njj6n\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.661982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-os-release\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.662042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662029 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-systemd\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-sys-fs\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662084 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2af4e5ca-f70c-4f2e-a052-4603774c13ea-kubelet-config\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662119 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-cni-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662123 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-os-release\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/215ceb81-5dd4-4903-821f-97e22caec11d-cni-binary-copy\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f15a6fc-e2e1-4e8b-8205-bda7dbd36094-konnectivity-ca\") pod \"konnectivity-agent-jlpsd\" (UID: \"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094\") " pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662225 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2af4e5ca-f70c-4f2e-a052-4603774c13ea-dbus\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662251 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662280 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-modprobe-d\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662300 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-cni-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.662425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662426 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-modprobe-d\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662305 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8whlk\" (UniqueName: \"kubernetes.io/projected/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-kube-api-access-8whlk\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662484 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-tmp\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d937e575-c105-4322-ab37-a7130a158f6e-tmp-dir\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpf25\" (UniqueName: \"kubernetes.io/projected/d937e575-c105-4322-ab37-a7130a158f6e-kube-api-access-bpf25\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whmt7\" (UniqueName: \"kubernetes.io/projected/5e238aea-d9ad-4890-b118-90a93f997c34-kube-api-access-whmt7\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysconfig\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-host\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cnibin\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662740 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-slash\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-run-netns\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-cni-netd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-socket-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662830 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-kubernetes\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.663201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662893 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-kubelet\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-hostroot\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662970 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgtrp\" (UniqueName: \"kubernetes.io/projected/b02538e3-a004-4422-9360-9b27ad6d8adc-kube-api-access-xgtrp\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.662983 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-hostroot\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-var-lib-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663062 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cnibin\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663066 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-log-socket\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663081 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/215ceb81-5dd4-4903-821f-97e22caec11d-cni-binary-copy\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663122 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-kubernetes\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663166 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-host\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-etc-selinux\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kks55\" (UniqueName: \"kubernetes.io/projected/215ceb81-5dd4-4903-821f-97e22caec11d-kube-api-access-kks55\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-registration-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/215ceb81-5dd4-4903-821f-97e22caec11d-multus-daemon-config\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-kubelet\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.664160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b02538e3-a004-4422-9360-9b27ad6d8adc-serviceca\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663625 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysconfig\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-run-ovn-kubernetes\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n86x7\" (UniqueName: \"kubernetes.io/projected/89dd69ea-d7ff-4458-a116-664e30e5c913-kube-api-access-n86x7\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/215ceb81-5dd4-4903-821f-97e22caec11d-multus-daemon-config\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.663979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664009 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-k8s-cni-cncf-io\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-conf-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664053 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-k8s-cni-cncf-io\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-etc-kubernetes\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664093 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-etc-kubernetes\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-kubelet\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664120 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-conf-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-node-log\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.665006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-cni-bin\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664177 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-ovnkube-script-lib\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664209 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-lib-modules\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-tuned\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664331 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-lib-modules\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664337 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-system-cni-dir\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-cni-binary-copy\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-os-release\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664426 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-system-cni-dir\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-ovnkube-config\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664470 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-os-release\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f15a6fc-e2e1-4e8b-8205-bda7dbd36094-agent-certs\") pod \"konnectivity-agent-jlpsd\" (UID: \"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094\") " pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysctl-conf\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664534 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-run\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-cni-bin\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664628 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-cni-bin\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.665838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664683 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-run\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664709 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-sysctl-conf\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664754 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-cni-multus\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664787 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e238aea-d9ad-4890-b118-90a93f997c34-host-slash\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664810 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-var-lib-cni-multus\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-socket-dir-parent\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664894 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-netns\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b02538e3-a004-4422-9360-9b27ad6d8adc-host\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-ovn\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664959 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkpsw\" (UniqueName: \"kubernetes.io/projected/5fb7fa83-52a0-40e4-b330-f5e759c766b1-kube-api-access-lkpsw\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.664973 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-multus-socket-dir-parent\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-system-cni-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665030 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-netns\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-systemd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-etc-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.666702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-env-overrides\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665116 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-cnibin\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665141 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-sys\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665149 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-system-cni-dir\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665165 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-multus-certs\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d937e575-c105-4322-ab37-a7130a158f6e-hosts-file\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-systemd-units\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665233 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-sys\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665322 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-cnibin\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.665347 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/215ceb81-5dd4-4903-821f-97e22caec11d-host-run-multus-certs\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.666422 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-tmp\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.667699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.666495 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-etc-tuned\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.673223 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.673020 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kks55\" (UniqueName: \"kubernetes.io/projected/215ceb81-5dd4-4903-821f-97e22caec11d-kube-api-access-kks55\") pod \"multus-xgg6x\" (UID: \"215ceb81-5dd4-4903-821f-97e22caec11d\") " pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.673223 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.673027 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njj6n\" (UniqueName: \"kubernetes.io/projected/a7cafd9d-437a-4dde-a61e-9a3d5859db3c-kube-api-access-njj6n\") pod \"multus-additional-cni-plugins-xqtm4\" (UID: \"a7cafd9d-437a-4dde-a61e-9a3d5859db3c\") " pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.673540 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.673489 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8whlk\" (UniqueName: \"kubernetes.io/projected/150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29-kube-api-access-8whlk\") pod \"tuned-jfkdk\" (UID: \"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29\") " pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.722145 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.722092 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 14:42:25 +0000 UTC" deadline="2028-03-17 12:37:05.370795093 +0000 UTC" Jul 31 14:47:25.722145 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.722142 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14277h49m39.648658014s" Jul 31 14:47:25.765969 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.765933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e238aea-d9ad-4890-b118-90a93f997c34-host-slash\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.765976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766003 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b02538e3-a004-4422-9360-9b27ad6d8adc-host\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-ovn\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkpsw\" (UniqueName: \"kubernetes.io/projected/5fb7fa83-52a0-40e4-b330-f5e759c766b1-kube-api-access-lkpsw\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-systemd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-etc-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766128 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766128 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-env-overrides\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d937e575-c105-4322-ab37-a7130a158f6e-hosts-file\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766164 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e238aea-d9ad-4890-b118-90a93f997c34-host-slash\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-systemd-units\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766216 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edb11af6-61e7-46ee-869b-43e5f2d58470-ovn-node-metrics-cert\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnvd\" (UniqueName: \"kubernetes.io/projected/edb11af6-61e7-46ee-869b-43e5f2d58470-kube-api-access-gnnvd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766269 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-device-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e238aea-d9ad-4890-b118-90a93f997c34-iptables-alerter-script\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766314 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-etc-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766395 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-systemd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766409 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-device-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-sys-fs\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766442 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2af4e5ca-f70c-4f2e-a052-4603774c13ea-kubelet-config\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766461 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f15a6fc-e2e1-4e8b-8205-bda7dbd36094-konnectivity-ca\") pod \"konnectivity-agent-jlpsd\" (UID: \"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094\") " pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2af4e5ca-f70c-4f2e-a052-4603774c13ea-dbus\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.766527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d937e575-c105-4322-ab37-a7130a158f6e-tmp-dir\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpf25\" (UniqueName: \"kubernetes.io/projected/d937e575-c105-4322-ab37-a7130a158f6e-kube-api-access-bpf25\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whmt7\" (UniqueName: \"kubernetes.io/projected/5e238aea-d9ad-4890-b118-90a93f997c34-kube-api-access-whmt7\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-slash\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-run-netns\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766641 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-cni-netd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-socket-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766667 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-sys-fs\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgtrp\" (UniqueName: \"kubernetes.io/projected/b02538e3-a004-4422-9360-9b27ad6d8adc-kube-api-access-xgtrp\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-var-lib-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-log-socket\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766801 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-etc-selinux\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-registration-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b02538e3-a004-4422-9360-9b27ad6d8adc-serviceca\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766863 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2af4e5ca-f70c-4f2e-a052-4603774c13ea-kubelet-config\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.766926 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-env-overrides\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.767424 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.766130 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.767040 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:26.266997375 +0000 UTC m=+2.112685911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767035 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767048 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-log-socket\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767089 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-slash\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767109 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-systemd-units\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767201 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2af4e5ca-f70c-4f2e-a052-4603774c13ea-dbus\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-run-ovn-kubernetes\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767279 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n86x7\" (UniqueName: \"kubernetes.io/projected/89dd69ea-d7ff-4458-a116-664e30e5c913-kube-api-access-n86x7\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767308 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767347 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-etc-selinux\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767383 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d937e575-c105-4322-ab37-a7130a158f6e-tmp-dir\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767393 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-run-netns\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767433 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b02538e3-a004-4422-9360-9b27ad6d8adc-serviceca\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767439 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-run-ovn-kubernetes\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767477 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b02538e3-a004-4422-9360-9b27ad6d8adc-host\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767497 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f15a6fc-e2e1-4e8b-8205-bda7dbd36094-konnectivity-ca\") pod \"konnectivity-agent-jlpsd\" (UID: \"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094\") " pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.768257 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767511 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-ovn\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-registration-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767441 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-cni-netd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.767515 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767542 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d937e575-c105-4322-ab37-a7130a158f6e-hosts-file\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767551 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-var-lib-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-kubelet\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767592 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-kubelet\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767634 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89dd69ea-d7ff-4458-a116-664e30e5c913-socket-dir\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767635 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5e238aea-d9ad-4890-b118-90a93f997c34-iptables-alerter-script\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.767656 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:47:26.267638902 +0000 UTC m=+2.113327442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-node-log\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767690 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-run-openvswitch\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767712 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-node-log\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-cni-bin\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767768 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-ovnkube-script-lib\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767798 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edb11af6-61e7-46ee-869b-43e5f2d58470-host-cni-bin\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769997 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-ovnkube-config\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769997 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.767945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f15a6fc-e2e1-4e8b-8205-bda7dbd36094-agent-certs\") pod \"konnectivity-agent-jlpsd\" (UID: \"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094\") " pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.769997 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.768292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-ovnkube-script-lib\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.769997 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.768513 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edb11af6-61e7-46ee-869b-43e5f2d58470-ovnkube-config\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.770505 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.770440 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edb11af6-61e7-46ee-869b-43e5f2d58470-ovn-node-metrics-cert\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.771838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.771816 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f15a6fc-e2e1-4e8b-8205-bda7dbd36094-agent-certs\") pod \"konnectivity-agent-jlpsd\" (UID: \"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094\") " pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:25.780785 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.780762 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:25.780785 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.780787 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:25.780992 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.780798 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:25.780992 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:25.780856 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:47:26.280844093 +0000 UTC m=+2.126532635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:25.782437 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.782412 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgtrp\" (UniqueName: \"kubernetes.io/projected/b02538e3-a004-4422-9360-9b27ad6d8adc-kube-api-access-xgtrp\") pod \"node-ca-rmk2d\" (UID: \"b02538e3-a004-4422-9360-9b27ad6d8adc\") " pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.782530 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.782413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnvd\" (UniqueName: \"kubernetes.io/projected/edb11af6-61e7-46ee-869b-43e5f2d58470-kube-api-access-gnnvd\") pod \"ovnkube-node-76j6l\" (UID: \"edb11af6-61e7-46ee-869b-43e5f2d58470\") " pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.782660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.782637 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpf25\" (UniqueName: \"kubernetes.io/projected/d937e575-c105-4322-ab37-a7130a158f6e-kube-api-access-bpf25\") pod \"node-resolver-n6mxj\" (UID: \"d937e575-c105-4322-ab37-a7130a158f6e\") " pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.783798 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.783781 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkpsw\" (UniqueName: \"kubernetes.io/projected/5fb7fa83-52a0-40e4-b330-f5e759c766b1-kube-api-access-lkpsw\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:25.784178 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.784159 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n86x7\" (UniqueName: \"kubernetes.io/projected/89dd69ea-d7ff-4458-a116-664e30e5c913-kube-api-access-n86x7\") pod \"aws-ebs-csi-driver-node-rmgrf\" (UID: \"89dd69ea-d7ff-4458-a116-664e30e5c913\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.784265 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.784248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whmt7\" (UniqueName: \"kubernetes.io/projected/5e238aea-d9ad-4890-b118-90a93f997c34-kube-api-access-whmt7\") pod \"iptables-alerter-7jdz2\" (UID: \"5e238aea-d9ad-4890-b118-90a93f997c34\") " pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.853481 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.853446 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbcff475c53247a65714e24c94325920.slice/crio-fb7f534633ccf1e26be6a79f7313e86a1a6e824dbe541cc26db821798d8d3039 WatchSource:0}: Error finding container fb7f534633ccf1e26be6a79f7313e86a1a6e824dbe541cc26db821798d8d3039: Status 404 returned error can't find the container with id fb7f534633ccf1e26be6a79f7313e86a1a6e824dbe541cc26db821798d8d3039 Jul 31 14:47:25.854033 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.854008 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7885553df81411020fc4e03d6f8d97.slice/crio-6f3d2af6f9132a576ded310a337c68e8892a25cd53ea92889d15351ee275cb7c WatchSource:0}: Error finding container 6f3d2af6f9132a576ded310a337c68e8892a25cd53ea92889d15351ee275cb7c: Status 404 returned error can't find the container with id 6f3d2af6f9132a576ded310a337c68e8892a25cd53ea92889d15351ee275cb7c Jul 31 14:47:25.860222 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.860205 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:47:25.882198 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.882179 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" Jul 31 14:47:25.889497 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.889477 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" Jul 31 14:47:25.891432 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.891399 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150dbd7c_c55c_4b6d_b4aa_53c0db6f6f29.slice/crio-ba7d2b27129cd0804318cd25c7f8d03349dd0f27d427d3c5980207c6816cd675 WatchSource:0}: Error finding container ba7d2b27129cd0804318cd25c7f8d03349dd0f27d427d3c5980207c6816cd675: Status 404 returned error can't find the container with id ba7d2b27129cd0804318cd25c7f8d03349dd0f27d427d3c5980207c6816cd675 Jul 31 14:47:25.899050 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.899029 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cafd9d_437a_4dde_a61e_9a3d5859db3c.slice/crio-529f2d737a1532e602d6776216afd45e5658f5bc4551adb9579947538fc528cc WatchSource:0}: Error finding container 529f2d737a1532e602d6776216afd45e5658f5bc4551adb9579947538fc528cc: Status 404 returned error can't find the container with id 529f2d737a1532e602d6776216afd45e5658f5bc4551adb9579947538fc528cc Jul 31 14:47:25.905030 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.905013 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xgg6x" Jul 31 14:47:25.913464 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.913443 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod215ceb81_5dd4_4903_821f_97e22caec11d.slice/crio-744e6a3d4805162eaa39daecf6c80035d828d7f4d13bbccfbe7d62492cb2d9b3 WatchSource:0}: Error finding container 744e6a3d4805162eaa39daecf6c80035d828d7f4d13bbccfbe7d62492cb2d9b3: Status 404 returned error can't find the container with id 744e6a3d4805162eaa39daecf6c80035d828d7f4d13bbccfbe7d62492cb2d9b3 Jul 31 14:47:25.922142 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.922125 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jdz2" Jul 31 14:47:25.930652 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.930633 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e238aea_d9ad_4890_b118_90a93f997c34.slice/crio-ce51165aaa4ca0ad9b9d6ebe1c4a46e20cbe4aaf44f43157213cdc44f8bcc93e WatchSource:0}: Error finding container ce51165aaa4ca0ad9b9d6ebe1c4a46e20cbe4aaf44f43157213cdc44f8bcc93e: Status 404 returned error can't find the container with id ce51165aaa4ca0ad9b9d6ebe1c4a46e20cbe4aaf44f43157213cdc44f8bcc93e Jul 31 14:47:25.945656 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.945635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rmk2d" Jul 31 14:47:25.953589 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.953566 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02538e3_a004_4422_9360_9b27ad6d8adc.slice/crio-9bc5ea5f6f22b355d2c5cbc391c7ef26a83fea3b9f7ceafb67f151072394e953 WatchSource:0}: Error finding container 9bc5ea5f6f22b355d2c5cbc391c7ef26a83fea3b9f7ceafb67f151072394e953: Status 404 returned error can't find the container with id 9bc5ea5f6f22b355d2c5cbc391c7ef26a83fea3b9f7ceafb67f151072394e953 Jul 31 14:47:25.961283 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.961265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n6mxj" Jul 31 14:47:25.966387 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.966365 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:25.969281 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.969170 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd937e575_c105_4322_ab37_a7130a158f6e.slice/crio-c5e0f496f84c531de5794c4767c7d3c31d5f15d77cdfe2f7c400ea7d306d8b89 WatchSource:0}: Error finding container c5e0f496f84c531de5794c4767c7d3c31d5f15d77cdfe2f7c400ea7d306d8b89: Status 404 returned error can't find the container with id c5e0f496f84c531de5794c4767c7d3c31d5f15d77cdfe2f7c400ea7d306d8b89 Jul 31 14:47:25.974793 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:25.974771 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb11af6_61e7_46ee_869b_43e5f2d58470.slice/crio-de102cabd010f453513a69e6003b8d6e790b257edf94667c9b8c8c57d969c4f4 WatchSource:0}: Error finding container de102cabd010f453513a69e6003b8d6e790b257edf94667c9b8c8c57d969c4f4: Status 404 returned error can't find the container with id de102cabd010f453513a69e6003b8d6e790b257edf94667c9b8c8c57d969c4f4 Jul 31 14:47:25.991583 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.991558 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" Jul 31 14:47:25.996503 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:25.996483 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:26.000588 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:26.000569 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89dd69ea_d7ff_4458_a116_664e30e5c913.slice/crio-43b67be0ddc1f74c9e361f8e8925993d16d93fb1f588a5cc5432434d18092b5e WatchSource:0}: Error finding container 43b67be0ddc1f74c9e361f8e8925993d16d93fb1f588a5cc5432434d18092b5e: Status 404 returned error can't find the container with id 43b67be0ddc1f74c9e361f8e8925993d16d93fb1f588a5cc5432434d18092b5e Jul 31 14:47:26.005387 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:47:26.005370 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f15a6fc_e2e1_4e8b_8205_bda7dbd36094.slice/crio-ef5f026baf5dc48c1f33822c7065fb071dfb993b154b5629825583025592d321 WatchSource:0}: Error finding container ef5f026baf5dc48c1f33822c7065fb071dfb993b154b5629825583025592d321: Status 404 returned error can't find the container with id ef5f026baf5dc48c1f33822c7065fb071dfb993b154b5629825583025592d321 Jul 31 14:47:26.007012 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.006994 2560 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-jlpsd_kube-system(6f15a6fc-e2e1-4e8b-8205-bda7dbd36094): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 31 14:47:26.007057 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.007024 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-jlpsd" podUID="6f15a6fc-e2e1-4e8b-8205-bda7dbd36094" Jul 31 14:47:26.022115 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.022099 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:26.080425 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.080402 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:26.270524 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.270436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:26.270524 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.270480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:26.270720 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.270582 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:26.270720 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.270584 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:26.270720 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.270634 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:47:27.270620994 +0000 UTC m=+3.116309519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:26.270720 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.270648 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:27.270641398 +0000 UTC m=+3.116329923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:26.370758 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.370715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:26.370955 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.370934 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:26.371050 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.370967 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:26.371050 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.370981 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:26.371159 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.371052 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:47:27.371031289 +0000 UTC m=+3.216719819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:26.623190 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.623102 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:42:26 +0000 UTC" deadline="2028-03-06 12:10:27.88937898 +0000 UTC" Jul 31 14:47:26.623190 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.623143 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14013h23m1.266240551s" Jul 31 14:47:26.774934 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.774890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:26.775116 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.775029 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:26.812235 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.812165 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" event={"ID":"1d7885553df81411020fc4e03d6f8d97","Type":"ContainerStarted","Data":"6f3d2af6f9132a576ded310a337c68e8892a25cd53ea92889d15351ee275cb7c"} Jul 31 14:47:26.821889 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.821848 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" event={"ID":"fbcff475c53247a65714e24c94325920","Type":"ContainerStarted","Data":"fb7f534633ccf1e26be6a79f7313e86a1a6e824dbe541cc26db821798d8d3039"} Jul 31 14:47:26.832150 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.832001 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"de102cabd010f453513a69e6003b8d6e790b257edf94667c9b8c8c57d969c4f4"} Jul 31 14:47:26.839825 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.839794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerStarted","Data":"529f2d737a1532e602d6776216afd45e5658f5bc4551adb9579947538fc528cc"} Jul 31 14:47:26.850440 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.850410 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" event={"ID":"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29","Type":"ContainerStarted","Data":"ba7d2b27129cd0804318cd25c7f8d03349dd0f27d427d3c5980207c6816cd675"} Jul 31 14:47:26.857573 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.857507 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jlpsd" event={"ID":"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094","Type":"ContainerStarted","Data":"ef5f026baf5dc48c1f33822c7065fb071dfb993b154b5629825583025592d321"} Jul 31 14:47:26.865568 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:26.865536 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:13a793596262f904c253062d1a856d35d787f0514effb969ceff913615754fd8\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-jlpsd" podUID="6f15a6fc-e2e1-4e8b-8205-bda7dbd36094" Jul 31 14:47:26.872404 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.872361 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" event={"ID":"89dd69ea-d7ff-4458-a116-664e30e5c913","Type":"ContainerStarted","Data":"43b67be0ddc1f74c9e361f8e8925993d16d93fb1f588a5cc5432434d18092b5e"} Jul 31 14:47:26.899045 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.898981 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6mxj" event={"ID":"d937e575-c105-4322-ab37-a7130a158f6e","Type":"ContainerStarted","Data":"c5e0f496f84c531de5794c4767c7d3c31d5f15d77cdfe2f7c400ea7d306d8b89"} Jul 31 14:47:26.917329 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.917283 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rmk2d" event={"ID":"b02538e3-a004-4422-9360-9b27ad6d8adc","Type":"ContainerStarted","Data":"9bc5ea5f6f22b355d2c5cbc391c7ef26a83fea3b9f7ceafb67f151072394e953"} Jul 31 14:47:26.938742 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.937577 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jdz2" event={"ID":"5e238aea-d9ad-4890-b118-90a93f997c34","Type":"ContainerStarted","Data":"ce51165aaa4ca0ad9b9d6ebe1c4a46e20cbe4aaf44f43157213cdc44f8bcc93e"} Jul 31 14:47:26.947662 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.947630 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xgg6x" event={"ID":"215ceb81-5dd4-4903-821f-97e22caec11d","Type":"ContainerStarted","Data":"744e6a3d4805162eaa39daecf6c80035d828d7f4d13bbccfbe7d62492cb2d9b3"} Jul 31 14:47:26.975950 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:26.975918 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:27.278568 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.278473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:27.278747 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.278568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:27.278747 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.278694 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:27.278901 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.278764 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:29.278743063 +0000 UTC m=+5.124431589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:27.279233 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.279214 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:27.279318 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.279273 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:47:29.279255482 +0000 UTC m=+5.124944011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:27.379511 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.379474 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:27.379700 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.379678 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:27.379784 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.379709 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:27.379784 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.379722 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:27.379784 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.379782 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:47:29.379763413 +0000 UTC m=+5.225451940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:27.624197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.624077 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 14:42:26 +0000 UTC" deadline="2028-01-03 10:00:46.756122883 +0000 UTC" Jul 31 14:47:27.624197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.624145 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12499h13m19.131982261s" Jul 31 14:47:27.773133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.772305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:27.773133 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.772476 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:27.773133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:27.772956 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:27.773133 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:27.773078 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:28.020523 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:28.020245 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 14:47:28.775605 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:28.775032 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:28.775605 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:28.775166 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:29.295851 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:29.295811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:29.296094 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:29.295951 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:29.296094 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.296083 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:29.296230 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.296141 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:33.296127904 +0000 UTC m=+9.141816429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:29.296230 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.296202 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:29.296349 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.296241 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:47:33.296228233 +0000 UTC m=+9.141916760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:29.397093 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:29.397059 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:29.397315 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.397291 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:29.397393 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.397319 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:29.397393 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.397333 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:29.397393 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.397387 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:47:33.397370146 +0000 UTC m=+9.243058674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:29.772429 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:29.772342 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:29.772604 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.772487 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:29.772985 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:29.772954 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:29.773125 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:29.773045 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:30.772293 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:30.772262 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:30.772796 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:30.772404 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:31.772374 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:31.771764 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:31.772374 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:31.771948 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:31.772971 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:31.772415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:31.772971 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:31.772562 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:32.771427 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:32.771391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:32.771595 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:32.771510 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:33.329659 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:33.329608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:33.330410 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:33.329684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:33.330410 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.329814 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:33.330410 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.329814 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:33.330410 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.329904 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:47:41.329861235 +0000 UTC m=+17.175549763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:33.330410 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.329935 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:41.329916239 +0000 UTC m=+17.175604770 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:33.430942 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:33.430727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:33.431123 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.430961 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:33.431123 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.430993 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:33.431123 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.431009 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:33.431123 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.431084 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:47:41.431062744 +0000 UTC m=+17.276751294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:33.772377 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:33.772268 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:33.772544 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:33.772412 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:33.772624 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.772540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:33.772624 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:33.772408 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:34.773187 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:34.773146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:34.773711 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:34.773285 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:35.772394 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:35.772361 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:35.772394 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:35.772408 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:35.772685 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:35.772525 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:35.772750 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:35.772670 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:36.772187 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:36.772151 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:36.772572 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:36.772282 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:37.771442 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:37.771370 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:37.771568 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:37.771370 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:37.771568 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:37.771490 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:37.771568 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:37.771548 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:38.771843 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:38.771796 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:38.772298 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:38.771945 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:39.772058 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:39.772030 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:39.772469 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:39.772039 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:39.772469 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:39.772129 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:39.772469 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:39.772249 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:40.771503 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:40.771466 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:40.771681 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:40.771603 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:41.390101 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:41.389895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:41.390599 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:41.390153 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:41.390599 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.390044 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:41.390599 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.390238 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:47:57.390214623 +0000 UTC m=+33.235903152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:41.390599 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.390241 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:41.390599 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.390282 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:47:57.390270021 +0000 UTC m=+33.235958544 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:41.490412 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:41.490382 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:41.490578 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.490561 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:41.490665 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.490584 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:41.490665 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.490598 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:41.490665 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.490661 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:47:57.490641764 +0000 UTC m=+33.336330304 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:41.772038 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:41.771954 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:41.772201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:41.771954 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:41.772201 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.772089 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:41.772201 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:41.772182 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:42.772464 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:42.772426 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:42.772908 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:42.772574 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:43.772155 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:43.772114 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:43.772362 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:43.772120 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:43.772362 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:43.772249 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:43.772362 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:43.772349 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:44.772408 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:44.772376 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:44.772886 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:44.772464 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:45.772006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:45.771976 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:45.772170 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:45.771981 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:45.772170 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:45.772102 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:45.772288 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:45.772185 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:46.771514 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.771486 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:46.772008 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:46.771615 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:46.992202 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.992151 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xgg6x" event={"ID":"215ceb81-5dd4-4903-821f-97e22caec11d","Type":"ContainerStarted","Data":"c9593eeacc888dd8cde99c6649452f8082cf2369f464b15f9f8cd3faeaa7ca05"} Jul 31 14:47:46.993931 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.993866 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" event={"ID":"1d7885553df81411020fc4e03d6f8d97","Type":"ContainerStarted","Data":"51a99ff49df0ecf095834edb70a7ecc0290bb8229e6b018a0dc633819e3a5df4"} Jul 31 14:47:46.995532 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.995503 2560 generic.go:356] "Generic (PLEG): container finished" podID="fbcff475c53247a65714e24c94325920" containerID="c3f72159be2cda5542b9b0c0463166a635bb5209d4e4388550e75c6e67337829" exitCode=0 Jul 31 14:47:46.995649 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.995599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" event={"ID":"fbcff475c53247a65714e24c94325920","Type":"ContainerDied","Data":"c3f72159be2cda5542b9b0c0463166a635bb5209d4e4388550e75c6e67337829"} Jul 31 14:47:46.998153 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.998126 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"126c6adcbd7ca6cb27092f0f8deade4a04071541a37d396d114d7c33d889cf39"} Jul 31 14:47:46.998239 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.998196 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"bd44280902c75968fc048f150f27b9e6cd31e872817fb48c62b31ea721a7a8cf"} Jul 31 14:47:46.998363 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.998238 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"69ee57d2a6d74247fd84819f7a71888e11a53f0ec5e0e6734b7c74fb2c86b96b"} Jul 31 14:47:46.999639 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:46.999607 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerStarted","Data":"730f4fe5869d4657afcd1e060bccc4029c1623c46235873edd951e1c0d790988"} Jul 31 14:47:47.001131 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.001107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" event={"ID":"150dbd7c-c55c-4b6d-b4aa-53c0db6f6f29","Type":"ContainerStarted","Data":"463d04a438c270a11d085518d484abbf7b3c6e4962ea44d78208bd32e21e5585"} Jul 31 14:47:47.002636 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.002615 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" event={"ID":"89dd69ea-d7ff-4458-a116-664e30e5c913","Type":"ContainerStarted","Data":"7f524e1b01efd45ea8651ad7eaf979c2774d9fed9f57ed6399fd16f83441da8a"} Jul 31 14:47:47.004077 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.004053 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n6mxj" event={"ID":"d937e575-c105-4322-ab37-a7130a158f6e","Type":"ContainerStarted","Data":"fde076fe7c3e5c7d458ad886e5a589b5371abdc44579ae588a4cca9c4498a3ef"} Jul 31 14:47:47.005544 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.005517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rmk2d" event={"ID":"b02538e3-a004-4422-9360-9b27ad6d8adc","Type":"ContainerStarted","Data":"545d6f679e3e681d3a1c634402fa98ce2b3c60a86ccc35046c27e5e27e9cbdd9"} Jul 31 14:47:47.013909 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.013871 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xgg6x" podStartSLOduration=1.9042299059999999 podStartE2EDuration="22.013856812s" totalImagesPullingTime="20.109626906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:47.013394402 +0000 UTC m=+22.859082948" watchObservedRunningTime="2026-07-31 14:47:47.013856812 +0000 UTC m=+22.859545359" Jul 31 14:47:47.030338 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.030301 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-167.ec2.internal" podStartSLOduration=21.030287867 podStartE2EDuration="21.030287867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:47.030099705 +0000 UTC m=+22.875788251" watchObservedRunningTime="2026-07-31 14:47:47.030287867 +0000 UTC m=+22.875976414" Jul 31 14:47:47.050863 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.050793 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jfkdk" podStartSLOduration=1.919262812 podStartE2EDuration="22.050778117s" totalImagesPullingTime="20.131515305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:47.050263513 +0000 UTC m=+22.895952058" watchObservedRunningTime="2026-07-31 14:47:47.050778117 +0000 UTC m=+22.896466664" Jul 31 14:47:47.066617 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.066542 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n6mxj" podStartSLOduration=2.22172982 podStartE2EDuration="22.066524137s" totalImagesPullingTime="19.844794317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:47.066337293 +0000 UTC m=+22.912025833" watchObservedRunningTime="2026-07-31 14:47:47.066524137 +0000 UTC m=+22.912212684" Jul 31 14:47:47.114513 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.114457 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rmk2d" podStartSLOduration=6.17382765 podStartE2EDuration="22.114436605s" totalImagesPullingTime="15.940608955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:47.114249974 +0000 UTC m=+22.959938520" watchObservedRunningTime="2026-07-31 14:47:47.114436605 +0000 UTC m=+22.960125149" Jul 31 14:47:47.771793 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.771588 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:47.772365 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:47.771588 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:47.772365 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:47.771914 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:47.772365 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:47.772014 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:48.012214 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.012122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jdz2" event={"ID":"5e238aea-d9ad-4890-b118-90a93f997c34","Type":"ContainerStarted","Data":"731186dde16d96222af5f47c40614fce7a5233982308e5d25c262ac1d9ebb9e1"} Jul 31 14:47:48.015956 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.015739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"917bde8cf0ed22e872ad6083ca2671cb60e876e7f9b5df8a40cadfa233c96257"} Jul 31 14:47:48.015956 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.015823 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"3f008ff0a0c24950a760ef833d0beb928e4d90f6fedbe1a1477f2873e23cb56a"} Jul 31 14:47:48.015956 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.015921 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"826c1773f18324fd4e8fc5330d9b9756d0a3686a13bb175606a3a4f6f354090f"} Jul 31 14:47:48.017530 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.017494 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7cafd9d-437a-4dde-a61e-9a3d5859db3c" containerID="730f4fe5869d4657afcd1e060bccc4029c1623c46235873edd951e1c0d790988" exitCode=0 Jul 31 14:47:48.017641 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.017576 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerDied","Data":"730f4fe5869d4657afcd1e060bccc4029c1623c46235873edd951e1c0d790988"} Jul 31 14:47:48.019120 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.019028 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jlpsd" event={"ID":"6f15a6fc-e2e1-4e8b-8205-bda7dbd36094","Type":"ContainerStarted","Data":"c4a8c2b3302e5ef8af0b76bdb5b55d8bcb8accb77b62055903f663756a809fb4"} Jul 31 14:47:48.028422 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.028379 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7jdz2" podStartSLOduration=2.935492644 podStartE2EDuration="23.028363598s" totalImagesPullingTime="20.092870954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:48.028053192 +0000 UTC m=+23.873741740" watchObservedRunningTime="2026-07-31 14:47:48.028363598 +0000 UTC m=+23.874052146" Jul 31 14:47:48.041728 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.041695 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jlpsd" podStartSLOduration=0.430949735 podStartE2EDuration="22.041684126s" totalImagesPullingTime="21.610734391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-31 14:47:48.041613507 +0000 UTC m=+23.887302052" watchObservedRunningTime="2026-07-31 14:47:48.041684126 +0000 UTC m=+23.887372670" Jul 31 14:47:48.430117 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.430097 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 14:47:48.623091 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.622951 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T14:47:48.430113027Z","UUID":"9d79ee41-a684-424f-8f40-04726c9022b9","Handler":null,"Name":"","Endpoint":""} Jul 31 14:47:48.624341 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.624318 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 14:47:48.624473 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.624360 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 14:47:48.772160 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:48.772126 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:48.772580 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:48.772247 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:49.023276 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:49.023204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" event={"ID":"fbcff475c53247a65714e24c94325920","Type":"ContainerStarted","Data":"e468ae90a27d64d8c9e7e89fdba15402282af01f1713b5b69c41d5b1fbee5dff"} Jul 31 14:47:49.024863 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:49.024840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" event={"ID":"89dd69ea-d7ff-4458-a116-664e30e5c913","Type":"ContainerStarted","Data":"bf0c1d88c791d70048b2b2762f7778c01f2207ab0b9980fda3caba4fd6b5239a"} Jul 31 14:47:49.039035 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:49.038992 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-167.ec2.internal" podStartSLOduration=23.038975887 podStartE2EDuration="23.038975887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:49.038389498 +0000 UTC m=+24.884078043" watchObservedRunningTime="2026-07-31 14:47:49.038975887 +0000 UTC m=+24.884664434" Jul 31 14:47:49.771542 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:49.771519 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:49.771665 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:49.771555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:49.771665 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:49.771642 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:49.771886 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:49.771802 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:50.031296 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:50.031217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"642add0c10baeab3924498c0294df5ce60e1a341dfe258166adb167093405cea"} Jul 31 14:47:50.033356 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:50.033320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" event={"ID":"89dd69ea-d7ff-4458-a116-664e30e5c913","Type":"ContainerStarted","Data":"20c3e516f0f6ce2e97663596b4fa047ff85b2a8d0f1aa2ef8f40cc5de0d11481"} Jul 31 14:47:50.050606 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:50.050563 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rmgrf" podStartSLOduration=1.412412246 podStartE2EDuration="24.050550633s" totalImagesPullingTime="22.638138387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:50.050482825 +0000 UTC m=+25.896171380" watchObservedRunningTime="2026-07-31 14:47:50.050550633 +0000 UTC m=+25.896239178" Jul 31 14:47:50.635619 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:50.635588 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:50.636262 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:50.636243 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:50.772399 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:50.772368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:50.772591 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:50.772502 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:51.035738 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:51.035672 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:51.036096 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:51.035924 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jlpsd" Jul 31 14:47:51.771372 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:51.771341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:51.771545 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:51.771338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:51.771545 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:51.771457 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:51.771545 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:51.771535 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:52.771454 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:52.771422 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:52.771903 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:52.771536 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:53.771753 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:53.771530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:53.772432 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:53.771530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:53.772432 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:53.771793 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:53.772432 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:53.771857 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:54.045362 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.045268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" event={"ID":"edb11af6-61e7-46ee-869b-43e5f2d58470","Type":"ContainerStarted","Data":"179815258fcf6a572d8e97ee639812b3945e4e159fad096aba641b6da3397f1f"} Jul 31 14:47:54.045513 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.045489 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:54.047055 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.047024 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7cafd9d-437a-4dde-a61e-9a3d5859db3c" containerID="2de02ee471fcd7d53e5b45f4979447d0884b98706b36ec0fc9a3c5b714231cfd" exitCode=0 Jul 31 14:47:54.047141 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.047063 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerDied","Data":"2de02ee471fcd7d53e5b45f4979447d0884b98706b36ec0fc9a3c5b714231cfd"} Jul 31 14:47:54.060670 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.060650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:54.071107 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.071070 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" podStartSLOduration=7.548635297 podStartE2EDuration="28.071058601s" totalImagesPullingTime="20.522423304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:47:54.06993634 +0000 UTC m=+29.915624885" watchObservedRunningTime="2026-07-31 14:47:54.071058601 +0000 UTC m=+29.916747146" Jul 31 14:47:54.776482 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:54.776300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:54.776969 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:54.776566 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:55.052625 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.052581 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 31 14:47:55.053640 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.053472 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:55.054090 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.054048 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9kc6"] Jul 31 14:47:55.054184 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.054153 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:55.054266 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:55.054241 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:55.056986 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.056961 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tfmsm"] Jul 31 14:47:55.057153 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.057121 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:55.057243 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.057225 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdv99"] Jul 31 14:47:55.057299 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:55.057241 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:55.057362 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.057315 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:55.057423 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:55.057402 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:55.070016 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.069997 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:55.209433 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:55.209398 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:47:56.056262 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:56.056227 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7cafd9d-437a-4dde-a61e-9a3d5859db3c" containerID="7a9b1fd233ecfe542da5f906d6f073f712bca55df0688bd6e67e02f579bf3eca" exitCode=0 Jul 31 14:47:56.056556 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:56.056309 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerDied","Data":"7a9b1fd233ecfe542da5f906d6f073f712bca55df0688bd6e67e02f579bf3eca"} Jul 31 14:47:56.772506 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:56.772479 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:56.772614 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:56.772501 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:56.772667 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:56.772608 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:56.772728 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:56.772688 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:56.772728 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:56.772710 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:56.772813 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:56.772789 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:57.060540 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:57.060505 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7cafd9d-437a-4dde-a61e-9a3d5859db3c" containerID="40ce766e02e9b4e044129abb93e5c7c8f1d0c32a0193f5978b857e4a6f847232" exitCode=0 Jul 31 14:47:57.060978 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:57.060594 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerDied","Data":"40ce766e02e9b4e044129abb93e5c7c8f1d0c32a0193f5978b857e4a6f847232"} Jul 31 14:47:57.406781 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:57.406702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:57.406781 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:57.406756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:57.406967 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.406857 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:57.406967 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.406862 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:57.406967 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.406905 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:29.406891861 +0000 UTC m=+65.252580384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 14:47:57.406967 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.406917 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret podName:2af4e5ca-f70c-4f2e-a052-4603774c13ea nodeName:}" failed. No retries permitted until 2026-07-31 14:48:29.406911751 +0000 UTC m=+65.252600273 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret") pod "global-pull-secret-syncer-s9kc6" (UID: "2af4e5ca-f70c-4f2e-a052-4603774c13ea") : object "kube-system"/"original-pull-secret" not registered Jul 31 14:47:57.507998 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:57.507965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:57.508167 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.508096 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 14:47:57.508167 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.508109 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 14:47:57.508167 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.508117 2560 projected.go:196] Error preparing data for projected volume kube-api-access-s4qdt for pod openshift-network-diagnostics/network-check-target-rdv99: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:57.508167 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:57.508161 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt podName:12727d0b-6de8-4da8-9130-4e29acf07a7d nodeName:}" failed. No retries permitted until 2026-07-31 14:48:29.508149329 +0000 UTC m=+65.353837852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s4qdt" (UniqueName: "kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt") pod "network-check-target-rdv99" (UID: "12727d0b-6de8-4da8-9130-4e29acf07a7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 14:47:58.771474 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:58.771448 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:47:58.771936 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:58.771450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:47:58.771936 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:58.771570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:47:58.771936 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:58.771568 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tfmsm" podUID="5fb7fa83-52a0-40e4-b330-f5e759c766b1" Jul 31 14:47:58.771936 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:58.771664 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s9kc6" podUID="2af4e5ca-f70c-4f2e-a052-4603774c13ea" Jul 31 14:47:58.771936 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:47:58.771738 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdv99" podUID="12727d0b-6de8-4da8-9130-4e29acf07a7d" Jul 31 14:47:59.984277 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:59.984244 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-167.ec2.internal" event="NodeReady" Jul 31 14:47:59.984680 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:47:59.984405 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 14:48:00.039226 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.039195 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-689f7f5dd8-cwzs8"] Jul 31 14:48:00.096412 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.096376 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6ctks"] Jul 31 14:48:00.096573 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.096498 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.099611 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.099588 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 14:48:00.100447 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.099767 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m7lrf\"" Jul 31 14:48:00.100447 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.099908 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 14:48:00.100447 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.099991 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 14:48:00.109603 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.109581 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689f7f5dd8-cwzs8"] Jul 31 14:48:00.109736 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.109614 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nxqts"] Jul 31 14:48:00.109736 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.109708 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.110555 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.110537 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 14:48:00.112674 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.112655 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 14:48:00.112801 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.112784 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 14:48:00.121954 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.121933 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4w6d9\"" Jul 31 14:48:00.127613 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.127594 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6ctks"] Jul 31 14:48:00.127708 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.127627 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxqts"] Jul 31 14:48:00.127708 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.127704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.134541 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.134462 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 14:48:00.134541 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.134519 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.134818 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.134797 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ls75f\"" Jul 31 14:48:00.135553 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.135535 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.225637 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225606 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.225804 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225655 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jns4q\" (UniqueName: \"kubernetes.io/projected/b54f5fcf-bea1-4521-af00-e4388825ddf1-kube-api-access-jns4q\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.225804 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-installation-pull-secrets\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.225804 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-bound-sa-token\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.225804 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xln4d\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-kube-api-access-xln4d\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.225804 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b54f5fcf-bea1-4521-af00-e4388825ddf1-config-volume\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-image-registry-private-configuration\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b54f5fcf-bea1-4521-af00-e4388825ddf1-tmp-dir\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/755ee731-917b-4b51-9a87-751e5dc3c4f1-ca-trust-extracted\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.225977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-certificates\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.226028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-trusted-ca\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.226063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.226051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adc07795-e3d1-4c0f-9ff4-64298b2e8386-cert\") pod \"ingress-canary-nxqts\" (UID: \"adc07795-e3d1-4c0f-9ff4-64298b2e8386\") " pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.226339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.226173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k457g\" (UniqueName: \"kubernetes.io/projected/adc07795-e3d1-4c0f-9ff4-64298b2e8386-kube-api-access-k457g\") pod \"ingress-canary-nxqts\" (UID: \"adc07795-e3d1-4c0f-9ff4-64298b2e8386\") " pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.326922 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.326887 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xln4d\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-kube-api-access-xln4d\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.326922 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.326923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b54f5fcf-bea1-4521-af00-e4388825ddf1-config-volume\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.327102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.326939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-image-registry-private-configuration\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.326956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.326993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b54f5fcf-bea1-4521-af00-e4388825ddf1-tmp-dir\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.327102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327021 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/755ee731-917b-4b51-9a87-751e5dc3c4f1-ca-trust-extracted\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-certificates\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327139 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-trusted-ca\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327176 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adc07795-e3d1-4c0f-9ff4-64298b2e8386-cert\") pod \"ingress-canary-nxqts\" (UID: \"adc07795-e3d1-4c0f-9ff4-64298b2e8386\") " pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k457g\" (UniqueName: \"kubernetes.io/projected/adc07795-e3d1-4c0f-9ff4-64298b2e8386-kube-api-access-k457g\") pod \"ingress-canary-nxqts\" (UID: \"adc07795-e3d1-4c0f-9ff4-64298b2e8386\") " pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.327273 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.327288 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327302 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.327332 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jns4q\" (UniqueName: \"kubernetes.io/projected/b54f5fcf-bea1-4521-af00-e4388825ddf1-kube-api-access-jns4q\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.327665 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327357 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-installation-pull-secrets\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327665 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-bound-sa-token\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327665 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327419 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b54f5fcf-bea1-4521-af00-e4388825ddf1-tmp-dir\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.327665 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327497 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/755ee731-917b-4b51-9a87-751e5dc3c4f1-ca-trust-extracted\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.327665 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b54f5fcf-bea1-4521-af00-e4388825ddf1-config-volume\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.327665 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.327608 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:00.827587854 +0000 UTC m=+36.673276376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:00.328003 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.327702 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-certificates\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.328003 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.327751 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:00.328003 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.327815 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:00.82780117 +0000 UTC m=+36.673489698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:00.328361 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.328339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-trusted-ca\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.331463 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.331357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-image-registry-private-configuration\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.331559 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.331361 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/adc07795-e3d1-4c0f-9ff4-64298b2e8386-cert\") pod \"ingress-canary-nxqts\" (UID: \"adc07795-e3d1-4c0f-9ff4-64298b2e8386\") " pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.331559 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.331365 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-installation-pull-secrets\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.341475 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.341455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xln4d\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-kube-api-access-xln4d\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.343533 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.343508 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k457g\" (UniqueName: \"kubernetes.io/projected/adc07795-e3d1-4c0f-9ff4-64298b2e8386-kube-api-access-k457g\") pod \"ingress-canary-nxqts\" (UID: \"adc07795-e3d1-4c0f-9ff4-64298b2e8386\") " pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.343533 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.343522 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jns4q\" (UniqueName: \"kubernetes.io/projected/b54f5fcf-bea1-4521-af00-e4388825ddf1-kube-api-access-jns4q\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.343955 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.343932 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-bound-sa-token\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.437479 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.437407 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nxqts" Jul 31 14:48:00.654745 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.654721 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nxqts"] Jul 31 14:48:00.656996 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:48:00.656964 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc07795_e3d1_4c0f_9ff4_64298b2e8386.slice/crio-544915910f6f26ff3ea40976247c9c20aa11dfda300cbfba1a3d6d209a5938a8 WatchSource:0}: Error finding container 544915910f6f26ff3ea40976247c9c20aa11dfda300cbfba1a3d6d209a5938a8: Status 404 returned error can't find the container with id 544915910f6f26ff3ea40976247c9c20aa11dfda300cbfba1a3d6d209a5938a8 Jul 31 14:48:00.772415 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.772350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:48:00.772415 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.772389 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:48:00.772605 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.772350 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:48:00.776435 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.776401 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:48:00.776687 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.776641 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:48:00.776793 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.776699 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ljf7\"" Jul 31 14:48:00.776793 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.776748 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:48:00.776957 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.776936 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:48:00.777164 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.777127 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-262fz\"" Jul 31 14:48:00.832415 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.832388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:00.832525 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:00.832430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:00.832595 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.832539 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:00.832595 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.832557 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:00.832595 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.832536 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:00.832774 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.832611 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:01.832593577 +0000 UTC m=+37.678282115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:00.832774 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:00.832626 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:01.832619137 +0000 UTC m=+37.678307660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:01.008999 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:01.008959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:01.072416 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:01.072347 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxqts" event={"ID":"adc07795-e3d1-4c0f-9ff4-64298b2e8386","Type":"ContainerStarted","Data":"544915910f6f26ff3ea40976247c9c20aa11dfda300cbfba1a3d6d209a5938a8"} Jul 31 14:48:01.112365 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:01.112325 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:01.840486 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:01.840449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:01.840660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:01.840573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:01.840715 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:01.840649 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:01.840715 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:01.840673 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:01.840715 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:01.840694 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:01.840872 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:01.840741 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:03.840717571 +0000 UTC m=+39.686406105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:01.840872 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:01.840761 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:03.840751549 +0000 UTC m=+39.686440076 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:03.080736 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:03.080695 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7cafd9d-437a-4dde-a61e-9a3d5859db3c" containerID="8625145e49b8c802005b56e5fbed0361aa37cae14f6796753b51248e611e367d" exitCode=0 Jul 31 14:48:03.081334 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:03.080773 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerDied","Data":"8625145e49b8c802005b56e5fbed0361aa37cae14f6796753b51248e611e367d"} Jul 31 14:48:03.854884 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:03.854803 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:03.854884 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:03.854885 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:03.855113 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:03.854978 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:03.855113 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:03.855048 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:03.855113 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:03.855060 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:07.855035947 +0000 UTC m=+43.700724497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:03.855113 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:03.855068 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:03.855264 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:03.855124 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:07.855105971 +0000 UTC m=+43.700794496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:04.061276 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:04.061242 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:04.086847 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:04.086792 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7cafd9d-437a-4dde-a61e-9a3d5859db3c" containerID="db267c33c9bb73e24cd84738770d6e3d7e5d1296231d00530c35a90fa13d8e52" exitCode=0 Jul 31 14:48:04.087252 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:04.086859 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerDied","Data":"db267c33c9bb73e24cd84738770d6e3d7e5d1296231d00530c35a90fa13d8e52"} Jul 31 14:48:04.161614 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:04.161519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:05.092624 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:05.092534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" event={"ID":"a7cafd9d-437a-4dde-a61e-9a3d5859db3c","Type":"ContainerStarted","Data":"287bcb47968f1c6abbe2d9f157e8cc3fe2af96a1ccb2f99b635f3a4cfe6620da"} Jul 31 14:48:05.093939 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:05.093905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nxqts" event={"ID":"adc07795-e3d1-4c0f-9ff4-64298b2e8386","Type":"ContainerStarted","Data":"d8330d41e4021fe6925e7688c411d86e3c798ad33b3837db047b6b385a8d8baf"} Jul 31 14:48:05.119027 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:05.118976 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xqtm4" podStartSLOduration=7.972411966 podStartE2EDuration="40.118962034s" totalImagesPullingTime="32.146550068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:05.118149029 +0000 UTC m=+40.963837574" watchObservedRunningTime="2026-07-31 14:48:05.118962034 +0000 UTC m=+40.964650580" Jul 31 14:48:05.135693 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:05.135646 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nxqts" podStartSLOduration=0.988085367 podStartE2EDuration="5.135634315s" totalImagesPullingTime="4.147548948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:05.135571976 +0000 UTC m=+40.981260536" watchObservedRunningTime="2026-07-31 14:48:05.135634315 +0000 UTC m=+40.981322862" Jul 31 14:48:05.349787 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:05.349708 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:05.411874 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:05.411848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:07.884020 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:07.883981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:07.884473 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:07.884030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:07.884473 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:07.884148 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:07.884473 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:07.884153 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:07.884473 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:07.884237 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:15.884217454 +0000 UTC m=+51.729905977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:07.884473 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:07.884160 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:07.884473 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:07.884296 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:15.884282418 +0000 UTC m=+51.729970941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:09.422401 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:09.422355 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:09.618689 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:09.618657 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:09.731233 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:09.731132 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:09.828044 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:09.828007 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:10.641215 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:10.641179 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:10.742537 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:10.742506 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:15.948644 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:15.948597 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:15.949188 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:15.948655 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:15.949188 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:15.948743 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:15.949188 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:15.948777 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:15.949188 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:15.948793 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:15.949188 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:15.948820 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.948804069 +0000 UTC m=+67.794492593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:15.949188 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:15.948870 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.948854298 +0000 UTC m=+67.794542821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:18.862311 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:18.862270 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" limit=1024 Jul 31 14:48:27.070485 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:27.070453 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-76j6l" Jul 31 14:48:29.448237 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.448179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:48:29.448630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.448259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:48:29.450868 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.450848 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 14:48:29.450935 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.450916 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 14:48:29.458837 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:29.458815 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 14:48:29.458896 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:29.458886 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs podName:5fb7fa83-52a0-40e4-b330-f5e759c766b1 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:33.458871604 +0000 UTC m=+129.304560127 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs") pod "network-metrics-daemon-tfmsm" (UID: "5fb7fa83-52a0-40e4-b330-f5e759c766b1") : secret "metrics-daemon-secret" not found Jul 31 14:48:29.461521 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.461504 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2af4e5ca-f70c-4f2e-a052-4603774c13ea-original-pull-secret\") pod \"global-pull-secret-syncer-s9kc6\" (UID: \"2af4e5ca-f70c-4f2e-a052-4603774c13ea\") " pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:48:29.549218 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.549183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:48:29.551621 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.551606 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 14:48:29.561838 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.561811 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 14:48:29.572066 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.572047 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4qdt\" (UniqueName: \"kubernetes.io/projected/12727d0b-6de8-4da8-9130-4e29acf07a7d-kube-api-access-s4qdt\") pod \"network-check-target-rdv99\" (UID: \"12727d0b-6de8-4da8-9130-4e29acf07a7d\") " pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:48:29.586373 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.586352 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6ljf7\"" Jul 31 14:48:29.594414 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.594400 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:48:29.595580 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.595565 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s9kc6" Jul 31 14:48:29.725984 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.725905 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdv99"] Jul 31 14:48:29.729450 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:48:29.729425 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12727d0b_6de8_4da8_9130_4e29acf07a7d.slice/crio-7ff3b91fc2f58577fe8f0cc36eb434dc99905cf2865f56f2086c72b58599f58c WatchSource:0}: Error finding container 7ff3b91fc2f58577fe8f0cc36eb434dc99905cf2865f56f2086c72b58599f58c: Status 404 returned error can't find the container with id 7ff3b91fc2f58577fe8f0cc36eb434dc99905cf2865f56f2086c72b58599f58c Jul 31 14:48:29.741801 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:29.741776 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s9kc6"] Jul 31 14:48:29.744672 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:48:29.744649 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af4e5ca_f70c_4f2e_a052_4603774c13ea.slice/crio-6e55e5e7a703889df0b3f18461d13b9ef61644e9cb472077b3b3f89237b7a48e WatchSource:0}: Error finding container 6e55e5e7a703889df0b3f18461d13b9ef61644e9cb472077b3b3f89237b7a48e: Status 404 returned error can't find the container with id 6e55e5e7a703889df0b3f18461d13b9ef61644e9cb472077b3b3f89237b7a48e Jul 31 14:48:30.153988 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.153949 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9kc6" event={"ID":"2af4e5ca-f70c-4f2e-a052-4603774c13ea","Type":"ContainerStarted","Data":"6e55e5e7a703889df0b3f18461d13b9ef61644e9cb472077b3b3f89237b7a48e"} Jul 31 14:48:30.155264 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.155236 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdv99" event={"ID":"12727d0b-6de8-4da8-9130-4e29acf07a7d","Type":"ContainerStarted","Data":"7ff3b91fc2f58577fe8f0cc36eb434dc99905cf2865f56f2086c72b58599f58c"} Jul 31 14:48:30.853299 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.853119 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh"] Jul 31 14:48:30.856114 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.856091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" Jul 31 14:48:30.863354 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.863120 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:30.863354 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.863206 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-mqzxn\"" Jul 31 14:48:30.863354 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.863128 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:30.875910 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.875884 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh"] Jul 31 14:48:30.878458 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.878425 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n"] Jul 31 14:48:30.883132 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.883098 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:30.886660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.886031 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-v27qf\"" Jul 31 14:48:30.886660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.886067 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 31 14:48:30.886660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.886104 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:30.886660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.886350 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:30.886660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.886557 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 31 14:48:30.891121 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.891072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n"] Jul 31 14:48:30.960193 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.960161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgddt\" (UniqueName: \"kubernetes.io/projected/1112877a-8af3-47c3-9731-8c6df30d0281-kube-api-access-zgddt\") pod \"volume-data-source-validator-5b8776669-zvpjh\" (UID: \"1112877a-8af3-47c3-9731-8c6df30d0281\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" Jul 31 14:48:30.960366 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.960202 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4b42702-60bb-4c51-956f-8646edf947ac-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:30.960366 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.960230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxtv\" (UniqueName: \"kubernetes.io/projected/a4b42702-60bb-4c51-956f-8646edf947ac-kube-api-access-xxxtv\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:30.960366 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.960327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4b42702-60bb-4c51-956f-8646edf947ac-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:30.963096 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.962053 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt"] Jul 31 14:48:30.964995 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.964974 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-hpgvd"] Jul 31 14:48:30.965137 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.965122 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" Jul 31 14:48:30.967800 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.967778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zwnd8\"" Jul 31 14:48:30.968123 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.968103 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:30.972135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.971045 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 31 14:48:30.972135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.971306 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:30.972135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.971463 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kf5tg\"" Jul 31 14:48:30.972135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.971585 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:30.972135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.971880 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 31 14:48:30.982053 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.981925 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4"] Jul 31 14:48:30.985038 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.985021 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks"] Jul 31 14:48:30.985174 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.985160 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:30.987565 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.987543 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8lzt4\"" Jul 31 14:48:30.988034 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.987916 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 31 14:48:30.988734 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.988710 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6"] Jul 31 14:48:30.989605 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.989347 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:30.989605 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.989488 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 31 14:48:30.990223 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.990204 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 31 14:48:30.991628 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.991608 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt"] Jul 31 14:48:30.991701 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.991686 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-hpgvd"] Jul 31 14:48:30.991800 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.991788 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:30.995864 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.995845 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 14:48:30.996187 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.996170 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 31 14:48:30.996424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.996403 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x7r76\"" Jul 31 14:48:30.996654 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.996637 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:30.996903 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.996883 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 31 14:48:30.997442 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.997423 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 14:48:30.997661 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.997641 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:30.998047 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.998017 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 31 14:48:30.998259 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.998241 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lbh57\"" Jul 31 14:48:30.998476 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:30.998457 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 31 14:48:31.001352 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.001303 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks"] Jul 31 14:48:31.003613 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.003570 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6"] Jul 31 14:48:31.005481 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.005460 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4"] Jul 31 14:48:31.061797 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.061760 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kw45\" (UniqueName: \"kubernetes.io/projected/8a0ce514-a697-47a3-aa49-e5b76df3a2ab-kube-api-access-5kw45\") pod \"network-check-source-65bdbbff45-6frvt\" (UID: \"8a0ce514-a697-47a3-aa49-e5b76df3a2ab\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" Jul 31 14:48:31.061977 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.061801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b348026-4c9d-45cc-b04b-cb4e52606a70-serving-cert\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.061977 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.061858 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe953075-526b-4133-81b9-a0d9a28fb43c-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:31.061977 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.061923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20e9d578-befb-479e-a4fb-8446a9bf99b5-config\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.061977 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.061966 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20e9d578-befb-479e-a4fb-8446a9bf99b5-serving-cert\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.062161 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxtv\" (UniqueName: \"kubernetes.io/projected/a4b42702-60bb-4c51-956f-8646edf947ac-kube-api-access-xxxtv\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.062161 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgddt\" (UniqueName: \"kubernetes.io/projected/1112877a-8af3-47c3-9731-8c6df30d0281-kube-api-access-zgddt\") pod \"volume-data-source-validator-5b8776669-zvpjh\" (UID: \"1112877a-8af3-47c3-9731-8c6df30d0281\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" Jul 31 14:48:31.062161 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b348026-4c9d-45cc-b04b-cb4e52606a70-config\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.062161 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4b42702-60bb-4c51-956f-8646edf947ac-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.062161 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062134 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:31.062393 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbxq9\" (UniqueName: \"kubernetes.io/projected/20e9d578-befb-479e-a4fb-8446a9bf99b5-kube-api-access-qbxq9\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.062393 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4b42702-60bb-4c51-956f-8646edf947ac-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.062393 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwplv\" (UniqueName: \"kubernetes.io/projected/3b348026-4c9d-45cc-b04b-cb4e52606a70-kube-api-access-fwplv\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.062393 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062281 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.062393 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/716e7166-1d2c-4b23-97b0-9cb65e38f7db-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.062393 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062384 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx8td\" (UniqueName: \"kubernetes.io/projected/716e7166-1d2c-4b23-97b0-9cb65e38f7db-kube-api-access-zx8td\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.062669 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062412 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20e9d578-befb-479e-a4fb-8446a9bf99b5-trusted-ca\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.062742 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.062725 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4b42702-60bb-4c51-956f-8646edf947ac-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.064962 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.064921 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4b42702-60bb-4c51-956f-8646edf947ac-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.067320 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.067288 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb"] Jul 31 14:48:31.071790 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.071635 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.079079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.078847 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 31 14:48:31.079079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.078873 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 31 14:48:31.079079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.078889 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 31 14:48:31.082413 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.082372 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jkvjj\"" Jul 31 14:48:31.085882 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.085855 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxtv\" (UniqueName: \"kubernetes.io/projected/a4b42702-60bb-4c51-956f-8646edf947ac-kube-api-access-xxxtv\") pod \"kube-storage-version-migrator-operator-7878f4b88c-sdh6n\" (UID: \"a4b42702-60bb-4c51-956f-8646edf947ac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.087275 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.087254 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgddt\" (UniqueName: \"kubernetes.io/projected/1112877a-8af3-47c3-9731-8c6df30d0281-kube-api-access-zgddt\") pod \"volume-data-source-validator-5b8776669-zvpjh\" (UID: \"1112877a-8af3-47c3-9731-8c6df30d0281\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" Jul 31 14:48:31.091541 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.091480 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb"] Jul 31 14:48:31.120748 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.120424 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-8zj96"] Jul 31 14:48:31.125919 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.125783 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7758b75b96-jp5tv"] Jul 31 14:48:31.126034 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.125933 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.128507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.128486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 14:48:31.129091 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.128819 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 14:48:31.129091 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.128858 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 31 14:48:31.129091 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.128869 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 31 14:48:31.129091 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.128820 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dphw9\"" Jul 31 14:48:31.129408 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.129391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.132797 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.132778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 31 14:48:31.132998 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.132984 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 31 14:48:31.133314 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.133279 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 31 14:48:31.133489 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.133473 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 31 14:48:31.134049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.133661 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 31 14:48:31.134049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.133841 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 31 14:48:31.134049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.133916 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8pjtg\"" Jul 31 14:48:31.138769 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.138748 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 31 14:48:31.140251 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.140234 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-8zj96"] Jul 31 14:48:31.141136 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.141114 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7758b75b96-jp5tv"] Jul 31 14:48:31.163153 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163132 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20e9d578-befb-479e-a4fb-8446a9bf99b5-config\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.163268 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163168 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20e9d578-befb-479e-a4fb-8446a9bf99b5-serving-cert\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.163268 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163195 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-stats-auth\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.163268 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163772 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b348026-4c9d-45cc-b04b-cb4e52606a70-config\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-default-certificate\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxq9\" (UniqueName: \"kubernetes.io/projected/20e9d578-befb-479e-a4fb-8446a9bf99b5-kube-api-access-qbxq9\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vslq\" (UniqueName: \"kubernetes.io/projected/d20379c4-8bbb-4753-af85-84f4c8f593bc-kube-api-access-7vslq\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76459ad2-12db-4330-9042-be87b3365cba-trusted-ca-bundle\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwplv\" (UniqueName: \"kubernetes.io/projected/3b348026-4c9d-45cc-b04b-cb4e52606a70-kube-api-access-fwplv\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76459ad2-12db-4330-9042-be87b3365cba-service-ca-bundle\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.163979 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvn5\" (UniqueName: \"kubernetes.io/projected/76459ad2-12db-4330-9042-be87b3365cba-kube-api-access-chvn5\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/716e7166-1d2c-4b23-97b0-9cb65e38f7db-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164094 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/20e9d578-befb-479e-a4fb-8446a9bf99b5-config\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx8td\" (UniqueName: \"kubernetes.io/projected/716e7166-1d2c-4b23-97b0-9cb65e38f7db-kube-api-access-zx8td\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.164803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20e9d578-befb-479e-a4fb-8446a9bf99b5-trusted-ca\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khpvh\" (UniqueName: \"kubernetes.io/projected/152bf7b5-8e6e-4f17-9b60-d23c24287110-kube-api-access-khpvh\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76459ad2-12db-4330-9042-be87b3365cba-tmp\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.164298 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.164363 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert podName:fe953075-526b-4133-81b9-a0d9a28fb43c nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.664345521 +0000 UTC m=+67.510034044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-p4nb4" (UID: "fe953075-526b-4133-81b9-a0d9a28fb43c") : secret "networking-console-plugin-cert" not found Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164579 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b348026-4c9d-45cc-b04b-cb4e52606a70-config\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.164779 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.164854 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls podName:716e7166-1d2c-4b23-97b0-9cb65e38f7db nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.664814042 +0000 UTC m=+67.510502584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-6p9ks" (UID: "716e7166-1d2c-4b23-97b0-9cb65e38f7db") : secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164911 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kw45\" (UniqueName: \"kubernetes.io/projected/8a0ce514-a697-47a3-aa49-e5b76df3a2ab-kube-api-access-5kw45\") pod \"network-check-source-65bdbbff45-6frvt\" (UID: \"8a0ce514-a697-47a3-aa49-e5b76df3a2ab\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.164965 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b348026-4c9d-45cc-b04b-cb4e52606a70-serving-cert\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe953075-526b-4133-81b9-a0d9a28fb43c-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165033 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/716e7166-1d2c-4b23-97b0-9cb65e38f7db-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165045 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20e9d578-befb-479e-a4fb-8446a9bf99b5-trusted-ca\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165051 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/76459ad2-12db-4330-9042-be87b3365cba-snapshots\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165105 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.165648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76459ad2-12db-4330-9042-be87b3365cba-serving-cert\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.166279 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.165721 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fe953075-526b-4133-81b9-a0d9a28fb43c-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:31.167553 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.167519 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/20e9d578-befb-479e-a4fb-8446a9bf99b5-serving-cert\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.167648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.167583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b348026-4c9d-45cc-b04b-cb4e52606a70-serving-cert\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.167648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.167599 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" Jul 31 14:48:31.180009 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.179986 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kw45\" (UniqueName: \"kubernetes.io/projected/8a0ce514-a697-47a3-aa49-e5b76df3a2ab-kube-api-access-5kw45\") pod \"network-check-source-65bdbbff45-6frvt\" (UID: \"8a0ce514-a697-47a3-aa49-e5b76df3a2ab\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" Jul 31 14:48:31.180803 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.180773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx8td\" (UniqueName: \"kubernetes.io/projected/716e7166-1d2c-4b23-97b0-9cb65e38f7db-kube-api-access-zx8td\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.181349 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.181297 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwplv\" (UniqueName: \"kubernetes.io/projected/3b348026-4c9d-45cc-b04b-cb4e52606a70-kube-api-access-fwplv\") pod \"service-ca-operator-784f97bcf6-vkzp6\" (UID: \"3b348026-4c9d-45cc-b04b-cb4e52606a70\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.182092 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.182071 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbxq9\" (UniqueName: \"kubernetes.io/projected/20e9d578-befb-479e-a4fb-8446a9bf99b5-kube-api-access-qbxq9\") pod \"console-operator-5ccd6b445f-hpgvd\" (UID: \"20e9d578-befb-479e-a4fb-8446a9bf99b5\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.195445 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.195410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-default-certificate\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vslq\" (UniqueName: \"kubernetes.io/projected/d20379c4-8bbb-4753-af85-84f4c8f593bc-kube-api-access-7vslq\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76459ad2-12db-4330-9042-be87b3365cba-trusted-ca-bundle\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76459ad2-12db-4330-9042-be87b3365cba-service-ca-bundle\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266529 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chvn5\" (UniqueName: \"kubernetes.io/projected/76459ad2-12db-4330-9042-be87b3365cba-kube-api-access-chvn5\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266577 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khpvh\" (UniqueName: \"kubernetes.io/projected/152bf7b5-8e6e-4f17-9b60-d23c24287110-kube-api-access-khpvh\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266635 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76459ad2-12db-4330-9042-be87b3365cba-tmp\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/76459ad2-12db-4330-9042-be87b3365cba-snapshots\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76459ad2-12db-4330-9042-be87b3365cba-serving-cert\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266747 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-stats-auth\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.266775 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.266976 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.766954264 +0000 UTC m=+67.612642813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : configmap references non-existent config key: service-ca.crt Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.267576 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76459ad2-12db-4330-9042-be87b3365cba-tmp\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.268448 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.268241 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:48:31.269521 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.268314 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls podName:d20379c4-8bbb-4753-af85-84f4c8f593bc nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.768296945 +0000 UTC m=+67.613985470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-cm7rb" (UID: "d20379c4-8bbb-4753-af85-84f4c8f593bc") : secret "samples-operator-tls" not found Jul 31 14:48:31.269521 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.269107 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76459ad2-12db-4330-9042-be87b3365cba-service-ca-bundle\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.270130 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.269711 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/76459ad2-12db-4330-9042-be87b3365cba-snapshots\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.270130 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.270050 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:48:31.270130 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.270104 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:31.770087123 +0000 UTC m=+67.615775648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : secret "router-metrics-certs-default" not found Jul 31 14:48:31.270395 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.270368 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76459ad2-12db-4330-9042-be87b3365cba-trusted-ca-bundle\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.275509 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.275148 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-default-certificate\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.275509 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.275370 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76459ad2-12db-4330-9042-be87b3365cba-serving-cert\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.276867 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.276544 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-stats-auth\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.278468 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.278267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" Jul 31 14:48:31.287430 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.286979 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:31.292904 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.292742 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khpvh\" (UniqueName: \"kubernetes.io/projected/152bf7b5-8e6e-4f17-9b60-d23c24287110-kube-api-access-khpvh\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.298861 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.298771 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vslq\" (UniqueName: \"kubernetes.io/projected/d20379c4-8bbb-4753-af85-84f4c8f593bc-kube-api-access-7vslq\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.300431 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.300407 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvn5\" (UniqueName: \"kubernetes.io/projected/76459ad2-12db-4330-9042-be87b3365cba-kube-api-access-chvn5\") pod \"insights-operator-77696685b-8zj96\" (UID: \"76459ad2-12db-4330-9042-be87b3365cba\") " pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.317559 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.317346 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" Jul 31 14:48:31.347209 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.346803 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh"] Jul 31 14:48:31.377421 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.375788 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n"] Jul 31 14:48:31.442816 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.442675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-8zj96" Jul 31 14:48:31.491972 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:48:31.491941 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e9d578_befb_479e_a4fb_8446a9bf99b5.slice/crio-047c2c0bde05df9ce65823be757472d7b2264e0b4aa041c816cfa46e462a75dc WatchSource:0}: Error finding container 047c2c0bde05df9ce65823be757472d7b2264e0b4aa041c816cfa46e462a75dc: Status 404 returned error can't find the container with id 047c2c0bde05df9ce65823be757472d7b2264e0b4aa041c816cfa46e462a75dc Jul 31 14:48:31.497811 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.497734 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-hpgvd"] Jul 31 14:48:31.499056 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.499002 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt"] Jul 31 14:48:31.508980 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.508740 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6"] Jul 31 14:48:31.603378 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.603123 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-8zj96"] Jul 31 14:48:31.607491 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:48:31.607461 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76459ad2_12db_4330_9042_be87b3365cba.slice/crio-6597f8ad94f2e507166bc4e81c6b9e3133e37cb492d547529681826a56e87350 WatchSource:0}: Error finding container 6597f8ad94f2e507166bc4e81c6b9e3133e37cb492d547529681826a56e87350: Status 404 returned error can't find the container with id 6597f8ad94f2e507166bc4e81c6b9e3133e37cb492d547529681826a56e87350 Jul 31 14:48:31.672485 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.672417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:31.672485 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.672476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:31.672668 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.672576 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:31.672668 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.672624 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls podName:716e7166-1d2c-4b23-97b0-9cb65e38f7db nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.672610644 +0000 UTC m=+68.518299167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-6p9ks" (UID: "716e7166-1d2c-4b23-97b0-9cb65e38f7db") : secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:31.672763 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.672678 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 14:48:31.672763 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.672749 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert podName:fe953075-526b-4133-81b9-a0d9a28fb43c nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.672731133 +0000 UTC m=+68.518419658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-p4nb4" (UID: "fe953075-526b-4133-81b9-a0d9a28fb43c") : secret "networking-console-plugin-cert" not found Jul 31 14:48:31.773149 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.773110 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.773311 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.773172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:31.773311 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.773207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:31.773434 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.773414 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.773394764 +0000 UTC m=+68.619083302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : configmap references non-existent config key: service-ca.crt Jul 31 14:48:31.773566 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.773545 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:48:31.773618 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.773610 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls podName:d20379c4-8bbb-4753-af85-84f4c8f593bc nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.773593203 +0000 UTC m=+68.619281729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-cm7rb" (UID: "d20379c4-8bbb-4753-af85-84f4c8f593bc") : secret "samples-operator-tls" not found Jul 31 14:48:31.773679 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.773550 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:48:31.773679 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.773653 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:32.773643597 +0000 UTC m=+68.619332125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : secret "router-metrics-certs-default" not found Jul 31 14:48:31.975954 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.975044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:48:31.975954 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:31.975301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:48:31.975954 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.975213 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 14:48:31.975954 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.975521 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls podName:b54f5fcf-bea1-4521-af00-e4388825ddf1 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:03.975503903 +0000 UTC m=+99.821192441 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls") pod "dns-default-6ctks" (UID: "b54f5fcf-bea1-4521-af00-e4388825ddf1") : secret "dns-default-metrics-tls" not found Jul 31 14:48:31.975954 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.975428 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 14:48:31.975954 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.975888 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-689f7f5dd8-cwzs8: secret "image-registry-tls" not found Jul 31 14:48:31.976904 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:31.976024 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls podName:755ee731-917b-4b51-9a87-751e5dc3c4f1 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:03.976004317 +0000 UTC m=+99.821692842 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls") pod "image-registry-689f7f5dd8-cwzs8" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1") : secret "image-registry-tls" not found Jul 31 14:48:32.177445 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.177321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8zj96" event={"ID":"76459ad2-12db-4330-9042-be87b3365cba","Type":"ContainerStarted","Data":"6597f8ad94f2e507166bc4e81c6b9e3133e37cb492d547529681826a56e87350"} Jul 31 14:48:32.182936 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.182858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" event={"ID":"a4b42702-60bb-4c51-956f-8646edf947ac","Type":"ContainerStarted","Data":"747e120036e44f24eebca0382a9fee718f436ece5f56ea2ee339d80fa28275cc"} Jul 31 14:48:32.184406 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.184384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" event={"ID":"3b348026-4c9d-45cc-b04b-cb4e52606a70","Type":"ContainerStarted","Data":"fc719154b8eab3d9d3198e3b3c9ca6cd67eec6ebb185b0ffea7a4ec957572d91"} Jul 31 14:48:32.187008 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.186953 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" event={"ID":"20e9d578-befb-479e-a4fb-8446a9bf99b5","Type":"ContainerStarted","Data":"047c2c0bde05df9ce65823be757472d7b2264e0b4aa041c816cfa46e462a75dc"} Jul 31 14:48:32.191950 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.191904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" event={"ID":"8a0ce514-a697-47a3-aa49-e5b76df3a2ab","Type":"ContainerStarted","Data":"7a0cc15fc579c3cdc6b97d80f79f41a373ae842f973e6c694bbe671d94389b5e"} Jul 31 14:48:32.209822 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.209766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" event={"ID":"1112877a-8af3-47c3-9731-8c6df30d0281","Type":"ContainerStarted","Data":"cdbd5fe07ae48e55e9e3b86562eb5cddf3c78fff9305cea262c12e9bc4a341ff"} Jul 31 14:48:32.682764 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.682726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:32.682957 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.682813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:32.683031 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.682996 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:32.683087 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.683063 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls podName:716e7166-1d2c-4b23-97b0-9cb65e38f7db nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.683043738 +0000 UTC m=+70.528732263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-6p9ks" (UID: "716e7166-1d2c-4b23-97b0-9cb65e38f7db") : secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:32.683150 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.683129 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 14:48:32.683200 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.683160 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert podName:fe953075-526b-4133-81b9-a0d9a28fb43c nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.683149873 +0000 UTC m=+70.528838399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-p4nb4" (UID: "fe953075-526b-4133-81b9-a0d9a28fb43c") : secret "networking-console-plugin-cert" not found Jul 31 14:48:32.783880 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.783842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:32.784054 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.783913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:32.784054 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:32.783957 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:32.784173 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.784112 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.784092502 +0000 UTC m=+70.629781040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : configmap references non-existent config key: service-ca.crt Jul 31 14:48:32.784571 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.784551 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:48:32.784654 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.784614 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.78459732 +0000 UTC m=+70.630285858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : secret "router-metrics-certs-default" not found Jul 31 14:48:32.784718 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.784680 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:48:32.784718 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:32.784715 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls podName:d20379c4-8bbb-4753-af85-84f4c8f593bc nodeName:}" failed. No retries permitted until 2026-07-31 14:48:34.784704276 +0000 UTC m=+70.630392802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-cm7rb" (UID: "d20379c4-8bbb-4753-af85-84f4c8f593bc") : secret "samples-operator-tls" not found Jul 31 14:48:34.704076 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:34.704038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:34.704481 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:34.704134 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:34.704481 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.704202 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 14:48:34.704481 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.704283 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert podName:fe953075-526b-4133-81b9-a0d9a28fb43c nodeName:}" failed. No retries permitted until 2026-07-31 14:48:38.704263168 +0000 UTC m=+74.549951708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-p4nb4" (UID: "fe953075-526b-4133-81b9-a0d9a28fb43c") : secret "networking-console-plugin-cert" not found Jul 31 14:48:34.704481 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.704286 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:34.704481 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.704347 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls podName:716e7166-1d2c-4b23-97b0-9cb65e38f7db nodeName:}" failed. No retries permitted until 2026-07-31 14:48:38.704333381 +0000 UTC m=+74.550021904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-6p9ks" (UID: "716e7166-1d2c-4b23-97b0-9cb65e38f7db") : secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:34.805097 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:34.805060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:34.805294 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:34.805131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:34.805294 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:34.805167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:34.805294 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.805197 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:48:34.805294 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.805276 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:48:34.805294 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.805288 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:38.80526998 +0000 UTC m=+74.650958513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : secret "router-metrics-certs-default" not found Jul 31 14:48:34.805552 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.805309 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:38.805300798 +0000 UTC m=+74.650989322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : configmap references non-existent config key: service-ca.crt Jul 31 14:48:34.805552 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:34.805330 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls podName:d20379c4-8bbb-4753-af85-84f4c8f593bc nodeName:}" failed. No retries permitted until 2026-07-31 14:48:38.805315317 +0000 UTC m=+74.651003840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-cm7rb" (UID: "d20379c4-8bbb-4753-af85-84f4c8f593bc") : secret "samples-operator-tls" not found Jul 31 14:48:38.741540 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:38.741507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:38.742147 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:38.741660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:38.742147 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.741843 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 14:48:38.742147 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.741897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert podName:fe953075-526b-4133-81b9-a0d9a28fb43c nodeName:}" failed. No retries permitted until 2026-07-31 14:48:46.741882084 +0000 UTC m=+82.587570607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-p4nb4" (UID: "fe953075-526b-4133-81b9-a0d9a28fb43c") : secret "networking-console-plugin-cert" not found Jul 31 14:48:38.742147 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.741844 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:38.742147 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.741935 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls podName:716e7166-1d2c-4b23-97b0-9cb65e38f7db nodeName:}" failed. No retries permitted until 2026-07-31 14:48:46.741928139 +0000 UTC m=+82.587616662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-6p9ks" (UID: "716e7166-1d2c-4b23-97b0-9cb65e38f7db") : secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:38.842215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:38.842273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:38.842414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.842540 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.842599 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:46.842580541 +0000 UTC m=+82.688269084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : secret "router-metrics-certs-default" not found Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.842661 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.842694 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls podName:d20379c4-8bbb-4753-af85-84f4c8f593bc nodeName:}" failed. No retries permitted until 2026-07-31 14:48:46.842684002 +0000 UTC m=+82.688372531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-cm7rb" (UID: "d20379c4-8bbb-4753-af85-84f4c8f593bc") : secret "samples-operator-tls" not found Jul 31 14:48:38.842899 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:38.842759 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:46.842749768 +0000 UTC m=+82.688438293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : configmap references non-existent config key: service-ca.crt Jul 31 14:48:39.234505 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.234427 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8zj96" event={"ID":"76459ad2-12db-4330-9042-be87b3365cba","Type":"ContainerStarted","Data":"41ebd59b1e5520c8c19a6c165c612a65e3ec0d54a6230cf2d4bf0fe0e19b6582"} Jul 31 14:48:39.236013 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.235987 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" event={"ID":"a4b42702-60bb-4c51-956f-8646edf947ac","Type":"ContainerStarted","Data":"ea3bb446a7d53455c8c8cd787509b0267a28bff563688f60b2b6a25811ca589a"} Jul 31 14:48:39.237394 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.237364 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" event={"ID":"3b348026-4c9d-45cc-b04b-cb4e52606a70","Type":"ContainerStarted","Data":"744830ec58c479e831ac67dc05d486ccd86d93d7e54c42a9f75734c4a962355c"} Jul 31 14:48:39.239270 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.239249 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/0.log" Jul 31 14:48:39.239370 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.239290 2560 generic.go:356] "Generic (PLEG): container finished" podID="20e9d578-befb-479e-a4fb-8446a9bf99b5" containerID="b4f6193ec0d3ce0f41f74739ec02bd9fb6034ed3f659073c5bdad5cc500f01b0" exitCode=255 Jul 31 14:48:39.239370 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.239366 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" event={"ID":"20e9d578-befb-479e-a4fb-8446a9bf99b5","Type":"ContainerDied","Data":"b4f6193ec0d3ce0f41f74739ec02bd9fb6034ed3f659073c5bdad5cc500f01b0"} Jul 31 14:48:39.239543 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.239528 2560 scope.go:117] "RemoveContainer" containerID="b4f6193ec0d3ce0f41f74739ec02bd9fb6034ed3f659073c5bdad5cc500f01b0" Jul 31 14:48:39.241113 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.241091 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" event={"ID":"8a0ce514-a697-47a3-aa49-e5b76df3a2ab","Type":"ContainerStarted","Data":"a667a633f8373447cbc616a1209c933368580bf4cb2bf971335c8144d9aa1c5d"} Jul 31 14:48:39.242680 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.242658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdv99" event={"ID":"12727d0b-6de8-4da8-9130-4e29acf07a7d","Type":"ContainerStarted","Data":"19d44df430cc8fe7ff7f3f444a770d9673a4c64910ca91e181e8189a57c919e9"} Jul 31 14:48:39.242778 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.242705 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:48:39.244191 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.244162 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s9kc6" event={"ID":"2af4e5ca-f70c-4f2e-a052-4603774c13ea","Type":"ContainerStarted","Data":"72dd788116c5b005a019089c075aa07bfd72481fb7d4f27256f62eca2132e897"} Jul 31 14:48:39.245544 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.245517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" event={"ID":"1112877a-8af3-47c3-9731-8c6df30d0281","Type":"ContainerStarted","Data":"c291e77b83fcff9ab5b112fd7e2fe9daa4c984cfe8e9544336b1d2600963efb2"} Jul 31 14:48:39.261118 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.261075 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-8zj96" podStartSLOduration=1.238283551 podStartE2EDuration="8.261058517s" totalImagesPullingTime="7.022774966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.260030513 +0000 UTC m=+75.105719058" watchObservedRunningTime="2026-07-31 14:48:39.261058517 +0000 UTC m=+75.106747063" Jul 31 14:48:39.307695 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.307647 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s9kc6" podStartSLOduration=64.422308007 podStartE2EDuration="1m13.307631598s" totalImagesPullingTime="8.885323591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.280643906 +0000 UTC m=+75.126332452" watchObservedRunningTime="2026-07-31 14:48:39.307631598 +0000 UTC m=+75.153320143" Jul 31 14:48:39.330555 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.330502 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-zvpjh" podStartSLOduration=2.051410191 podStartE2EDuration="9.330486101s" totalImagesPullingTime="7.27907591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.307249508 +0000 UTC m=+75.152938054" watchObservedRunningTime="2026-07-31 14:48:39.330486101 +0000 UTC m=+75.176174646" Jul 31 14:48:39.382876 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.382687 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" podStartSLOduration=2.1385775320000002 podStartE2EDuration="9.38267126s" totalImagesPullingTime="7.244093728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.33075415 +0000 UTC m=+75.176442696" watchObservedRunningTime="2026-07-31 14:48:39.38267126 +0000 UTC m=+75.228359818" Jul 31 14:48:39.408227 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.408175 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" podStartSLOduration=2.28533577 podStartE2EDuration="9.408157539s" totalImagesPullingTime="7.122821769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.406219051 +0000 UTC m=+75.251907596" watchObservedRunningTime="2026-07-31 14:48:39.408157539 +0000 UTC m=+75.253846085" Jul 31 14:48:39.443883 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.443807 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rdv99" podStartSLOduration=65.544859809 podStartE2EDuration="1m14.443786198s" totalImagesPullingTime="8.898926389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.442761893 +0000 UTC m=+75.288450439" watchObservedRunningTime="2026-07-31 14:48:39.443786198 +0000 UTC m=+75.289474724" Jul 31 14:48:39.468681 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:39.468644 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-6frvt" podStartSLOduration=2.330525323 podStartE2EDuration="9.468629105s" totalImagesPullingTime="7.138103782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:48:39.468345566 +0000 UTC m=+75.314034113" watchObservedRunningTime="2026-07-31 14:48:39.468629105 +0000 UTC m=+75.314317650" Jul 31 14:48:40.250198 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:40.250169 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/1.log" Jul 31 14:48:40.250694 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:40.250673 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/0.log" Jul 31 14:48:40.250753 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:40.250720 2560 generic.go:356] "Generic (PLEG): container finished" podID="20e9d578-befb-479e-a4fb-8446a9bf99b5" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" exitCode=255 Jul 31 14:48:40.250875 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:40.250824 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" event={"ID":"20e9d578-befb-479e-a4fb-8446a9bf99b5","Type":"ContainerDied","Data":"18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0"} Jul 31 14:48:40.250982 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:40.250960 2560 scope.go:117] "RemoveContainer" containerID="b4f6193ec0d3ce0f41f74739ec02bd9fb6034ed3f659073c5bdad5cc500f01b0" Jul 31 14:48:40.251249 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:40.251231 2560 scope.go:117] "RemoveContainer" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" Jul 31 14:48:40.251759 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:40.251436 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:48:41.097071 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.097038 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5q6ms"] Jul 31 14:48:41.101469 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.101450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.104811 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.104792 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lxkp8\"" Jul 31 14:48:41.105153 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.105137 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 14:48:41.105234 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.105140 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 14:48:41.114691 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.114672 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5q6ms"] Jul 31 14:48:41.163395 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.163365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv29v\" (UniqueName: \"kubernetes.io/projected/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-api-access-lv29v\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.163536 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.163418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-data-volume\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.163536 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.163441 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.163536 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.163472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.163536 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.163537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-crio-socket\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.255357 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.255321 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/1.log" Jul 31 14:48:41.255728 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.255667 2560 scope.go:117] "RemoveContainer" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" Jul 31 14:48:41.255893 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.255871 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:48:41.264613 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.264579 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-crio-socket\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.264727 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.264656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv29v\" (UniqueName: \"kubernetes.io/projected/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-api-access-lv29v\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.264727 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.264689 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-data-volume\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.264727 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.264697 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-crio-socket\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.264727 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.264706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.264937 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.264746 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.264937 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.264804 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:41.264937 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.264888 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.76486778 +0000 UTC m=+77.610556303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:41.264937 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.264886 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:41.264937 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.264932 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:41.764920609 +0000 UTC m=+77.610609137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : configmap "kube-rbac-proxy" not found Jul 31 14:48:41.265115 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.265064 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-data-volume\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.277916 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.277892 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv29v\" (UniqueName: \"kubernetes.io/projected/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-api-access-lv29v\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.288731 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.288707 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:41.288856 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.288754 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:48:41.770398 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.770358 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.770398 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:41.770396 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:41.770597 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.770491 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:41.770597 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.770519 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:41.770597 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.770545 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:42.770530685 +0000 UTC m=+78.616219207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : configmap "kube-rbac-proxy" not found Jul 31 14:48:41.770597 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:41.770574 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:42.770561568 +0000 UTC m=+78.616250090 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:42.260331 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:42.260298 2560 scope.go:117] "RemoveContainer" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" Jul 31 14:48:42.260689 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:42.260498 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:48:42.778433 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:42.778404 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:42.778596 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:42.778435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:42.778596 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:42.778558 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:42.778596 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:42.778580 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:42.778700 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:42.778627 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:44.778612274 +0000 UTC m=+80.624300798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:42.778741 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:42.778697 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:44.778675859 +0000 UTC m=+80.624364390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : configmap "kube-rbac-proxy" not found Jul 31 14:48:43.262624 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:43.262596 2560 scope.go:117] "RemoveContainer" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" Jul 31 14:48:43.263008 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:43.262751 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:48:43.464218 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:43.464190 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6mxj_d937e575-c105-4322-ab37-a7130a158f6e/dns-node-resolver/0.log" Jul 31 14:48:44.660754 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:44.660727 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rmk2d_b02538e3-a004-4422-9360-9b27ad6d8adc/node-ca/0.log" Jul 31 14:48:44.798684 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:44.798653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:44.798684 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:44.798685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:44.798910 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:44.798765 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:44.798910 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:44.798792 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:44.798910 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:44.798825 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:48.798808944 +0000 UTC m=+84.644497485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : configmap "kube-rbac-proxy" not found Jul 31 14:48:44.798910 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:44.798864 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:48.798850434 +0000 UTC m=+84.644538970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:45.258666 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:45.258634 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxqts_adc07795-e3d1-4c0f-9ff4-64298b2e8386/serve-healthcheck-canary/0.log" Jul 31 14:48:45.863971 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:45.863936 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-sdh6n_a4b42702-60bb-4c51-956f-8646edf947ac/kube-storage-version-migrator-operator/0.log" Jul 31 14:48:46.822166 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:46.822124 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:48:46.822310 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:46.822238 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:48:46.822376 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.822319 2560 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:46.822428 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.822394 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls podName:716e7166-1d2c-4b23-97b0-9cb65e38f7db nodeName:}" failed. No retries permitted until 2026-07-31 14:49:02.822378084 +0000 UTC m=+98.668066609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-6p9ks" (UID: "716e7166-1d2c-4b23-97b0-9cb65e38f7db") : secret "cluster-monitoring-operator-tls" not found Jul 31 14:48:46.822428 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.822325 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 31 14:48:46.822527 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.822467 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert podName:fe953075-526b-4133-81b9-a0d9a28fb43c nodeName:}" failed. No retries permitted until 2026-07-31 14:49:02.822451725 +0000 UTC m=+98.668140249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-p4nb4" (UID: "fe953075-526b-4133-81b9-a0d9a28fb43c") : secret "networking-console-plugin-cert" not found Jul 31 14:48:46.923130 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:46.923089 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:46.923143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:46.923173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.923249 2560 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.923289 2560 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.923324 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:02.923304409 +0000 UTC m=+98.768992932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : configmap references non-existent config key: service-ca.crt Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.923344 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs podName:152bf7b5-8e6e-4f17-9b60-d23c24287110 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:02.923334999 +0000 UTC m=+98.769023522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs") pod "router-default-7758b75b96-jp5tv" (UID: "152bf7b5-8e6e-4f17-9b60-d23c24287110") : secret "router-metrics-certs-default" not found Jul 31 14:48:46.923538 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:46.923359 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls podName:d20379c4-8bbb-4753-af85-84f4c8f593bc nodeName:}" failed. No retries permitted until 2026-07-31 14:49:02.92335071 +0000 UTC m=+98.769039240 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-cm7rb" (UID: "d20379c4-8bbb-4753-af85-84f4c8f593bc") : secret "samples-operator-tls" not found Jul 31 14:48:48.839820 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:48.839781 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:48.839820 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:48.839823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:48.840367 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:48.839904 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 14:48:48.840367 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:48.839940 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 14:48:48.840367 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:48.839964 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.839950027 +0000 UTC m=+92.685638550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : configmap "kube-rbac-proxy" not found Jul 31 14:48:48.840367 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:48.840001 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls podName:fdedd0b8-decb-447e-96d8-01b8d67f3dc1 nodeName:}" failed. No retries permitted until 2026-07-31 14:48:56.839982983 +0000 UTC m=+92.685671521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5q6ms" (UID: "fdedd0b8-decb-447e-96d8-01b8d67f3dc1") : secret "insights-runtime-extractor-tls" not found Jul 31 14:48:55.772668 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:55.772635 2560 scope.go:117] "RemoveContainer" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" Jul 31 14:48:56.304035 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.304005 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:48:56.304444 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.304423 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/1.log" Jul 31 14:48:56.304527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.304468 2560 generic.go:356] "Generic (PLEG): container finished" podID="20e9d578-befb-479e-a4fb-8446a9bf99b5" containerID="18b861b80508c651124b1da17a60c5cd7821ea11ac1e484a3388df40fa2b5bca" exitCode=255 Jul 31 14:48:56.304580 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.304550 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" event={"ID":"20e9d578-befb-479e-a4fb-8446a9bf99b5","Type":"ContainerDied","Data":"18b861b80508c651124b1da17a60c5cd7821ea11ac1e484a3388df40fa2b5bca"} Jul 31 14:48:56.304644 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.304630 2560 scope.go:117] "RemoveContainer" containerID="18802964ca8084fd6f0613b0ca33a6d13af7551da9aed97a549e6eba06fadaa0" Jul 31 14:48:56.304922 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.304903 2560 scope.go:117] "RemoveContainer" containerID="18b861b80508c651124b1da17a60c5cd7821ea11ac1e484a3388df40fa2b5bca" Jul 31 14:48:56.305094 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:48:56.305075 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:48:56.909049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.909018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:56.909049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.909053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:56.909560 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.909502 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:56.911381 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:56.911359 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdedd0b8-decb-447e-96d8-01b8d67f3dc1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5q6ms\" (UID: \"fdedd0b8-decb-447e-96d8-01b8d67f3dc1\") " pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:57.010117 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:57.010080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5q6ms" Jul 31 14:48:57.138318 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:57.138294 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5q6ms"] Jul 31 14:48:57.140747 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:48:57.140706 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdedd0b8_decb_447e_96d8_01b8d67f3dc1.slice/crio-9e86fa03f4af6777caf5a3bad4a62301767641a0d93e54f5b16ea23da4f7b4e8 WatchSource:0}: Error finding container 9e86fa03f4af6777caf5a3bad4a62301767641a0d93e54f5b16ea23da4f7b4e8: Status 404 returned error can't find the container with id 9e86fa03f4af6777caf5a3bad4a62301767641a0d93e54f5b16ea23da4f7b4e8 Jul 31 14:48:57.308534 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:57.308511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:48:57.310043 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:57.310018 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5q6ms" event={"ID":"fdedd0b8-decb-447e-96d8-01b8d67f3dc1","Type":"ContainerStarted","Data":"bbd9d0f45e2f34d4edfa596efa6daf037da164733c19c3b5d71211a97192d51a"} Jul 31 14:48:57.310158 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:57.310069 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5q6ms" event={"ID":"fdedd0b8-decb-447e-96d8-01b8d67f3dc1","Type":"ContainerStarted","Data":"9e86fa03f4af6777caf5a3bad4a62301767641a0d93e54f5b16ea23da4f7b4e8"} Jul 31 14:48:58.315118 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:48:58.315084 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5q6ms" event={"ID":"fdedd0b8-decb-447e-96d8-01b8d67f3dc1","Type":"ContainerStarted","Data":"d132f56129e0f684d34c19658c787b90587fe46ac255fe3e1acec4211baee424"} Jul 31 14:49:00.325733 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:00.325695 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5q6ms" event={"ID":"fdedd0b8-decb-447e-96d8-01b8d67f3dc1","Type":"ContainerStarted","Data":"697bfe1949e85d5a9a7e6958799ed59dd449f97c9aafb6fdeb1975433681d927"} Jul 31 14:49:00.353105 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:00.353057 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5q6ms" podStartSLOduration=17.264392447 podStartE2EDuration="19.353041488s" totalImagesPullingTime="2.088649041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 14:48:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:00.35291434 +0000 UTC m=+96.198602885" watchObservedRunningTime="2026-07-31 14:49:00.353041488 +0000 UTC m=+96.198730032" Jul 31 14:49:01.288363 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:01.288331 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:49:01.288529 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:01.288383 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:49:01.288702 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:01.288686 2560 scope.go:117] "RemoveContainer" containerID="18b861b80508c651124b1da17a60c5cd7821ea11ac1e484a3388df40fa2b5bca" Jul 31 14:49:01.288923 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:49:01.288902 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:49:02.863407 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.863373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:49:02.863818 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.863455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:49:02.865796 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.865775 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe953075-526b-4133-81b9-a0d9a28fb43c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p4nb4\" (UID: \"fe953075-526b-4133-81b9-a0d9a28fb43c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:49:02.865925 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.865903 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/716e7166-1d2c-4b23-97b0-9cb65e38f7db-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-6p9ks\" (UID: \"716e7166-1d2c-4b23-97b0-9cb65e38f7db\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:49:02.964414 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.964373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:02.964414 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.964422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:49:02.964619 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.964443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:02.965051 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.965030 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/152bf7b5-8e6e-4f17-9b60-d23c24287110-service-ca-bundle\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:02.966767 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.966738 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d20379c4-8bbb-4753-af85-84f4c8f593bc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-cm7rb\" (UID: \"d20379c4-8bbb-4753-af85-84f4c8f593bc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:49:02.966880 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:02.966792 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/152bf7b5-8e6e-4f17-9b60-d23c24287110-metrics-certs\") pod \"router-default-7758b75b96-jp5tv\" (UID: \"152bf7b5-8e6e-4f17-9b60-d23c24287110\") " pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:03.100407 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.100366 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" Jul 31 14:49:03.111915 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.111896 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" Jul 31 14:49:03.186605 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.186525 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" Jul 31 14:49:03.249999 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.249226 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:03.267226 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.267187 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4"] Jul 31 14:49:03.269913 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:03.269877 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe953075_526b_4133_81b9_a0d9a28fb43c.slice/crio-cc8aaa828fb36ed76e890e6706510650747d2e355c4fb9cae67abe7616e68e32 WatchSource:0}: Error finding container cc8aaa828fb36ed76e890e6706510650747d2e355c4fb9cae67abe7616e68e32: Status 404 returned error can't find the container with id cc8aaa828fb36ed76e890e6706510650747d2e355c4fb9cae67abe7616e68e32 Jul 31 14:49:03.285369 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.285282 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks"] Jul 31 14:49:03.289268 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:03.289240 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716e7166_1d2c_4b23_97b0_9cb65e38f7db.slice/crio-31625ff5f05b5f4e3fad2f3c1ea3d8d2dc141822be7cc9b6a43f15465edf6e74 WatchSource:0}: Error finding container 31625ff5f05b5f4e3fad2f3c1ea3d8d2dc141822be7cc9b6a43f15465edf6e74: Status 404 returned error can't find the container with id 31625ff5f05b5f4e3fad2f3c1ea3d8d2dc141822be7cc9b6a43f15465edf6e74 Jul 31 14:49:03.333626 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.333589 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb"] Jul 31 14:49:03.336210 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.336171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" event={"ID":"716e7166-1d2c-4b23-97b0-9cb65e38f7db","Type":"ContainerStarted","Data":"31625ff5f05b5f4e3fad2f3c1ea3d8d2dc141822be7cc9b6a43f15465edf6e74"} Jul 31 14:49:03.338964 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.338146 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" event={"ID":"fe953075-526b-4133-81b9-a0d9a28fb43c","Type":"ContainerStarted","Data":"cc8aaa828fb36ed76e890e6706510650747d2e355c4fb9cae67abe7616e68e32"} Jul 31 14:49:03.390135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.390082 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7758b75b96-jp5tv"] Jul 31 14:49:03.392260 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:03.392239 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod152bf7b5_8e6e_4f17_9b60_d23c24287110.slice/crio-f22e9617b1a0e62d913238775ba373a39945b85b96db1a3303f7c8c703196447 WatchSource:0}: Error finding container f22e9617b1a0e62d913238775ba373a39945b85b96db1a3303f7c8c703196447: Status 404 returned error can't find the container with id f22e9617b1a0e62d913238775ba373a39945b85b96db1a3303f7c8c703196447 Jul 31 14:49:03.979849 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.979788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:49:03.980330 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.979878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:03.986481 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.986415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54f5fcf-bea1-4521-af00-e4388825ddf1-metrics-tls\") pod \"dns-default-6ctks\" (UID: \"b54f5fcf-bea1-4521-af00-e4388825ddf1\") " pod="openshift-dns/dns-default-6ctks" Jul 31 14:49:03.987179 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:03.987133 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"image-registry-689f7f5dd8-cwzs8\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:04.013533 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.013507 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m7lrf\"" Jul 31 14:49:04.021065 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.021040 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:04.023127 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.023100 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4w6d9\"" Jul 31 14:49:04.030077 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.030057 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6ctks" Jul 31 14:49:04.349532 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.349411 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7758b75b96-jp5tv" event={"ID":"152bf7b5-8e6e-4f17-9b60-d23c24287110","Type":"ContainerStarted","Data":"3b9a6b32e85babaaa5ebebca3a7a4392391dd5e431dd2de9447248155fd09d2b"} Jul 31 14:49:04.349532 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.349473 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7758b75b96-jp5tv" event={"ID":"152bf7b5-8e6e-4f17-9b60-d23c24287110","Type":"ContainerStarted","Data":"f22e9617b1a0e62d913238775ba373a39945b85b96db1a3303f7c8c703196447"} Jul 31 14:49:04.356941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.354730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" event={"ID":"d20379c4-8bbb-4753-af85-84f4c8f593bc","Type":"ContainerStarted","Data":"b2a799ddf2d40e32f255e2a576679b34c88812ea43fb857b773146b660c4e48a"} Jul 31 14:49:04.388112 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.387024 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7758b75b96-jp5tv" podStartSLOduration=33.387004828 podStartE2EDuration="33.387004828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:04.385856306 +0000 UTC m=+100.231544852" watchObservedRunningTime="2026-07-31 14:49:04.387004828 +0000 UTC m=+100.232693369" Jul 31 14:49:04.454197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.454163 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689f7f5dd8-cwzs8"] Jul 31 14:49:04.470101 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:04.470063 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6ctks"] Jul 31 14:49:04.475413 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:04.475388 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54f5fcf_bea1_4521_af00_e4388825ddf1.slice/crio-b9076ad2a95e81510a0cbbc3df08872b10650f1bc788f0cc7a98c1915dc2f454 WatchSource:0}: Error finding container b9076ad2a95e81510a0cbbc3df08872b10650f1bc788f0cc7a98c1915dc2f454: Status 404 returned error can't find the container with id b9076ad2a95e81510a0cbbc3df08872b10650f1bc788f0cc7a98c1915dc2f454 Jul 31 14:49:05.250621 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.250588 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:05.253501 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.253475 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:05.360209 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.360168 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6ctks" event={"ID":"b54f5fcf-bea1-4521-af00-e4388825ddf1","Type":"ContainerStarted","Data":"b9076ad2a95e81510a0cbbc3df08872b10650f1bc788f0cc7a98c1915dc2f454"} Jul 31 14:49:05.361816 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.361787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" event={"ID":"755ee731-917b-4b51-9a87-751e5dc3c4f1","Type":"ContainerStarted","Data":"5fe92c04d5558b203daedc07f0cf2416ac0436f5b5af64167e2575c538623395"} Jul 31 14:49:05.361982 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.361867 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" event={"ID":"755ee731-917b-4b51-9a87-751e5dc3c4f1","Type":"ContainerStarted","Data":"49c1592852edb1ec41b8ead6096fc5c66482ecdfb054740890f5a28bdcae89dd"} Jul 31 14:49:05.361982 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.361899 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:05.363524 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.363491 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" event={"ID":"fe953075-526b-4133-81b9-a0d9a28fb43c","Type":"ContainerStarted","Data":"aee7a3a5f4cfcc50c47e195b51e4f0959f38417ff1af01a14aa20e9814886d19"} Jul 31 14:49:05.363648 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.363618 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:05.365014 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.364991 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7758b75b96-jp5tv" Jul 31 14:49:05.384082 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.384039 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" podStartSLOduration=99.384025942 podStartE2EDuration="1m39.384025942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:05.383435553 +0000 UTC m=+101.229124144" watchObservedRunningTime="2026-07-31 14:49:05.384025942 +0000 UTC m=+101.229714492" Jul 31 14:49:05.406764 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:05.406719 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p4nb4" podStartSLOduration=34.350246186 podStartE2EDuration="35.406705597s" totalImagesPullingTime="1.056459411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:05.406119853 +0000 UTC m=+101.251808400" watchObservedRunningTime="2026-07-31 14:49:05.406705597 +0000 UTC m=+101.252394142" Jul 31 14:49:06.372236 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:06.372202 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" event={"ID":"716e7166-1d2c-4b23-97b0-9cb65e38f7db","Type":"ContainerStarted","Data":"c90a6ed1d645cf52037fd7e0b82800f8098ad9c411e1f728ff601ee35dcf3820"} Jul 31 14:49:06.374928 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:06.374849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" event={"ID":"d20379c4-8bbb-4753-af85-84f4c8f593bc","Type":"ContainerStarted","Data":"f1b60e7c680e22af1cb1f0d6a2b3779c97c460dff69518c2b72ee9f6e7264217"} Jul 31 14:49:06.374928 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:06.374910 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" event={"ID":"d20379c4-8bbb-4753-af85-84f4c8f593bc","Type":"ContainerStarted","Data":"0dcdf6d5b5ce8c15f5607fcd3d17d09ae129beafa67c591e657bef2481665ab0"} Jul 31 14:49:06.391303 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:06.391254 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-6p9ks" podStartSLOduration=33.750937656 podStartE2EDuration="36.391235357s" totalImagesPullingTime="2.640297701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:06.389925392 +0000 UTC m=+102.235613938" watchObservedRunningTime="2026-07-31 14:49:06.391235357 +0000 UTC m=+102.236923902" Jul 31 14:49:06.412492 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:06.412446 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-cm7rb" podStartSLOduration=32.870469349 podStartE2EDuration="35.412433283s" totalImagesPullingTime="2.541963934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:06.412334911 +0000 UTC m=+102.258023456" watchObservedRunningTime="2026-07-31 14:49:06.412433283 +0000 UTC m=+102.258121854" Jul 31 14:49:08.382476 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:08.382436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6ctks" event={"ID":"b54f5fcf-bea1-4521-af00-e4388825ddf1","Type":"ContainerStarted","Data":"133eb63e3a1b39d763034ec1cc12f1099cc02d51fe1dd138ed4da232ec7c1c3f"} Jul 31 14:49:08.382873 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:08.382546 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6ctks" event={"ID":"b54f5fcf-bea1-4521-af00-e4388825ddf1","Type":"ContainerStarted","Data":"3895d1f5d938e833e6fc61c6182f4b15cf11d3479c62503ad97f9c29a71e5983"} Jul 31 14:49:08.382873 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:08.382579 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6ctks" Jul 31 14:49:08.402282 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:08.402240 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6ctks" podStartSLOduration=65.526737708 podStartE2EDuration="1m8.402226376s" totalImagesPullingTime="2.875488668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:08.401233539 +0000 UTC m=+104.246922083" watchObservedRunningTime="2026-07-31 14:49:08.402226376 +0000 UTC m=+104.247914920" Jul 31 14:49:10.254294 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:10.254254 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rdv99" Jul 31 14:49:11.772225 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:11.772195 2560 scope.go:117] "RemoveContainer" containerID="18b861b80508c651124b1da17a60c5cd7821ea11ac1e484a3388df40fa2b5bca" Jul 31 14:49:11.772602 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:49:11.772344 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hpgvd_openshift-console-operator(20e9d578-befb-479e-a4fb-8446a9bf99b5)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podUID="20e9d578-befb-479e-a4fb-8446a9bf99b5" Jul 31 14:49:16.243624 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.243589 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vpl5n"] Jul 31 14:49:16.246918 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.246894 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.251583 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.251564 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 14:49:16.251878 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.251858 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 14:49:16.251878 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.251867 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 14:49:16.252293 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.252277 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t7hpg\"" Jul 31 14:49:16.252374 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.252356 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 14:49:16.274636 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-root\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.274720 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-sys\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.274781 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-wtmp\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.274856 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274816 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6592dc69-e826-4270-8f9e-8bd149bd99db-metrics-client-ca\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.274918 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-tls\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.274977 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rlcq\" (UniqueName: \"kubernetes.io/projected/6592dc69-e826-4270-8f9e-8bd149bd99db-kube-api-access-5rlcq\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.275029 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.274975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-textfile\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.275029 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.275002 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.275120 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.275056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375489 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-sys\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375634 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375533 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-wtmp\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375634 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375585 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-sys\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375634 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6592dc69-e826-4270-8f9e-8bd149bd99db-metrics-client-ca\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375792 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-tls\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375792 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rlcq\" (UniqueName: \"kubernetes.io/projected/6592dc69-e826-4270-8f9e-8bd149bd99db-kube-api-access-5rlcq\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375792 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375729 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-wtmp\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375792 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375740 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-textfile\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.375792 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.376079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.376079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-root\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.376079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.375946 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6592dc69-e826-4270-8f9e-8bd149bd99db-root\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.376239 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.376082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-textfile\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.376239 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.376213 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6592dc69-e826-4270-8f9e-8bd149bd99db-metrics-client-ca\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.376370 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.376351 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-accelerators-collector-config\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.378116 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.378096 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.378224 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.378208 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6592dc69-e826-4270-8f9e-8bd149bd99db-node-exporter-tls\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.385231 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.385200 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rlcq\" (UniqueName: \"kubernetes.io/projected/6592dc69-e826-4270-8f9e-8bd149bd99db-kube-api-access-5rlcq\") pod \"node-exporter-vpl5n\" (UID: \"6592dc69-e826-4270-8f9e-8bd149bd99db\") " pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.555889 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:16.555858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vpl5n" Jul 31 14:49:16.567537 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:16.567502 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6592dc69_e826_4270_8f9e_8bd149bd99db.slice/crio-c21f7f5260c71d43e0ec20bb65fa7c12182c4d34324081f7b5f8128e60954c86 WatchSource:0}: Error finding container c21f7f5260c71d43e0ec20bb65fa7c12182c4d34324081f7b5f8128e60954c86: Status 404 returned error can't find the container with id c21f7f5260c71d43e0ec20bb65fa7c12182c4d34324081f7b5f8128e60954c86 Jul 31 14:49:17.415044 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:17.415009 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpl5n" event={"ID":"6592dc69-e826-4270-8f9e-8bd149bd99db","Type":"ContainerStarted","Data":"c21f7f5260c71d43e0ec20bb65fa7c12182c4d34324081f7b5f8128e60954c86"} Jul 31 14:49:18.285935 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.285897 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd"] Jul 31 14:49:18.289331 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.289314 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.291751 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.291727 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 31 14:49:18.291869 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.291819 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 31 14:49:18.292929 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.292903 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 31 14:49:18.293041 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.292937 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-dq2cc\"" Jul 31 14:49:18.293041 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.292947 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 31 14:49:18.293041 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.292999 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 31 14:49:18.293041 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.292950 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3rmcbg7nmfkdo\"" Jul 31 14:49:18.309516 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.309487 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd"] Jul 31 14:49:18.387534 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.387508 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6ctks" Jul 31 14:49:18.391141 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391212 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391267 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391229 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-grpc-tls\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391305 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391284 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlr75\" (UniqueName: \"kubernetes.io/projected/436dc9ae-a658-4eb6-9d98-c64c7a548088-kube-api-access-wlr75\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391342 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391313 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-tls\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391342 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436dc9ae-a658-4eb6-9d98-c64c7a548088-metrics-client-ca\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391411 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.391411 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.391402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.421136 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.421101 2560 generic.go:356] "Generic (PLEG): container finished" podID="6592dc69-e826-4270-8f9e-8bd149bd99db" containerID="165cfcb03efcf7f82812b7ba78f299956a6c703a5b24aa8a764b011e82403782" exitCode=0 Jul 31 14:49:18.421589 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.421145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpl5n" event={"ID":"6592dc69-e826-4270-8f9e-8bd149bd99db","Type":"ContainerDied","Data":"165cfcb03efcf7f82812b7ba78f299956a6c703a5b24aa8a764b011e82403782"} Jul 31 14:49:18.492416 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492388 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492527 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492593 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-grpc-tls\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492593 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlr75\" (UniqueName: \"kubernetes.io/projected/436dc9ae-a658-4eb6-9d98-c64c7a548088-kube-api-access-wlr75\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-tls\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492633 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436dc9ae-a658-4eb6-9d98-c64c7a548088-metrics-client-ca\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492699 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.492869 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.492725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.494021 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.493975 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/436dc9ae-a658-4eb6-9d98-c64c7a548088-metrics-client-ca\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.495458 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.495433 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-tls\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.495807 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.495783 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.496102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.496081 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.496455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.496433 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.496546 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.496495 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-grpc-tls\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.496663 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.496645 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/436dc9ae-a658-4eb6-9d98-c64c7a548088-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.511520 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.511499 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlr75\" (UniqueName: \"kubernetes.io/projected/436dc9ae-a658-4eb6-9d98-c64c7a548088-kube-api-access-wlr75\") pod \"thanos-querier-669cbb5cb8-zfdgd\" (UID: \"436dc9ae-a658-4eb6-9d98-c64c7a548088\") " pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.598737 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.598710 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:18.762382 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:18.762352 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd"] Jul 31 14:49:18.763728 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:18.763700 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436dc9ae_a658_4eb6_9d98_c64c7a548088.slice/crio-14457dd59cf51174e5b8090329182978fdbda086b579af1c3e637fa7037471f0 WatchSource:0}: Error finding container 14457dd59cf51174e5b8090329182978fdbda086b579af1c3e637fa7037471f0: Status 404 returned error can't find the container with id 14457dd59cf51174e5b8090329182978fdbda086b579af1c3e637fa7037471f0 Jul 31 14:49:19.428666 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:19.428631 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpl5n" event={"ID":"6592dc69-e826-4270-8f9e-8bd149bd99db","Type":"ContainerStarted","Data":"5d811b54033e6f98b9f30a8760156021829c8ed5201264f0c2e8f99f8f3eb0ed"} Jul 31 14:49:19.429109 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:19.428691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vpl5n" event={"ID":"6592dc69-e826-4270-8f9e-8bd149bd99db","Type":"ContainerStarted","Data":"7cf873ba1b94a7a668addac9eb4b9f08f86097b69bda1fbbe718b3c038b41704"} Jul 31 14:49:19.430230 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:19.430195 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"14457dd59cf51174e5b8090329182978fdbda086b579af1c3e637fa7037471f0"} Jul 31 14:49:19.457561 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:19.457514 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vpl5n" podStartSLOduration=2.514933383 podStartE2EDuration="3.457500244s" totalImagesPullingTime="879.301523ms" totalInitContainerRuntime="63.265338ms" isStatefulPod=true podCreationTimestamp="2026-07-31 14:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:19.456856405 +0000 UTC m=+115.302544951" watchObservedRunningTime="2026-07-31 14:49:19.457500244 +0000 UTC m=+115.303188843" Jul 31 14:49:20.906463 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:20.906425 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4"] Jul 31 14:49:20.909931 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:20.909911 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:20.913146 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:20.913122 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 31 14:49:20.914101 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:20.914062 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-s69nw\"" Jul 31 14:49:20.928696 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:20.928673 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4"] Jul 31 14:49:21.015784 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.015746 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c80cb60-16ab-451c-87a0-713dfc14b1c9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.015986 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.015796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shztx\" (UniqueName: \"kubernetes.io/projected/2c80cb60-16ab-451c-87a0-713dfc14b1c9-kube-api-access-shztx\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.116854 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.116797 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c80cb60-16ab-451c-87a0-713dfc14b1c9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.117041 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.116861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shztx\" (UniqueName: \"kubernetes.io/projected/2c80cb60-16ab-451c-87a0-713dfc14b1c9-kube-api-access-shztx\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.117041 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:49:21.116985 2560 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 31 14:49:21.117155 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:49:21.117065 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c80cb60-16ab-451c-87a0-713dfc14b1c9-monitoring-plugin-cert podName:2c80cb60-16ab-451c-87a0-713dfc14b1c9 nodeName:}" failed. No retries permitted until 2026-07-31 14:49:21.617045159 +0000 UTC m=+117.462733687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/2c80cb60-16ab-451c-87a0-713dfc14b1c9-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-48bv4" (UID: "2c80cb60-16ab-451c-87a0-713dfc14b1c9") : secret "monitoring-plugin-cert" not found Jul 31 14:49:21.127748 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.127720 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shztx\" (UniqueName: \"kubernetes.io/projected/2c80cb60-16ab-451c-87a0-713dfc14b1c9-kube-api-access-shztx\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.446767 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446675 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"2a909b69ba1ce096e985c712be209e38c676122d7b1348deb9230254e52bd494"} Jul 31 14:49:21.446767 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446750 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"dc1afde6ba5d2790beae7627c600b1a39d41798a351106a59aed3d9e6e38d1df"} Jul 31 14:49:21.447001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446789 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"ec7d02c7d349d30551e208126b550e75efcf28f275b1fd676b2b83bcd8cb63c3"} Jul 31 14:49:21.447001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446817 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"93f2316bed604d55727cbe85ea0bfdc604fcfd355feed59769ac3b0432374279"} Jul 31 14:49:21.447001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446866 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"ea0a0a8c0c17fab831fceeef4c6bcb93a6fd3aead12a567c21c13a0fa3287799"} Jul 31 14:49:21.447001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446903 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:21.447001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.446932 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" event={"ID":"436dc9ae-a658-4eb6-9d98-c64c7a548088","Type":"ContainerStarted","Data":"5949536308bc9703d410f658b24ff039e5cafb167c801e2cbae2fe9cd257839d"} Jul 31 14:49:21.499979 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.499930 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" podStartSLOduration=1.254336381 podStartE2EDuration="3.49991268s" totalImagesPullingTime="2.245576299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:21.499498268 +0000 UTC m=+117.345186827" watchObservedRunningTime="2026-07-31 14:49:21.49991268 +0000 UTC m=+117.345601225" Jul 31 14:49:21.621270 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.621239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c80cb60-16ab-451c-87a0-713dfc14b1c9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.623469 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.623445 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c80cb60-16ab-451c-87a0-713dfc14b1c9-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-48bv4\" (UID: \"2c80cb60-16ab-451c-87a0-713dfc14b1c9\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.820946 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.820920 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:21.955307 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:21.955283 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4"] Jul 31 14:49:21.957899 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:21.957874 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c80cb60_16ab_451c_87a0_713dfc14b1c9.slice/crio-f2ac8141a4474202579a1379456e4d7aaf734dcb05816b2fcda046cc14193f18 WatchSource:0}: Error finding container f2ac8141a4474202579a1379456e4d7aaf734dcb05816b2fcda046cc14193f18: Status 404 returned error can't find the container with id f2ac8141a4474202579a1379456e4d7aaf734dcb05816b2fcda046cc14193f18 Jul 31 14:49:22.452006 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.451967 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" event={"ID":"2c80cb60-16ab-451c-87a0-713dfc14b1c9","Type":"ContainerStarted","Data":"f2ac8141a4474202579a1379456e4d7aaf734dcb05816b2fcda046cc14193f18"} Jul 31 14:49:22.634328 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.634289 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:49:22.638603 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.638578 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.642129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.642102 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 14:49:22.642129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.642119 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9t34edc9bc1ej\"" Jul 31 14:49:22.642316 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.642109 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 14:49:22.643737 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.643715 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 14:49:22.645872 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.645849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 14:49:22.646049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.645879 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 14:49:22.646049 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.645855 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 14:49:22.646170 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.645850 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 14:49:22.646729 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.646557 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 14:49:22.646729 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.646604 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 14:49:22.646729 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.646612 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 14:49:22.647214 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.647034 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9m6wf\"" Jul 31 14:49:22.647214 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.647183 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 14:49:22.648353 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.647659 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 14:49:22.648849 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.648815 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 14:49:22.653359 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.653333 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 14:49:22.655164 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.655140 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 14:49:22.670201 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.670180 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:49:22.731010 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.730921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731010 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.730971 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45djw\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-kube-api-access-45djw\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731010 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.730999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731079 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731169 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731269 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731419 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731450 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-config\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731536 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.731588 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.731578 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.772218 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.772188 2560 scope.go:117] "RemoveContainer" containerID="18b861b80508c651124b1da17a60c5cd7821ea11ac1e484a3388df40fa2b5bca" Jul 31 14:49:22.833126 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833304 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833140 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833304 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833177 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-config\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833304 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833304 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833250 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833304 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833581 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833581 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833581 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45djw\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-kube-api-access-45djw\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833581 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833581 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.833581 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.833525 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.834318 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.834183 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.834432 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.834560 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835412 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835531 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836181 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.835710 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836774 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.836383 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-config\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.836774 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.836593 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.837059 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.837031 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.837666 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.837569 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.837666 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.837640 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.839528 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.838559 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.839528 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.838757 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.839528 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.838786 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.839528 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.839250 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.839528 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.839457 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.839856 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.839654 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.840144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.840122 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.841020 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.840943 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.841020 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.840998 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.841748 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.841725 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.843552 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.843530 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45djw\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-kube-api-access-45djw\") pod \"prometheus-k8s-0\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:22.952184 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:22.952146 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:23.243714 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.243687 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:49:23.244932 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:23.244899 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea81f85c_eff2_41f8_a3b1_88148671989d.slice/crio-17a5525eebd041338479e4d7a75762df423a106d9936d9d955da10c172773a88 WatchSource:0}: Error finding container 17a5525eebd041338479e4d7a75762df423a106d9936d9d955da10c172773a88: Status 404 returned error can't find the container with id 17a5525eebd041338479e4d7a75762df423a106d9936d9d955da10c172773a88 Jul 31 14:49:23.457431 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.457337 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" event={"ID":"2c80cb60-16ab-451c-87a0-713dfc14b1c9","Type":"ContainerStarted","Data":"47c4f1f1f79d76c4a4b057e17c22994d64cc36e3ad34437043b88478b191a68e"} Jul 31 14:49:23.457586 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.457500 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:23.458592 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.458565 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"17a5525eebd041338479e4d7a75762df423a106d9936d9d955da10c172773a88"} Jul 31 14:49:23.460515 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.460497 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:49:23.460621 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.460592 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" event={"ID":"20e9d578-befb-479e-a4fb-8446a9bf99b5","Type":"ContainerStarted","Data":"1a4b3ae57796dfc5a9252bd3aa9c42c8347face590fa8d91c7f5d8e72f9a9a58"} Jul 31 14:49:23.460887 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.460864 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:49:23.462840 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.462811 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" Jul 31 14:49:23.480598 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.480554 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-48bv4" podStartSLOduration=2.298405337 podStartE2EDuration="3.480542518s" totalImagesPullingTime="1.182137181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:23.479416696 +0000 UTC m=+119.325105241" watchObservedRunningTime="2026-07-31 14:49:23.480542518 +0000 UTC m=+119.326231062" Jul 31 14:49:23.499612 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.499574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" podStartSLOduration=46.361462358 podStartE2EDuration="53.499562661s" totalImagesPullingTime="7.138100303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:23.497068733 +0000 UTC m=+119.342757289" watchObservedRunningTime="2026-07-31 14:49:23.499562661 +0000 UTC m=+119.345251206" Jul 31 14:49:23.675671 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:23.675643 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hpgvd" Jul 31 14:49:24.026302 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:24.026251 2560 patch_prober.go:28] interesting pod/image-registry-689f7f5dd8-cwzs8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 14:49:24.026451 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:24.026327 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" podUID="755ee731-917b-4b51-9a87-751e5dc3c4f1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 14:49:24.466073 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:24.466038 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" exitCode=0 Jul 31 14:49:24.466565 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:24.466129 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} Jul 31 14:49:26.380042 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:26.380009 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:27.403675 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:27.403639 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-689f7f5dd8-cwzs8"] Jul 31 14:49:27.464447 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:27.464416 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-669cbb5cb8-zfdgd" Jul 31 14:49:28.485009 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.484972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} Jul 31 14:49:28.485507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.485120 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} Jul 31 14:49:28.485507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.485169 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} Jul 31 14:49:28.485507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.485211 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} Jul 31 14:49:28.485507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.485259 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} Jul 31 14:49:28.485507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.485299 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerStarted","Data":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} Jul 31 14:49:28.517779 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:28.517721 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4381910270000002 podStartE2EDuration="6.517699282s" totalImagesPullingTime="4.063241821s" totalInitContainerRuntime="16.266434ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:49:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:28.51634427 +0000 UTC m=+124.362032825" watchObservedRunningTime="2026-07-31 14:49:28.517699282 +0000 UTC m=+124.363387829" Jul 31 14:49:32.953070 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:32.953025 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:49:33.531692 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:33.531650 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:49:33.534243 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:33.534218 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5fb7fa83-52a0-40e4-b330-f5e759c766b1-metrics-certs\") pod \"network-metrics-daemon-tfmsm\" (UID: \"5fb7fa83-52a0-40e4-b330-f5e759c766b1\") " pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:49:33.794686 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:33.794602 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-262fz\"" Jul 31 14:49:33.802018 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:33.801991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tfmsm" Jul 31 14:49:33.939276 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:33.939244 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tfmsm"] Jul 31 14:49:33.942555 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:49:33.942522 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb7fa83_52a0_40e4_b330_f5e759c766b1.slice/crio-a9b5fa9a243629a1f4804f041439d678e345b4e80c2e98acf01cad9fd96de844 WatchSource:0}: Error finding container a9b5fa9a243629a1f4804f041439d678e345b4e80c2e98acf01cad9fd96de844: Status 404 returned error can't find the container with id a9b5fa9a243629a1f4804f041439d678e345b4e80c2e98acf01cad9fd96de844 Jul 31 14:49:34.516102 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:34.516052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tfmsm" event={"ID":"5fb7fa83-52a0-40e4-b330-f5e759c766b1","Type":"ContainerStarted","Data":"a9b5fa9a243629a1f4804f041439d678e345b4e80c2e98acf01cad9fd96de844"} Jul 31 14:49:35.521336 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:35.521296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tfmsm" event={"ID":"5fb7fa83-52a0-40e4-b330-f5e759c766b1","Type":"ContainerStarted","Data":"7cd8fc03019e78cb5728c22871ca46f1817d980315f20fd7a0ac8f788dd4f9aa"} Jul 31 14:49:35.521759 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:35.521355 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tfmsm" event={"ID":"5fb7fa83-52a0-40e4-b330-f5e759c766b1","Type":"ContainerStarted","Data":"09a8369e07d5222e0a6c2a836ed00d1bb881a9535d29a7a9bbd01b729b5394b3"} Jul 31 14:49:35.543402 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:35.543346 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tfmsm" podStartSLOduration=129.625434147 podStartE2EDuration="2m10.543331356s" totalImagesPullingTime="917.897209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:47:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:49:35.543275518 +0000 UTC m=+131.388964063" watchObservedRunningTime="2026-07-31 14:49:35.543331356 +0000 UTC m=+131.389019899" Jul 31 14:49:52.424714 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.424654 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" podUID="755ee731-917b-4b51-9a87-751e5dc3c4f1" containerName="registry" containerID="cri-o://5fe92c04d5558b203daedc07f0cf2416ac0436f5b5af64167e2575c538623395" gracePeriod=30 Jul 31 14:49:52.597082 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.596992 2560 generic.go:356] "Generic (PLEG): container finished" podID="755ee731-917b-4b51-9a87-751e5dc3c4f1" containerID="5fe92c04d5558b203daedc07f0cf2416ac0436f5b5af64167e2575c538623395" exitCode=0 Jul 31 14:49:52.597220 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.597075 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" event={"ID":"755ee731-917b-4b51-9a87-751e5dc3c4f1","Type":"ContainerDied","Data":"5fe92c04d5558b203daedc07f0cf2416ac0436f5b5af64167e2575c538623395"} Jul 31 14:49:52.677062 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.677010 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:52.799549 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799520 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-image-registry-private-configuration\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799677 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799589 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xln4d\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-kube-api-access-xln4d\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799677 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799615 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-certificates\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799677 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799648 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/755ee731-917b-4b51-9a87-751e5dc3c4f1-ca-trust-extracted\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799677 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799674 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799889 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799712 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-trusted-ca\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799889 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799761 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-bound-sa-token\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.799889 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.799793 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-installation-pull-secrets\") pod \"755ee731-917b-4b51-9a87-751e5dc3c4f1\" (UID: \"755ee731-917b-4b51-9a87-751e5dc3c4f1\") " Jul 31 14:49:52.800562 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.800134 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:49:52.800562 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.800210 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:49:52.804934 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.804890 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-kube-api-access-xln4d" (OuterVolumeSpecName: "kube-api-access-xln4d") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "kube-api-access-xln4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:49:52.804934 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.804889 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:49:52.805292 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.805260 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:49:52.805408 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.805357 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:49:52.805408 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.805374 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:49:52.809300 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.809272 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755ee731-917b-4b51-9a87-751e5dc3c4f1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "755ee731-917b-4b51-9a87-751e5dc3c4f1" (UID: "755ee731-917b-4b51-9a87-751e5dc3c4f1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:49:52.901294 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901264 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xln4d\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-kube-api-access-xln4d\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901294 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901291 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-certificates\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901305 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/755ee731-917b-4b51-9a87-751e5dc3c4f1-ca-trust-extracted\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901319 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-registry-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901329 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/755ee731-917b-4b51-9a87-751e5dc3c4f1-trusted-ca\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901340 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/755ee731-917b-4b51-9a87-751e5dc3c4f1-bound-sa-token\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901351 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-installation-pull-secrets\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:52.901455 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:52.901365 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/755ee731-917b-4b51-9a87-751e5dc3c4f1-image-registry-private-configuration\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:49:53.602212 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:53.602186 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" Jul 31 14:49:53.602619 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:53.602185 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689f7f5dd8-cwzs8" event={"ID":"755ee731-917b-4b51-9a87-751e5dc3c4f1","Type":"ContainerDied","Data":"49c1592852edb1ec41b8ead6096fc5c66482ecdfb054740890f5a28bdcae89dd"} Jul 31 14:49:53.602619 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:53.602329 2560 scope.go:117] "RemoveContainer" containerID="5fe92c04d5558b203daedc07f0cf2416ac0436f5b5af64167e2575c538623395" Jul 31 14:49:53.623845 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:53.623811 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-689f7f5dd8-cwzs8"] Jul 31 14:49:53.630813 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:53.630789 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-689f7f5dd8-cwzs8"] Jul 31 14:49:54.608174 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:54.608145 2560 generic.go:356] "Generic (PLEG): container finished" podID="3b348026-4c9d-45cc-b04b-cb4e52606a70" containerID="744830ec58c479e831ac67dc05d486ccd86d93d7e54c42a9f75734c4a962355c" exitCode=0 Jul 31 14:49:54.608574 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:54.608209 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" event={"ID":"3b348026-4c9d-45cc-b04b-cb4e52606a70","Type":"ContainerDied","Data":"744830ec58c479e831ac67dc05d486ccd86d93d7e54c42a9f75734c4a962355c"} Jul 31 14:49:54.608574 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:54.608495 2560 scope.go:117] "RemoveContainer" containerID="744830ec58c479e831ac67dc05d486ccd86d93d7e54c42a9f75734c4a962355c" Jul 31 14:49:54.781507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:54.781473 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755ee731-917b-4b51-9a87-751e5dc3c4f1" path="/var/lib/kubelet/pods/755ee731-917b-4b51-9a87-751e5dc3c4f1/volumes" Jul 31 14:49:55.614476 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:49:55.614444 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-vkzp6" event={"ID":"3b348026-4c9d-45cc-b04b-cb4e52606a70","Type":"ContainerStarted","Data":"35b7b722612cff88765e56f6faabb8aa49d13532b54427d89c9f2983ba73fc5b"} Jul 31 14:50:04.650444 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:04.650410 2560 generic.go:356] "Generic (PLEG): container finished" podID="76459ad2-12db-4330-9042-be87b3365cba" containerID="41ebd59b1e5520c8c19a6c165c612a65e3ec0d54a6230cf2d4bf0fe0e19b6582" exitCode=0 Jul 31 14:50:04.650905 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:04.650480 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8zj96" event={"ID":"76459ad2-12db-4330-9042-be87b3365cba","Type":"ContainerDied","Data":"41ebd59b1e5520c8c19a6c165c612a65e3ec0d54a6230cf2d4bf0fe0e19b6582"} Jul 31 14:50:04.650965 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:04.650922 2560 scope.go:117] "RemoveContainer" containerID="41ebd59b1e5520c8c19a6c165c612a65e3ec0d54a6230cf2d4bf0fe0e19b6582" Jul 31 14:50:05.397723 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:05.397689 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7758b75b96-jp5tv_152bf7b5-8e6e-4f17-9b60-d23c24287110/router/0.log" Jul 31 14:50:05.419605 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:05.419576 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxqts_adc07795-e3d1-4c0f-9ff4-64298b2e8386/serve-healthcheck-canary/0.log" Jul 31 14:50:05.656056 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:05.655979 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-8zj96" event={"ID":"76459ad2-12db-4330-9042-be87b3365cba","Type":"ContainerStarted","Data":"03d5c937deb94841561d020b1a95938ae0d1d9de8017d2e3fc6eb3ae433f4f13"} Jul 31 14:50:10.677228 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:10.677195 2560 generic.go:356] "Generic (PLEG): container finished" podID="a4b42702-60bb-4c51-956f-8646edf947ac" containerID="ea3bb446a7d53455c8c8cd787509b0267a28bff563688f60b2b6a25811ca589a" exitCode=0 Jul 31 14:50:10.677611 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:10.677274 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" event={"ID":"a4b42702-60bb-4c51-956f-8646edf947ac","Type":"ContainerDied","Data":"ea3bb446a7d53455c8c8cd787509b0267a28bff563688f60b2b6a25811ca589a"} Jul 31 14:50:10.677660 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:10.677645 2560 scope.go:117] "RemoveContainer" containerID="ea3bb446a7d53455c8c8cd787509b0267a28bff563688f60b2b6a25811ca589a" Jul 31 14:50:11.683285 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:11.683247 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-sdh6n" event={"ID":"a4b42702-60bb-4c51-956f-8646edf947ac","Type":"ContainerStarted","Data":"194fb44c2e84dcb67a239a5340071d71cb101656d4ea52ca891c36312fd8ede2"} Jul 31 14:50:22.952909 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:22.952796 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:22.968796 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:22.968767 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:23.747670 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:23.747646 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:41.056842 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.056786 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:50:41.057594 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.057203 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy" containerID="cri-o://8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" gracePeriod=600 Jul 31 14:50:41.057594 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.057194 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="prometheus" containerID="cri-o://13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" gracePeriod=600 Jul 31 14:50:41.057594 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.057215 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="thanos-sidecar" containerID="cri-o://dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" gracePeriod=600 Jul 31 14:50:41.057594 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.057245 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-web" containerID="cri-o://6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" gracePeriod=600 Jul 31 14:50:41.057773 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.057269 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="config-reloader" containerID="cri-o://e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" gracePeriod=600 Jul 31 14:50:41.057773 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.057269 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" gracePeriod=600 Jul 31 14:50:41.294064 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.294042 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:41.412595 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412514 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-trusted-ca-bundle\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412595 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412556 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-db\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412595 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412573 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-thanos-prometheus-http-client-file\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412607 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-config\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412626 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-kubelet-serving-ca-bundle\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412642 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412662 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-serving-certs-ca-bundle\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412688 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-grpc-tls\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412737 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-2\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412778 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-tls-assets\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412814 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-kube-rbac-proxy\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.412879 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412878 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-metrics-client-certs\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412915 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-metrics-client-ca\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412948 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-1\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412979 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-web-config\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413008 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413057 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45djw\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-kube-api-access-45djw\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413092 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-tls\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.412996 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413133 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-config-out\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413333 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413183 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-0\") pod \"ea81f85c-eff2-41f8-a3b1-88148671989d\" (UID: \"ea81f85c-eff2-41f8-a3b1-88148671989d\") " Jul 31 14:50:41.413780 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413410 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.413780 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413468 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.413780 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413754 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.413965 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.413779 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.414062 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.414030 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:50:41.415693 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.415663 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.416068 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416041 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-config" (OuterVolumeSpecName: "config") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416245 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416330 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416677 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416744 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416751 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416799 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416866 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.416941 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.416903 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.417426 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.417109 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-config-out" (OuterVolumeSpecName: "config-out") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:50:41.417597 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.417572 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:41.417872 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.417850 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.418014 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.417988 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-kube-api-access-45djw" (OuterVolumeSpecName: "kube-api-access-45djw") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "kube-api-access-45djw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:50:41.429144 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.429116 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-web-config" (OuterVolumeSpecName: "web-config") pod "ea81f85c-eff2-41f8-a3b1-88148671989d" (UID: "ea81f85c-eff2-41f8-a3b1-88148671989d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 14:50:41.514640 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514611 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514640 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514636 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-web-config\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514647 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514657 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45djw\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-kube-api-access-45djw\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514666 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514674 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-config-out\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514682 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514690 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-db\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514698 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514709 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-config\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514717 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514726 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514735 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514743 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-grpc-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514751 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514759 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea81f85c-eff2-41f8-a3b1-88148671989d-tls-assets\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514766 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-kube-rbac-proxy\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514774 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea81f85c-eff2-41f8-a3b1-88148671989d-secret-metrics-client-certs\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.514776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.514782 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea81f85c-eff2-41f8-a3b1-88148671989d-configmap-metrics-client-ca\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:50:41.810051 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810014 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" exitCode=0 Jul 31 14:50:41.810051 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810042 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" exitCode=0 Jul 31 14:50:41.810051 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810053 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" exitCode=0 Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810062 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" exitCode=0 Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810069 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" exitCode=0 Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810076 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" exitCode=0 Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810095 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810186 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810243 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810259 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} Jul 31 14:50:41.810308 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810304 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} Jul 31 14:50:41.810723 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.810336 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea81f85c-eff2-41f8-a3b1-88148671989d","Type":"ContainerDied","Data":"17a5525eebd041338479e4d7a75762df423a106d9936d9d955da10c172773a88"} Jul 31 14:50:41.818470 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.818454 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.825812 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.825794 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.832486 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.832468 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.839174 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.839157 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.841963 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.841944 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:50:41.845805 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.845785 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:50:41.846353 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.846329 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.854966 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.854953 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.861188 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861173 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.861432 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.861411 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.861475 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861439 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} err="failed to get container status \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" Jul 31 14:50:41.861475 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861468 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.861675 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.861661 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.861711 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861679 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} err="failed to get container status \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" Jul 31 14:50:41.861711 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861692 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.861895 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.861875 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.862040 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861895 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} err="failed to get container status \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" Jul 31 14:50:41.862040 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.861909 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.862141 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.862124 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.862177 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862152 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} err="failed to get container status \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" Jul 31 14:50:41.862213 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862175 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.862428 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.862410 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.862482 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862433 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} err="failed to get container status \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" Jul 31 14:50:41.862482 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862451 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.862656 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.862641 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.862693 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862660 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} err="failed to get container status \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" Jul 31 14:50:41.862693 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862673 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.862993 ip-10-0-143-167 kubenswrapper[2560]: E0731 14:50:41.862976 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.863050 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.862996 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} err="failed to get container status \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" Jul 31 14:50:41.863050 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863009 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.863194 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863174 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} err="failed to get container status \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" Jul 31 14:50:41.863237 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863198 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.863379 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863363 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} err="failed to get container status \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" Jul 31 14:50:41.863424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863380 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.863574 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863558 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} err="failed to get container status \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" Jul 31 14:50:41.863615 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863574 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.863766 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863751 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} err="failed to get container status \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" Jul 31 14:50:41.863807 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863766 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.863976 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863959 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} err="failed to get container status \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" Jul 31 14:50:41.864023 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.863976 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.864154 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864139 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} err="failed to get container status \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" Jul 31 14:50:41.864194 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864154 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.864375 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864358 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} err="failed to get container status \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" Jul 31 14:50:41.864466 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864376 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.864603 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864587 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} err="failed to get container status \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" Jul 31 14:50:41.864645 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864603 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.864791 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864772 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} err="failed to get container status \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" Jul 31 14:50:41.864848 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864793 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.865002 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.864974 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} err="failed to get container status \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" Jul 31 14:50:41.865002 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865001 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.865228 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865211 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} err="failed to get container status \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" Jul 31 14:50:41.865228 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865228 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.865487 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865469 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} err="failed to get container status \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" Jul 31 14:50:41.865530 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865489 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.865686 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865671 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} err="failed to get container status \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" Jul 31 14:50:41.865743 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865686 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.865893 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865873 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} err="failed to get container status \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" Jul 31 14:50:41.865938 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.865894 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.866091 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866075 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} err="failed to get container status \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" Jul 31 14:50:41.866141 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866092 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.866295 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866277 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} err="failed to get container status \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" Jul 31 14:50:41.866332 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866296 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.866497 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866481 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} err="failed to get container status \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" Jul 31 14:50:41.866555 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866497 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.866700 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866685 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} err="failed to get container status \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" Jul 31 14:50:41.866742 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866700 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.866892 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866874 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} err="failed to get container status \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" Jul 31 14:50:41.866953 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.866893 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.867125 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867109 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} err="failed to get container status \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" Jul 31 14:50:41.867177 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867126 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.867331 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867312 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} err="failed to get container status \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" Jul 31 14:50:41.867375 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867332 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.867551 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867533 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} err="failed to get container status \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" Jul 31 14:50:41.867595 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867551 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.867788 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867767 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} err="failed to get container status \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" Jul 31 14:50:41.867897 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867788 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.867996 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867981 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} err="failed to get container status \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" Jul 31 14:50:41.868054 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.867997 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.868196 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868168 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} err="failed to get container status \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" Jul 31 14:50:41.868196 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868189 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.868382 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868364 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} err="failed to get container status \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" Jul 31 14:50:41.868450 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868385 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.868587 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868572 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} err="failed to get container status \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" Jul 31 14:50:41.868636 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868586 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.868773 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868758 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} err="failed to get container status \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" Jul 31 14:50:41.868773 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868772 2560 scope.go:117] "RemoveContainer" containerID="df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98" Jul 31 14:50:41.868985 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868967 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98"} err="failed to get container status \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": rpc error: code = NotFound desc = could not find container \"df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98\": container with ID starting with df2aa095ae867e1a5a74bbe4fef062c28eee5ca618157247a1da1bbe2f60af98 not found: ID does not exist" Jul 31 14:50:41.869037 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.868986 2560 scope.go:117] "RemoveContainer" containerID="8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971" Jul 31 14:50:41.869215 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869195 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971"} err="failed to get container status \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": rpc error: code = NotFound desc = could not find container \"8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971\": container with ID starting with 8419e5924c6bbefbda84857f9d1a0b7d95668e63d6fdbf4887e64e44249e4971 not found: ID does not exist" Jul 31 14:50:41.869278 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869217 2560 scope.go:117] "RemoveContainer" containerID="6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9" Jul 31 14:50:41.869430 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869411 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9"} err="failed to get container status \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": rpc error: code = NotFound desc = could not find container \"6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9\": container with ID starting with 6f0935e169ae3fda630ca03e16120dc1995e7b4210faa4dbf29506bb200f10a9 not found: ID does not exist" Jul 31 14:50:41.869478 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869430 2560 scope.go:117] "RemoveContainer" containerID="dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d" Jul 31 14:50:41.869620 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869602 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d"} err="failed to get container status \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": rpc error: code = NotFound desc = could not find container \"dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d\": container with ID starting with dba6a23c4c1285a2085c8bf8a1969c2a76f4d57917d11efac79fb1f93440b47d not found: ID does not exist" Jul 31 14:50:41.869685 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869622 2560 scope.go:117] "RemoveContainer" containerID="e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8" Jul 31 14:50:41.869860 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869818 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8"} err="failed to get container status \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": rpc error: code = NotFound desc = could not find container \"e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8\": container with ID starting with e69360c3b72bee9ea8ae5c13e01a990d038a4496d339b59659db69c17f598cb8 not found: ID does not exist" Jul 31 14:50:41.869860 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.869859 2560 scope.go:117] "RemoveContainer" containerID="13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093" Jul 31 14:50:41.870081 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.870063 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093"} err="failed to get container status \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": rpc error: code = NotFound desc = could not find container \"13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093\": container with ID starting with 13324817c947d2a44ac7d168423b24f83b531fe6819048231ed8c0ca296fd093 not found: ID does not exist" Jul 31 14:50:41.870138 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.870082 2560 scope.go:117] "RemoveContainer" containerID="61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f" Jul 31 14:50:41.870301 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.870284 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f"} err="failed to get container status \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": rpc error: code = NotFound desc = could not find container \"61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f\": container with ID starting with 61533e82a566609e620cd5ac16d2cda3863ddcbf4bfbd7045761dcafd9ada22f not found: ID does not exist" Jul 31 14:50:41.902796 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.902773 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:50:41.903063 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903051 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="thanos-sidecar" Jul 31 14:50:41.903106 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903065 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="thanos-sidecar" Jul 31 14:50:41.903106 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903077 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755ee731-917b-4b51-9a87-751e5dc3c4f1" containerName="registry" Jul 31 14:50:41.903106 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903082 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="755ee731-917b-4b51-9a87-751e5dc3c4f1" containerName="registry" Jul 31 14:50:41.903106 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903090 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-thanos" Jul 31 14:50:41.903106 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903096 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-thanos" Jul 31 14:50:41.903106 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903106 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="prometheus" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903112 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="prometheus" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903121 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="config-reloader" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903126 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="config-reloader" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903134 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-web" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903139 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-web" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903146 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903151 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903158 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="init-config-reloader" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903163 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="init-config-reloader" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903210 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="config-reloader" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903219 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="755ee731-917b-4b51-9a87-751e5dc3c4f1" containerName="registry" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903225 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-thanos" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903230 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="prometheus" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903237 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy-web" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903242 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="thanos-sidecar" Jul 31 14:50:41.903326 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.903249 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" containerName="kube-rbac-proxy" Jul 31 14:50:41.908291 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.908277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:41.919246 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919228 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 14:50:41.919342 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919254 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 14:50:41.919342 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919268 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 14:50:41.919434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919394 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 14:50:41.919434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919405 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 14:50:41.919539 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919397 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 14:50:41.919539 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919468 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 14:50:41.919901 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919863 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 14:50:41.919961 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919932 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 14:50:41.920021 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.919995 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 14:50:41.920075 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.920041 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 14:50:41.920197 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.920181 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 14:50:41.920258 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.920222 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 14:50:41.920258 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.920246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9t34edc9bc1ej\"" Jul 31 14:50:41.920258 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.920251 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9m6wf\"" Jul 31 14:50:41.922175 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.922160 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 14:50:41.931084 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.931062 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 14:50:41.941225 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:41.941200 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:50:42.019656 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-config\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.019779 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019661 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.019779 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019683 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02ea7647-7689-4faa-9151-490993462d11-config-out\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.019779 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019702 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.019779 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019744 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-web-config\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019849 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02ea7647-7689-4faa-9151-490993462d11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.019983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020039 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020035 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2bx\" (UniqueName: \"kubernetes.io/projected/02ea7647-7689-4faa-9151-490993462d11-kube-api-access-8t2bx\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020057 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020077 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020164 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020189 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.020339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.020248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.121666 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.121666 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02ea7647-7689-4faa-9151-490993462d11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2bx\" (UniqueName: \"kubernetes.io/projected/02ea7647-7689-4faa-9151-490993462d11-kube-api-access-8t2bx\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121795 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121818 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.121990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122088 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122129 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122121 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-config\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122145 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122179 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02ea7647-7689-4faa-9151-490993462d11-config-out\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122221 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-web-config\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122629 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.122776 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122687 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.123169 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.122870 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.124935 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.124801 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02ea7647-7689-4faa-9151-490993462d11-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125090 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125068 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125171 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125141 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125233 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125162 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125284 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125241 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-config\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125611 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125583 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125760 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125630 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.125937 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125916 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.126003 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125960 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.126003 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.125976 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.126330 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.126306 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.126967 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.126941 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.127117 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.127098 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02ea7647-7689-4faa-9151-490993462d11-config-out\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.127565 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.127548 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.127970 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.127956 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02ea7647-7689-4faa-9151-490993462d11-web-config\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.128357 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.128340 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/02ea7647-7689-4faa-9151-490993462d11-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.131431 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.131412 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2bx\" (UniqueName: \"kubernetes.io/projected/02ea7647-7689-4faa-9151-490993462d11-kube-api-access-8t2bx\") pod \"prometheus-k8s-0\" (UID: \"02ea7647-7689-4faa-9151-490993462d11\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.217502 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.217465 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:50:42.397964 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.397893 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 14:50:42.400729 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:50:42.400702 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ea7647_7689_4faa_9151_490993462d11.slice/crio-cb60b947868cc6495533efbb451c72064e784301f2dc3675fcb9adc55b109352 WatchSource:0}: Error finding container cb60b947868cc6495533efbb451c72064e784301f2dc3675fcb9adc55b109352: Status 404 returned error can't find the container with id cb60b947868cc6495533efbb451c72064e784301f2dc3675fcb9adc55b109352 Jul 31 14:50:42.777058 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.776980 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea81f85c-eff2-41f8-a3b1-88148671989d" path="/var/lib/kubelet/pods/ea81f85c-eff2-41f8-a3b1-88148671989d/volumes" Jul 31 14:50:42.815359 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.815328 2560 generic.go:356] "Generic (PLEG): container finished" podID="02ea7647-7689-4faa-9151-490993462d11" containerID="d43285da67d60be6801cef83f3297be0f1c76a02be79f1e3a5b3bed1b05e6f2f" exitCode=0 Jul 31 14:50:42.815507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.815430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerDied","Data":"d43285da67d60be6801cef83f3297be0f1c76a02be79f1e3a5b3bed1b05e6f2f"} Jul 31 14:50:42.815565 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:42.815503 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"cb60b947868cc6495533efbb451c72064e784301f2dc3675fcb9adc55b109352"} Jul 31 14:50:43.823976 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.823938 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"020102ea666a9acc3ac061a8b868338e3b7d37b0e691084dab6111bdbe0ca14d"} Jul 31 14:50:43.824434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.824027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"6e28c334c507536e8c56c73936a21f6783c55b26a6b122b9f0fabadbbbce70f2"} Jul 31 14:50:43.824434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.824055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"37aa04750f239aba5f3af3a6fefdbe18d1dfb2f22a87efac1e36c3f98373c7c6"} Jul 31 14:50:43.824434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.824078 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"32aded13907dd25170e388739d0eeabf6112c63416449e824479d4a50d19240f"} Jul 31 14:50:43.824434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.824100 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"7ac39e6665725959b4bc92994ad07ad69d829f7df710d7422e0cc0696645bc08"} Jul 31 14:50:43.824434 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.824127 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"02ea7647-7689-4faa-9151-490993462d11","Type":"ContainerStarted","Data":"23b3c288934aa49bcaf86ce7cbd4e7c7765d59e5ca452e9a296ab0931d3f8ae9"} Jul 31 14:50:43.869376 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:43.869326 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.851493188 podStartE2EDuration="2.869310759s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.817571ms" isStatefulPod=false podCreationTimestamp="2026-07-31 14:50:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:50:43.867303393 +0000 UTC m=+199.712991937" watchObservedRunningTime="2026-07-31 14:50:43.869310759 +0000 UTC m=+199.714999305" Jul 31 14:50:47.218355 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:50:47.218300 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:51:42.217810 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:51:42.217762 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:51:42.233206 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:51:42.233180 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:51:43.070937 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:51:43.070907 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 14:52:24.561518 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:52:24.561486 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:52:24.568691 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:52:24.568666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:52:24.572898 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:52:24.572876 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 14:57:24.588621 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:24.588592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:57:24.599779 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:24.599750 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 14:57:35.363345 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.363306 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-v787p"] Jul 31 14:57:35.366367 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.366338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-v787p" Jul 31 14:57:35.368920 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.368899 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 31 14:57:35.369026 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.368901 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-hhjb4\"" Jul 31 14:57:35.369220 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.369204 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 31 14:57:35.369630 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.369617 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 31 14:57:35.375713 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.375695 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-v787p"] Jul 31 14:57:35.501538 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.501499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17283790-b945-4e3c-b8e1-96d7554f3d4d-model-cache\") pod \"s3-init-v787p\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " pod="kserve/s3-init-v787p" Jul 31 14:57:35.501735 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.501554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwk2f\" (UniqueName: \"kubernetes.io/projected/17283790-b945-4e3c-b8e1-96d7554f3d4d-kube-api-access-fwk2f\") pod \"s3-init-v787p\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " pod="kserve/s3-init-v787p" Jul 31 14:57:35.602931 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.602891 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17283790-b945-4e3c-b8e1-96d7554f3d4d-model-cache\") pod \"s3-init-v787p\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " pod="kserve/s3-init-v787p" Jul 31 14:57:35.603087 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.602946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwk2f\" (UniqueName: \"kubernetes.io/projected/17283790-b945-4e3c-b8e1-96d7554f3d4d-kube-api-access-fwk2f\") pod \"s3-init-v787p\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " pod="kserve/s3-init-v787p" Jul 31 14:57:35.603265 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.603247 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17283790-b945-4e3c-b8e1-96d7554f3d4d-model-cache\") pod \"s3-init-v787p\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " pod="kserve/s3-init-v787p" Jul 31 14:57:35.612116 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.612094 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwk2f\" (UniqueName: \"kubernetes.io/projected/17283790-b945-4e3c-b8e1-96d7554f3d4d-kube-api-access-fwk2f\") pod \"s3-init-v787p\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " pod="kserve/s3-init-v787p" Jul 31 14:57:35.691024 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.690944 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-v787p" Jul 31 14:57:35.822191 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.822156 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-v787p"] Jul 31 14:57:35.825268 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:57:35.825245 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17283790_b945_4e3c_b8e1_96d7554f3d4d.slice/crio-32d254e7b1fe01cc4345f2b5c985752ef863c55a4ae2b4378d5ebee76b077f45 WatchSource:0}: Error finding container 32d254e7b1fe01cc4345f2b5c985752ef863c55a4ae2b4378d5ebee76b077f45: Status 404 returned error can't find the container with id 32d254e7b1fe01cc4345f2b5c985752ef863c55a4ae2b4378d5ebee76b077f45 Jul 31 14:57:35.827285 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:35.827267 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 14:57:36.406540 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:36.406497 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-v787p" event={"ID":"17283790-b945-4e3c-b8e1-96d7554f3d4d","Type":"ContainerStarted","Data":"32d254e7b1fe01cc4345f2b5c985752ef863c55a4ae2b4378d5ebee76b077f45"} Jul 31 14:57:39.420563 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:39.420519 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-v787p" event={"ID":"17283790-b945-4e3c-b8e1-96d7554f3d4d","Type":"ContainerStarted","Data":"c934410320d522265d75c7874f18da96e325016ad87ba8c9ae7428dd4bb73e85"} Jul 31 14:57:41.430162 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:41.430120 2560 generic.go:356] "Generic (PLEG): container finished" podID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerID="c934410320d522265d75c7874f18da96e325016ad87ba8c9ae7428dd4bb73e85" exitCode=0 Jul 31 14:57:41.430162 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:41.430166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-v787p" event={"ID":"17283790-b945-4e3c-b8e1-96d7554f3d4d","Type":"ContainerDied","Data":"c934410320d522265d75c7874f18da96e325016ad87ba8c9ae7428dd4bb73e85"} Jul 31 14:57:46.455744 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:46.455705 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-v787p" event={"ID":"17283790-b945-4e3c-b8e1-96d7554f3d4d","Type":"ContainerStarted","Data":"8689b1c48974de26b43167bb59f9c76973645490703db15e91a167cc121cab28"} Jul 31 14:57:46.491030 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:57:46.490967 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-v787p" podStartSLOduration=1.743092525 podStartE2EDuration="11.490951545s" totalImagesPullingTime="7.816533789s" totalInitContainerRuntime="1.931325231s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:57:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:57:46.489774403 +0000 UTC m=+622.335462948" watchObservedRunningTime="2026-07-31 14:57:46.490951545 +0000 UTC m=+622.336640092" Jul 31 14:58:51.710285 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:51.710250 2560 generic.go:356] "Generic (PLEG): container finished" podID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerID="8689b1c48974de26b43167bb59f9c76973645490703db15e91a167cc121cab28" exitCode=0 Jul 31 14:58:51.710685 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:51.710323 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-v787p" event={"ID":"17283790-b945-4e3c-b8e1-96d7554f3d4d","Type":"ContainerDied","Data":"8689b1c48974de26b43167bb59f9c76973645490703db15e91a167cc121cab28"} Jul 31 14:58:52.837769 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:52.837740 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-v787p" Jul 31 14:58:52.935913 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:52.935880 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17283790-b945-4e3c-b8e1-96d7554f3d4d-model-cache\") pod \"17283790-b945-4e3c-b8e1-96d7554f3d4d\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " Jul 31 14:58:52.936080 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:52.935994 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwk2f\" (UniqueName: \"kubernetes.io/projected/17283790-b945-4e3c-b8e1-96d7554f3d4d-kube-api-access-fwk2f\") pod \"17283790-b945-4e3c-b8e1-96d7554f3d4d\" (UID: \"17283790-b945-4e3c-b8e1-96d7554f3d4d\") " Jul 31 14:58:52.938170 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:52.938141 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17283790-b945-4e3c-b8e1-96d7554f3d4d-kube-api-access-fwk2f" (OuterVolumeSpecName: "kube-api-access-fwk2f") pod "17283790-b945-4e3c-b8e1-96d7554f3d4d" (UID: "17283790-b945-4e3c-b8e1-96d7554f3d4d"). InnerVolumeSpecName "kube-api-access-fwk2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 14:58:52.954521 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:52.954495 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17283790-b945-4e3c-b8e1-96d7554f3d4d-model-cache" (OuterVolumeSpecName: "model-cache") pod "17283790-b945-4e3c-b8e1-96d7554f3d4d" (UID: "17283790-b945-4e3c-b8e1-96d7554f3d4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 14:58:53.037322 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:53.037263 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwk2f\" (UniqueName: \"kubernetes.io/projected/17283790-b945-4e3c-b8e1-96d7554f3d4d-kube-api-access-fwk2f\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:58:53.037322 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:53.037284 2560 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17283790-b945-4e3c-b8e1-96d7554f3d4d-model-cache\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 14:58:53.719911 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:53.719863 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-v787p" event={"ID":"17283790-b945-4e3c-b8e1-96d7554f3d4d","Type":"ContainerDied","Data":"32d254e7b1fe01cc4345f2b5c985752ef863c55a4ae2b4378d5ebee76b077f45"} Jul 31 14:58:53.719911 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:53.719923 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32d254e7b1fe01cc4345f2b5c985752ef863c55a4ae2b4378d5ebee76b077f45" Jul 31 14:58:53.720138 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:58:53.719885 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-v787p" Jul 31 14:59:05.932706 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.932648 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh"] Jul 31 14:59:05.933155 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.933096 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerName="s3-init" Jul 31 14:59:05.933155 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.933121 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerName="s3-init" Jul 31 14:59:05.933155 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.933153 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerName="download-hf-model" Jul 31 14:59:05.933325 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.933162 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerName="download-hf-model" Jul 31 14:59:05.933325 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.933244 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="17283790-b945-4e3c-b8e1-96d7554f3d4d" containerName="s3-init" Jul 31 14:59:05.936643 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.936623 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:05.939092 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.939071 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 31 14:59:05.939734 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.939712 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hpn59\"" Jul 31 14:59:05.939837 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.939742 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 31 14:59:05.940077 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.940064 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 31 14:59:05.940305 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.940293 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 31 14:59:05.940339 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.940323 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 31 14:59:05.942514 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.942497 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 31 14:59:05.949507 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:05.949489 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh"] Jul 31 14:59:06.046719 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.046688 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/177705e1-c723-4ef0-ab4c-0587a4facb6a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.046890 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.046733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/177705e1-c723-4ef0-ab4c-0587a4facb6a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.046890 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.046752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckh4\" (UniqueName: \"kubernetes.io/projected/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-api-access-9ckh4\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.046890 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.046865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.047014 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.046921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.057908 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.057876 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6"] Jul 31 14:59:06.061329 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.061308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.064246 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.064226 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 31 14:59:06.064328 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.064233 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 31 14:59:06.076416 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.076392 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6"] Jul 31 14:59:06.148135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/177705e1-c723-4ef0-ab4c-0587a4facb6a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.148135 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148136 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckh4\" (UniqueName: \"kubernetes.io/projected/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-api-access-9ckh4\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.148330 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148217 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.148330 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148258 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.148330 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz762\" (UniqueName: \"kubernetes.io/projected/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-api-access-zz762\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.148330 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148305 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.148467 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.148501 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148475 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.148501 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.148585 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/177705e1-c723-4ef0-ab4c-0587a4facb6a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.148895 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.148873 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/177705e1-c723-4ef0-ab4c-0587a4facb6a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.149067 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.149045 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.149067 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.149057 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.150858 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.150822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/177705e1-c723-4ef0-ab4c-0587a4facb6a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.175116 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.175090 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckh4\" (UniqueName: \"kubernetes.io/projected/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-api-access-9ckh4\") pod \"isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.246505 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.246438 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:06.248897 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.248871 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.249015 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.248923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.249079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.249018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.249079 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.249043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz762\" (UniqueName: \"kubernetes.io/projected/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-api-access-zz762\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.249187 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.249083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.249936 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.249517 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.249936 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.249628 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.250133 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.249946 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.252107 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.252077 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.263821 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.263797 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz762\" (UniqueName: \"kubernetes.io/projected/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-api-access-zz762\") pod \"isvc-xgboost-graph-predictor-555fc69d56-zcbs6\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.371299 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.371264 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:06.393002 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:59:06.392959 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177705e1_c723_4ef0_ab4c_0587a4facb6a.slice/crio-c28f6a9fbe1742a1b3e27e63bf693299088ea970808f3fa1d0aee8633c896b9d WatchSource:0}: Error finding container c28f6a9fbe1742a1b3e27e63bf693299088ea970808f3fa1d0aee8633c896b9d: Status 404 returned error can't find the container with id c28f6a9fbe1742a1b3e27e63bf693299088ea970808f3fa1d0aee8633c896b9d Jul 31 14:59:06.393328 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.393307 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh"] Jul 31 14:59:06.453883 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.453856 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj"] Jul 31 14:59:06.459082 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.459062 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.462317 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.461798 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Jul 31 14:59:06.462317 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.462125 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Jul 31 14:59:06.474075 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.473977 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj"] Jul 31 14:59:06.521671 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.521644 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6"] Jul 31 14:59:06.523503 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:59:06.523469 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a84c80b_8b9d_456d_bc0b_d9e71bb86dca.slice/crio-cca247efddaa06e9430f94b40159d9f147703056bb35627d77ecad6a754251ba WatchSource:0}: Error finding container cca247efddaa06e9430f94b40159d9f147703056bb35627d77ecad6a754251ba: Status 404 returned error can't find the container with id cca247efddaa06e9430f94b40159d9f147703056bb35627d77ecad6a754251ba Jul 31 14:59:06.551729 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.551705 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.551852 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.551750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.551852 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.551819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.551968 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.551921 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.552001 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.551959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx9k4\" (UniqueName: \"kubernetes.io/projected/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-api-access-dx9k4\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.653358 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.653311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.653358 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.653355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.653799 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.653375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx9k4\" (UniqueName: \"kubernetes.io/projected/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-api-access-dx9k4\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.653799 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.653426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.653799 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.653475 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.654010 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.653913 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.654217 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.654191 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.654289 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.654193 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.655810 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.655789 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.665038 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.665003 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx9k4\" (UniqueName: \"kubernetes.io/projected/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-api-access-dx9k4\") pod \"isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.771223 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.771128 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerStarted","Data":"476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd"} Jul 31 14:59:06.771223 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.771205 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerStarted","Data":"c28f6a9fbe1742a1b3e27e63bf693299088ea970808f3fa1d0aee8633c896b9d"} Jul 31 14:59:06.772634 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.772612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:06.784853 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.781123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerStarted","Data":"ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c"} Jul 31 14:59:06.784853 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.781217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerStarted","Data":"cca247efddaa06e9430f94b40159d9f147703056bb35627d77ecad6a754251ba"} Jul 31 14:59:06.925634 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:06.925594 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj"] Jul 31 14:59:06.929169 ip-10-0-143-167 kubenswrapper[2560]: W0731 14:59:06.929140 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1f1ca3_d3a9_46f1_98e5_535a4a6e362c.slice/crio-9c5377b428f38f38076dbb51586d6d80a67abff96aecb51cc32ae54b54085f99 WatchSource:0}: Error finding container 9c5377b428f38f38076dbb51586d6d80a67abff96aecb51cc32ae54b54085f99: Status 404 returned error can't find the container with id 9c5377b428f38f38076dbb51586d6d80a67abff96aecb51cc32ae54b54085f99 Jul 31 14:59:07.778987 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:07.778951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerStarted","Data":"b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099"} Jul 31 14:59:07.779449 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:07.779016 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerStarted","Data":"9c5377b428f38f38076dbb51586d6d80a67abff96aecb51cc32ae54b54085f99"} Jul 31 14:59:10.791602 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:10.791571 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerID="b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099" exitCode=0 Jul 31 14:59:10.792038 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:10.791655 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerDied","Data":"b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099"} Jul 31 14:59:10.793327 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:10.793307 2560 generic.go:356] "Generic (PLEG): container finished" podID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerID="476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd" exitCode=0 Jul 31 14:59:10.793401 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:10.793378 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerDied","Data":"476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd"} Jul 31 14:59:10.795065 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:10.795041 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerID="ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c" exitCode=0 Jul 31 14:59:10.795148 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:10.795063 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerDied","Data":"ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c"} Jul 31 14:59:38.981893 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:38.981861 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerStarted","Data":"a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa"} Jul 31 14:59:38.983637 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:38.983612 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerStarted","Data":"89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3"} Jul 31 14:59:38.985276 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:38.985255 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerStarted","Data":"ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4"} Jul 31 14:59:42.007785 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.007738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerStarted","Data":"4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2"} Jul 31 14:59:42.008424 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.008403 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:42.008579 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.008558 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:42.009745 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.009713 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 14:59:42.010435 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.010406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerStarted","Data":"a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4"} Jul 31 14:59:42.010694 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.010675 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:42.010791 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.010745 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:42.011958 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.011882 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 14:59:42.013023 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.012998 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerStarted","Data":"1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82"} Jul 31 14:59:42.013211 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.013194 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:42.013306 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.013247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:42.014138 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.014117 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 14:59:42.038586 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.038548 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podStartSLOduration=1.679390653 podStartE2EDuration="36.038536151s" totalImagesPullingTime="30.632604503s" totalInitContainerRuntime="3.726540995s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:59:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:59:42.035024751 +0000 UTC m=+737.880713299" watchObservedRunningTime="2026-07-31 14:59:42.038536151 +0000 UTC m=+737.884224695" Jul 31 14:59:42.060786 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.060747 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podStartSLOduration=1.360657105 podStartE2EDuration="36.060735114s" totalImagesPullingTime="30.652236638s" totalInitContainerRuntime="4.047841371s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:59:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:59:42.059076528 +0000 UTC m=+737.904765072" watchObservedRunningTime="2026-07-31 14:59:42.060735114 +0000 UTC m=+737.906423659" Jul 31 14:59:42.083320 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:42.083278 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podStartSLOduration=2.97274028 podStartE2EDuration="37.083267949s" totalImagesPullingTime="30.429712135s" totalInitContainerRuntime="3.680815534s" isStatefulPod=false podCreationTimestamp="2026-07-31 14:59:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 14:59:42.082192752 +0000 UTC m=+737.927881296" watchObservedRunningTime="2026-07-31 14:59:42.083267949 +0000 UTC m=+737.928956493" Jul 31 14:59:43.017958 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:43.017920 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 14:59:43.018390 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:43.018059 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 14:59:43.018390 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:43.018076 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 14:59:44.022445 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:44.022409 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 14:59:48.024132 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:48.024086 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 14:59:48.024978 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:48.024946 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 14:59:48.025122 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:48.025083 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 14:59:48.025463 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:48.025424 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 14:59:49.026973 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:49.026948 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 14:59:49.027448 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:49.027422 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 14:59:58.025623 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:58.025579 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 14:59:58.026090 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:58.025582 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 14:59:59.027980 ip-10-0-143-167 kubenswrapper[2560]: I0731 14:59:59.027942 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:00:08.025687 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:08.025651 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 15:00:08.026222 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:08.025649 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 15:00:09.028011 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:09.027968 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:00:18.025085 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:18.025047 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 15:00:18.025546 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:18.025380 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 15:00:19.027805 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:19.027765 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:00:28.025988 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:28.025950 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 15:00:28.025988 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:28.025959 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 15:00:29.027617 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:29.027572 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:00:38.025680 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:38.025638 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 15:00:38.026155 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:38.025647 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 15:00:39.027389 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:39.027350 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:00:48.026200 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:48.026108 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 15:00:48.026912 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:48.026892 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 15:00:49.028226 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:49.028188 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:00:58.026040 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:58.026003 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 15:00:59.028021 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:00:59.027992 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 15:01:35.903154 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:35.903117 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj"] Jul 31 15:01:35.903677 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:35.903337 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" containerID="cri-o://ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4" gracePeriod=30 Jul 31 15:01:35.903677 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:35.903362 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kube-rbac-proxy" containerID="cri-o://4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2" gracePeriod=30 Jul 31 15:01:35.973923 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:35.973887 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh"] Jul 31 15:01:35.974218 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:35.974190 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" containerID="cri-o://a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa" gracePeriod=30 Jul 31 15:01:35.974333 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:35.974212 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kube-rbac-proxy" containerID="cri-o://a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4" gracePeriod=30 Jul 31 15:01:36.031524 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.031494 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6"] Jul 31 15:01:36.031751 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.031719 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" containerID="cri-o://89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3" gracePeriod=30 Jul 31 15:01:36.031923 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.031762 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kube-rbac-proxy" containerID="cri-o://1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82" gracePeriod=30 Jul 31 15:01:36.501463 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.501430 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerID="4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2" exitCode=2 Jul 31 15:01:36.501643 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.501503 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerDied","Data":"4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2"} Jul 31 15:01:36.503784 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.503757 2560 generic.go:356] "Generic (PLEG): container finished" podID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerID="a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4" exitCode=2 Jul 31 15:01:36.503954 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.503788 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerDied","Data":"a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4"} Jul 31 15:01:36.506210 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.506184 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerID="1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82" exitCode=2 Jul 31 15:01:36.506341 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:36.506216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerDied","Data":"1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82"} Jul 31 15:01:38.019156 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:38.019107 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused" Jul 31 15:01:38.019572 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:38.019111 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused" Jul 31 15:01:38.025297 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:38.025264 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused" Jul 31 15:01:38.025416 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:38.025394 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Jul 31 15:01:39.022748 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.022699 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused" Jul 31 15:01:39.027858 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.027809 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused" Jul 31 15:01:39.766782 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.766757 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 15:01:39.826746 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.826715 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-proxy-tls\") pod \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " Jul 31 15:01:39.826923 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.826787 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kserve-provision-location\") pod \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " Jul 31 15:01:39.826923 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.826883 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz762\" (UniqueName: \"kubernetes.io/projected/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-api-access-zz762\") pod \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " Jul 31 15:01:39.826923 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.826918 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-cabundle-cert\") pod \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " Jul 31 15:01:39.827104 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.826971 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-rbac-proxy-sar-config\") pod \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\" (UID: \"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca\") " Jul 31 15:01:39.827104 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.827035 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" (UID: "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 15:01:39.827318 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.827295 2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kserve-provision-location\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:39.827318 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.827291 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" (UID: "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:39.827501 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.827337 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" (UID: "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:39.828895 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.828870 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" (UID: "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:01:39.829009 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.828992 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-api-access-zz762" (OuterVolumeSpecName: "kube-api-access-zz762") pod "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" (UID: "9a84c80b-8b9d-456d-bc0b-d9e71bb86dca"). InnerVolumeSpecName "kube-api-access-zz762". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 15:01:39.928042 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.927975 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz762\" (UniqueName: \"kubernetes.io/projected/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-api-access-zz762\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:39.928042 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.927999 2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-cabundle-cert\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:39.928042 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.928009 2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:39.928042 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:39.928018 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca-proxy-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:40.524871 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.524818 2560 generic.go:356] "Generic (PLEG): container finished" podID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerID="89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3" exitCode=0 Jul 31 15:01:40.525343 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.524890 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" Jul 31 15:01:40.525343 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.524909 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerDied","Data":"89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3"} Jul 31 15:01:40.525343 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.524990 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6" event={"ID":"9a84c80b-8b9d-456d-bc0b-d9e71bb86dca","Type":"ContainerDied","Data":"cca247efddaa06e9430f94b40159d9f147703056bb35627d77ecad6a754251ba"} Jul 31 15:01:40.525343 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.525037 2560 scope.go:117] "RemoveContainer" containerID="1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82" Jul 31 15:01:40.533582 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.533567 2560 scope.go:117] "RemoveContainer" containerID="89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3" Jul 31 15:01:40.540632 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.540613 2560 scope.go:117] "RemoveContainer" containerID="ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c" Jul 31 15:01:40.548103 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548087 2560 scope.go:117] "RemoveContainer" containerID="1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82" Jul 31 15:01:40.548345 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:40.548329 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82\": container with ID starting with 1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82 not found: ID does not exist" containerID="1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82" Jul 31 15:01:40.548394 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548352 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82"} err="failed to get container status \"1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82\": rpc error: code = NotFound desc = could not find container \"1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82\": container with ID starting with 1089d2567651c356bbe630222158e8ec2d94bd4539e859cfc7b9f56605fabf82 not found: ID does not exist" Jul 31 15:01:40.548394 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548368 2560 scope.go:117] "RemoveContainer" containerID="89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3" Jul 31 15:01:40.548594 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:40.548576 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3\": container with ID starting with 89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3 not found: ID does not exist" containerID="89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3" Jul 31 15:01:40.548659 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548604 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3"} err="failed to get container status \"89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3\": rpc error: code = NotFound desc = could not find container \"89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3\": container with ID starting with 89bec03f19c1e1c644e3ae19ff0c27698e8882bb212dbf029b229f792d8624d3 not found: ID does not exist" Jul 31 15:01:40.548659 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548626 2560 scope.go:117] "RemoveContainer" containerID="ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c" Jul 31 15:01:40.548659 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548626 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6"] Jul 31 15:01:40.548899 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:40.548865 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c\": container with ID starting with ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c not found: ID does not exist" containerID="ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c" Jul 31 15:01:40.548948 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.548903 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c"} err="failed to get container status \"ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c\": rpc error: code = NotFound desc = could not find container \"ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c\": container with ID starting with ac733e355cf0274caf64f921d86d5b69cd478b039f179f2610f80264376b8f2c not found: ID does not exist" Jul 31 15:01:40.551968 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.551949 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-zcbs6"] Jul 31 15:01:40.778981 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.778885 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" path="/var/lib/kubelet/pods/9a84c80b-8b9d-456d-bc0b-d9e71bb86dca/volumes" Jul 31 15:01:40.831755 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.831733 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 15:01:40.833592 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.833576 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ckh4\" (UniqueName: \"kubernetes.io/projected/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-api-access-9ckh4\") pod \"177705e1-c723-4ef0-ab4c-0587a4facb6a\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " Jul 31 15:01:40.833652 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.833610 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/177705e1-c723-4ef0-ab4c-0587a4facb6a-kserve-provision-location\") pod \"177705e1-c723-4ef0-ab4c-0587a4facb6a\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " Jul 31 15:01:40.833652 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.833629 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-rbac-proxy-sar-config\") pod \"177705e1-c723-4ef0-ab4c-0587a4facb6a\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " Jul 31 15:01:40.833765 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.833656 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/177705e1-c723-4ef0-ab4c-0587a4facb6a-proxy-tls\") pod \"177705e1-c723-4ef0-ab4c-0587a4facb6a\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " Jul 31 15:01:40.833765 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.833694 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-cabundle-cert\") pod \"177705e1-c723-4ef0-ab4c-0587a4facb6a\" (UID: \"177705e1-c723-4ef0-ab4c-0587a4facb6a\") " Jul 31 15:01:40.834039 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.833948 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/177705e1-c723-4ef0-ab4c-0587a4facb6a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "177705e1-c723-4ef0-ab4c-0587a4facb6a" (UID: "177705e1-c723-4ef0-ab4c-0587a4facb6a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 15:01:40.834149 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.834065 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "177705e1-c723-4ef0-ab4c-0587a4facb6a" (UID: "177705e1-c723-4ef0-ab4c-0587a4facb6a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:40.834149 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.834078 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "177705e1-c723-4ef0-ab4c-0587a4facb6a" (UID: "177705e1-c723-4ef0-ab4c-0587a4facb6a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:40.836136 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.836111 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-api-access-9ckh4" (OuterVolumeSpecName: "kube-api-access-9ckh4") pod "177705e1-c723-4ef0-ab4c-0587a4facb6a" (UID: "177705e1-c723-4ef0-ab4c-0587a4facb6a"). InnerVolumeSpecName "kube-api-access-9ckh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 15:01:40.836216 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.836169 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/177705e1-c723-4ef0-ab4c-0587a4facb6a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "177705e1-c723-4ef0-ab4c-0587a4facb6a" (UID: "177705e1-c723-4ef0-ab4c-0587a4facb6a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:01:40.853401 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.853381 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 15:01:40.934540 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934511 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-cabundle-cert\") pod \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " Jul 31 15:01:40.934689 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934570 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-proxy-tls\") pod \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " Jul 31 15:01:40.934689 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934597 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-rbac-proxy-sar-config\") pod \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " Jul 31 15:01:40.934689 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934627 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx9k4\" (UniqueName: \"kubernetes.io/projected/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-api-access-dx9k4\") pod \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " Jul 31 15:01:40.934689 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934657 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kserve-provision-location\") pod \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\" (UID: \"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c\") " Jul 31 15:01:40.934947 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934931 2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-cabundle-cert\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:40.935007 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934955 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ckh4\" (UniqueName: \"kubernetes.io/projected/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-api-access-9ckh4\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:40.935007 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934972 2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/177705e1-c723-4ef0-ab4c-0587a4facb6a-kserve-provision-location\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:40.935007 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.934989 2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/177705e1-c723-4ef0-ab4c-0587a4facb6a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:40.935007 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.935004 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/177705e1-c723-4ef0-ab4c-0587a4facb6a-proxy-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:40.935136 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.935002 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" (UID: "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 15:01:40.935136 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.935018 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" (UID: "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:40.935136 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.935002 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" (UID: "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 15:01:40.936671 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.936649 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-api-access-dx9k4" (OuterVolumeSpecName: "kube-api-access-dx9k4") pod "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" (UID: "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c"). InnerVolumeSpecName "kube-api-access-dx9k4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 15:01:40.936710 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:40.936656 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" (UID: "9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 15:01:41.035771 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.035711 2560 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-cabundle-cert\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:41.035771 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.035734 2560 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-proxy-tls\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:41.035771 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.035742 2560 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:41.035771 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.035751 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx9k4\" (UniqueName: \"kubernetes.io/projected/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kube-api-access-dx9k4\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:41.035771 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.035759 2560 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c-kserve-provision-location\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:01:41.530437 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.530401 2560 generic.go:356] "Generic (PLEG): container finished" podID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerID="a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa" exitCode=0 Jul 31 15:01:41.530912 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.530453 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" Jul 31 15:01:41.530912 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.530483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerDied","Data":"a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa"} Jul 31 15:01:41.530912 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.530548 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh" event={"ID":"177705e1-c723-4ef0-ab4c-0587a4facb6a","Type":"ContainerDied","Data":"c28f6a9fbe1742a1b3e27e63bf693299088ea970808f3fa1d0aee8633c896b9d"} Jul 31 15:01:41.530912 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.530585 2560 scope.go:117] "RemoveContainer" containerID="a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4" Jul 31 15:01:41.533587 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.533553 2560 generic.go:356] "Generic (PLEG): container finished" podID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerID="ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4" exitCode=0 Jul 31 15:01:41.533721 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.533600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerDied","Data":"ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4"} Jul 31 15:01:41.533721 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.533623 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" Jul 31 15:01:41.533721 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.533652 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj" event={"ID":"9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c","Type":"ContainerDied","Data":"9c5377b428f38f38076dbb51586d6d80a67abff96aecb51cc32ae54b54085f99"} Jul 31 15:01:41.539443 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.539421 2560 scope.go:117] "RemoveContainer" containerID="a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa" Jul 31 15:01:41.547269 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.547250 2560 scope.go:117] "RemoveContainer" containerID="476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd" Jul 31 15:01:41.552798 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.552780 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh"] Jul 31 15:01:41.554499 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.554485 2560 scope.go:117] "RemoveContainer" containerID="a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4" Jul 31 15:01:41.554758 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:41.554741 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4\": container with ID starting with a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4 not found: ID does not exist" containerID="a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4" Jul 31 15:01:41.554802 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.554766 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4"} err="failed to get container status \"a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4\": rpc error: code = NotFound desc = could not find container \"a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4\": container with ID starting with a46bc9212bc58e4780a98d6c6733233225243ba9affe5d17a4fea4aee21e32b4 not found: ID does not exist" Jul 31 15:01:41.554802 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.554781 2560 scope.go:117] "RemoveContainer" containerID="a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa" Jul 31 15:01:41.555020 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:41.555003 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa\": container with ID starting with a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa not found: ID does not exist" containerID="a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa" Jul 31 15:01:41.555064 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.555026 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa"} err="failed to get container status \"a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa\": rpc error: code = NotFound desc = could not find container \"a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa\": container with ID starting with a101d6ada540595958541745791b31e4337b098890120bab98d8d5a6f8ee37aa not found: ID does not exist" Jul 31 15:01:41.555064 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.555041 2560 scope.go:117] "RemoveContainer" containerID="476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd" Jul 31 15:01:41.555231 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:41.555218 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd\": container with ID starting with 476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd not found: ID does not exist" containerID="476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd" Jul 31 15:01:41.555268 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.555234 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd"} err="failed to get container status \"476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd\": rpc error: code = NotFound desc = could not find container \"476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd\": container with ID starting with 476a1a59cfc8729acaed115baf57cf1d34690bb347f9694a5a2f44f50388b4fd not found: ID does not exist" Jul 31 15:01:41.555268 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.555247 2560 scope.go:117] "RemoveContainer" containerID="4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2" Jul 31 15:01:41.558456 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.558438 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7dc5b78b48-hpbgh"] Jul 31 15:01:41.562500 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.562485 2560 scope.go:117] "RemoveContainer" containerID="ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4" Jul 31 15:01:41.570869 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.570799 2560 scope.go:117] "RemoveContainer" containerID="b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099" Jul 31 15:01:41.570944 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.570875 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj"] Jul 31 15:01:41.572490 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.572471 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54ff6676d8-8vwrj"] Jul 31 15:01:41.577711 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.577680 2560 scope.go:117] "RemoveContainer" containerID="4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2" Jul 31 15:01:41.577978 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:41.577958 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2\": container with ID starting with 4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2 not found: ID does not exist" containerID="4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2" Jul 31 15:01:41.578064 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.577988 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2"} err="failed to get container status \"4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2\": rpc error: code = NotFound desc = could not find container \"4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2\": container with ID starting with 4bc92080d1670b92eec481d12d204fa35cac8b778d81c72370bb39cf8c8952a2 not found: ID does not exist" Jul 31 15:01:41.578064 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.578010 2560 scope.go:117] "RemoveContainer" containerID="ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4" Jul 31 15:01:41.578274 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:41.578257 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4\": container with ID starting with ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4 not found: ID does not exist" containerID="ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4" Jul 31 15:01:41.578316 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.578280 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4"} err="failed to get container status \"ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4\": rpc error: code = NotFound desc = could not find container \"ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4\": container with ID starting with ecf749670abcbcbbd2fc525485eea5da09aaefda9ff7bd7032fd7b3ebf7199d4 not found: ID does not exist" Jul 31 15:01:41.578316 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.578295 2560 scope.go:117] "RemoveContainer" containerID="b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099" Jul 31 15:01:41.578546 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:01:41.578527 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099\": container with ID starting with b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099 not found: ID does not exist" containerID="b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099" Jul 31 15:01:41.578622 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:41.578549 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099"} err="failed to get container status \"b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099\": rpc error: code = NotFound desc = could not find container \"b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099\": container with ID starting with b82e9b5c1ddb66a62c5ac6c940bc53ecb9ccba9f826729d392e1e25c23b1c099 not found: ID does not exist" Jul 31 15:01:42.777335 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:42.777302 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" path="/var/lib/kubelet/pods/177705e1-c723-4ef0-ab4c-0587a4facb6a/volumes" Jul 31 15:01:42.777804 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:01:42.777790 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" path="/var/lib/kubelet/pods/9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c/volumes" Jul 31 15:02:24.620241 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:02:24.620156 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:02:24.624154 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:02:24.624135 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:07:24.647013 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:07:24.646984 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:07:24.647642 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:07:24.647624 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:12:24.671891 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:12:24.671858 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:12:24.673047 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:12:24.673023 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:17:24.696886 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:17:24.696856 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:17:24.698734 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:17:24.698713 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:22:24.722249 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:22:24.722221 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:22:24.724685 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:22:24.724656 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:27:24.747685 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:27:24.747656 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:27:24.750223 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:27:24.750059 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:32:24.771948 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:32:24.771819 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:32:24.776733 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:32:24.776709 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:37:24.801081 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:37:24.801052 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:37:24.810325 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:37:24.810305 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:38:51.339960 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.339883 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9rlwp/must-gather-49l5g"] Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340222 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340235 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340245 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="storage-initializer" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340251 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="storage-initializer" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340264 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="storage-initializer" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340269 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="storage-initializer" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340275 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="storage-initializer" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340282 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="storage-initializer" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340288 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340294 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340300 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340305 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340312 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340317 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340323 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340328 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340339 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340344 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340390 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340398 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340404 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340410 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a84c80b-8b9d-456d-bc0b-d9e71bb86dca" containerName="kube-rbac-proxy" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340418 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="177705e1-c723-4ef0-ab4c-0587a4facb6a" containerName="kserve-container" Jul 31 15:38:51.340619 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.340423 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d1f1ca3-d3a9-46f1-98e5-535a4a6e362c" containerName="kserve-container" Jul 31 15:38:51.343447 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.343428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.346207 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.346184 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9rlwp\"/\"kube-root-ca.crt\"" Jul 31 15:38:51.346400 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.346387 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9rlwp\"/\"openshift-service-ca.crt\"" Jul 31 15:38:51.347052 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.347034 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9rlwp\"/\"default-dockercfg-nlpbn\"" Jul 31 15:38:51.352004 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.351979 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9rlwp/must-gather-49l5g"] Jul 31 15:38:51.426551 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.426511 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcf09855-aae9-4a36-b020-810265a0d24d-must-gather-output\") pod \"must-gather-49l5g\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.426755 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.426573 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6bnl\" (UniqueName: \"kubernetes.io/projected/dcf09855-aae9-4a36-b020-810265a0d24d-kube-api-access-w6bnl\") pod \"must-gather-49l5g\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.527869 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.527807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcf09855-aae9-4a36-b020-810265a0d24d-must-gather-output\") pod \"must-gather-49l5g\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.528056 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.527884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bnl\" (UniqueName: \"kubernetes.io/projected/dcf09855-aae9-4a36-b020-810265a0d24d-kube-api-access-w6bnl\") pod \"must-gather-49l5g\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.528137 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.528115 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcf09855-aae9-4a36-b020-810265a0d24d-must-gather-output\") pod \"must-gather-49l5g\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.536498 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.536470 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6bnl\" (UniqueName: \"kubernetes.io/projected/dcf09855-aae9-4a36-b020-810265a0d24d-kube-api-access-w6bnl\") pod \"must-gather-49l5g\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.666553 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.666473 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:38:51.798036 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.798011 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9rlwp/must-gather-49l5g"] Jul 31 15:38:51.800921 ip-10-0-143-167 kubenswrapper[2560]: W0731 15:38:51.800892 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcf09855_aae9_4a36_b020_810265a0d24d.slice/crio-7ab3bf0708a8bc23533e6c43962b0a2bd863d1a0e7582925c88626867065230f WatchSource:0}: Error finding container 7ab3bf0708a8bc23533e6c43962b0a2bd863d1a0e7582925c88626867065230f: Status 404 returned error can't find the container with id 7ab3bf0708a8bc23533e6c43962b0a2bd863d1a0e7582925c88626867065230f Jul 31 15:38:51.803119 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:51.803102 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 15:38:52.215889 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:52.215848 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rlwp/must-gather-49l5g" event={"ID":"dcf09855-aae9-4a36-b020-810265a0d24d","Type":"ContainerStarted","Data":"7ab3bf0708a8bc23533e6c43962b0a2bd863d1a0e7582925c88626867065230f"} Jul 31 15:38:59.255243 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:59.255200 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rlwp/must-gather-49l5g" event={"ID":"dcf09855-aae9-4a36-b020-810265a0d24d","Type":"ContainerStarted","Data":"08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc"} Jul 31 15:38:59.255687 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:59.255258 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rlwp/must-gather-49l5g" event={"ID":"dcf09855-aae9-4a36-b020-810265a0d24d","Type":"ContainerStarted","Data":"f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f"} Jul 31 15:38:59.275938 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:38:59.275886 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9rlwp/must-gather-49l5g" podStartSLOduration=1.934407818 podStartE2EDuration="8.275871936s" totalImagesPullingTime="6.341464118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:38:59.274388086 +0000 UTC m=+3095.120076630" watchObservedRunningTime="2026-07-31 15:38:59.275871936 +0000 UTC m=+3095.121560481" Jul 31 15:39:21.348123 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:21.348040 2560 generic.go:356] "Generic (PLEG): container finished" podID="dcf09855-aae9-4a36-b020-810265a0d24d" containerID="f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f" exitCode=0 Jul 31 15:39:21.348123 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:21.348079 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9rlwp/must-gather-49l5g" event={"ID":"dcf09855-aae9-4a36-b020-810265a0d24d","Type":"ContainerDied","Data":"f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f"} Jul 31 15:39:21.348541 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:21.348361 2560 scope.go:117] "RemoveContainer" containerID="f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f" Jul 31 15:39:22.112441 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.112412 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9rlwp_must-gather-49l5g_dcf09855-aae9-4a36-b020-810265a0d24d/gather/0.log" Jul 31 15:39:22.784689 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.784656 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cd56f/must-gather-5rbsm"] Jul 31 15:39:22.788001 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.787983 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:22.790797 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.790775 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cd56f\"/\"default-dockercfg-mzp76\"" Jul 31 15:39:22.790934 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.790851 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cd56f\"/\"openshift-service-ca.crt\"" Jul 31 15:39:22.791273 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.791258 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cd56f\"/\"kube-root-ca.crt\"" Jul 31 15:39:22.804078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.804056 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cd56f/must-gather-5rbsm"] Jul 31 15:39:22.900909 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.900880 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43cfa437-a60e-4f37-a56f-08d08c1cb8b1-must-gather-output\") pod \"must-gather-5rbsm\" (UID: \"43cfa437-a60e-4f37-a56f-08d08c1cb8b1\") " pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:22.901056 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:22.900927 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2t68\" (UniqueName: \"kubernetes.io/projected/43cfa437-a60e-4f37-a56f-08d08c1cb8b1-kube-api-access-k2t68\") pod \"must-gather-5rbsm\" (UID: \"43cfa437-a60e-4f37-a56f-08d08c1cb8b1\") " pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:23.001871 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.001821 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2t68\" (UniqueName: \"kubernetes.io/projected/43cfa437-a60e-4f37-a56f-08d08c1cb8b1-kube-api-access-k2t68\") pod \"must-gather-5rbsm\" (UID: \"43cfa437-a60e-4f37-a56f-08d08c1cb8b1\") " pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:23.002027 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.001918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43cfa437-a60e-4f37-a56f-08d08c1cb8b1-must-gather-output\") pod \"must-gather-5rbsm\" (UID: \"43cfa437-a60e-4f37-a56f-08d08c1cb8b1\") " pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:23.002202 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.002187 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43cfa437-a60e-4f37-a56f-08d08c1cb8b1-must-gather-output\") pod \"must-gather-5rbsm\" (UID: \"43cfa437-a60e-4f37-a56f-08d08c1cb8b1\") " pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:23.014034 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.014000 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2t68\" (UniqueName: \"kubernetes.io/projected/43cfa437-a60e-4f37-a56f-08d08c1cb8b1-kube-api-access-k2t68\") pod \"must-gather-5rbsm\" (UID: \"43cfa437-a60e-4f37-a56f-08d08c1cb8b1\") " pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:23.097036 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.097001 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cd56f/must-gather-5rbsm" Jul 31 15:39:23.225456 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.225432 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cd56f/must-gather-5rbsm"] Jul 31 15:39:23.228061 ip-10-0-143-167 kubenswrapper[2560]: W0731 15:39:23.228033 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43cfa437_a60e_4f37_a56f_08d08c1cb8b1.slice/crio-dd0b08f6247b65f4a6553ed7014eff8ae0a111d46f1f36ca442de598a9d0840b WatchSource:0}: Error finding container dd0b08f6247b65f4a6553ed7014eff8ae0a111d46f1f36ca442de598a9d0840b: Status 404 returned error can't find the container with id dd0b08f6247b65f4a6553ed7014eff8ae0a111d46f1f36ca442de598a9d0840b Jul 31 15:39:23.356129 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:23.356037 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/must-gather-5rbsm" event={"ID":"43cfa437-a60e-4f37-a56f-08d08c1cb8b1","Type":"ContainerStarted","Data":"dd0b08f6247b65f4a6553ed7014eff8ae0a111d46f1f36ca442de598a9d0840b"} Jul 31 15:39:24.362243 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:24.362209 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/must-gather-5rbsm" event={"ID":"43cfa437-a60e-4f37-a56f-08d08c1cb8b1","Type":"ContainerStarted","Data":"e9bf3f9befcbdb39cd23416ca0353f6f989bdea7097f8c470aca98299fc14909"} Jul 31 15:39:25.369474 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:25.369430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/must-gather-5rbsm" event={"ID":"43cfa437-a60e-4f37-a56f-08d08c1cb8b1","Type":"ContainerStarted","Data":"fd36a2ffe1fa0a1fbe5a0cd9d56115a2beded95d784d4fb78c522ed3773d4c41"} Jul 31 15:39:25.393557 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:25.393498 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cd56f/must-gather-5rbsm" podStartSLOduration=2.434231895 podStartE2EDuration="3.393477195s" totalImagesPullingTime="959.2453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 15:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:39:25.393357421 +0000 UTC m=+3121.239045967" watchObservedRunningTime="2026-07-31 15:39:25.393477195 +0000 UTC m=+3121.239165742" Jul 31 15:39:25.714470 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:25.714397 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s9kc6_2af4e5ca-f70c-4f2e-a052-4603774c13ea/global-pull-secret-syncer/0.log" Jul 31 15:39:25.818935 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:25.818895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jlpsd_6f15a6fc-e2e1-4e8b-8205-bda7dbd36094/konnectivity-agent/0.log" Jul 31 15:39:25.973998 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:25.973894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-167.ec2.internal_1d7885553df81411020fc4e03d6f8d97/haproxy/0.log" Jul 31 15:39:27.597480 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:27.597441 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-9rlwp/must-gather-49l5g"] Jul 31 15:39:27.598063 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:27.597664 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-9rlwp/must-gather-49l5g" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="copy" containerID="cri-o://08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc" gracePeriod=2 Jul 31 15:39:27.605219 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:27.605185 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-9rlwp/must-gather-49l5g"] Jul 31 15:39:27.966846 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:27.963040 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9rlwp_must-gather-49l5g_dcf09855-aae9-4a36-b020-810265a0d24d/copy/0.log" Jul 31 15:39:27.968854 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:27.967417 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:39:27.975848 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:39:27.973208 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-49l5g\" is forbidden: User \"system:node:ip-10-0-143-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9rlwp\": no relationship found between node 'ip-10-0-143-167.ec2.internal' and this object" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:39:28.058291 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.058254 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6bnl\" (UniqueName: \"kubernetes.io/projected/dcf09855-aae9-4a36-b020-810265a0d24d-kube-api-access-w6bnl\") pod \"dcf09855-aae9-4a36-b020-810265a0d24d\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " Jul 31 15:39:28.058470 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.058350 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcf09855-aae9-4a36-b020-810265a0d24d-must-gather-output\") pod \"dcf09855-aae9-4a36-b020-810265a0d24d\" (UID: \"dcf09855-aae9-4a36-b020-810265a0d24d\") " Jul 31 15:39:28.062847 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.060016 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcf09855-aae9-4a36-b020-810265a0d24d-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "dcf09855-aae9-4a36-b020-810265a0d24d" (UID: "dcf09855-aae9-4a36-b020-810265a0d24d"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 15:39:28.066844 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.066482 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf09855-aae9-4a36-b020-810265a0d24d-kube-api-access-w6bnl" (OuterVolumeSpecName: "kube-api-access-w6bnl") pod "dcf09855-aae9-4a36-b020-810265a0d24d" (UID: "dcf09855-aae9-4a36-b020-810265a0d24d"). InnerVolumeSpecName "kube-api-access-w6bnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 15:39:28.159964 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.159923 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6bnl\" (UniqueName: \"kubernetes.io/projected/dcf09855-aae9-4a36-b020-810265a0d24d-kube-api-access-w6bnl\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:39:28.159964 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.159964 2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcf09855-aae9-4a36-b020-810265a0d24d-must-gather-output\") on node \"ip-10-0-143-167.ec2.internal\" DevicePath \"\"" Jul 31 15:39:28.388387 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.388337 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9rlwp_must-gather-49l5g_dcf09855-aae9-4a36-b020-810265a0d24d/copy/0.log" Jul 31 15:39:28.388847 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.388751 2560 generic.go:356] "Generic (PLEG): container finished" podID="dcf09855-aae9-4a36-b020-810265a0d24d" containerID="08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc" exitCode=143 Jul 31 15:39:28.390853 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.388821 2560 scope.go:117] "RemoveContainer" containerID="08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc" Jul 31 15:39:28.390853 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.389169 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:39:28.395282 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:39:28.395044 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-49l5g\" is forbidden: User \"system:node:ip-10-0-143-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9rlwp\": no relationship found between node 'ip-10-0-143-167.ec2.internal' and this object" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:39:28.409461 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:39:28.409407 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-49l5g\" is forbidden: User \"system:node:ip-10-0-143-167.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9rlwp\": no relationship found between node 'ip-10-0-143-167.ec2.internal' and this object" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" pod="openshift-must-gather-9rlwp/must-gather-49l5g" Jul 31 15:39:28.412080 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.412060 2560 scope.go:117] "RemoveContainer" containerID="f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f" Jul 31 15:39:28.440256 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.440212 2560 scope.go:117] "RemoveContainer" containerID="08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc" Jul 31 15:39:28.441005 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:39:28.440978 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc\": container with ID starting with 08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc not found: ID does not exist" containerID="08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc" Jul 31 15:39:28.441183 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.441141 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc"} err="failed to get container status \"08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc\": rpc error: code = NotFound desc = could not find container \"08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc\": container with ID starting with 08b163189c6683e8502fd44570aef71f05c7262ce7532d382e68a6f4250e60fc not found: ID does not exist" Jul 31 15:39:28.441301 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.441288 2560 scope.go:117] "RemoveContainer" containerID="f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f" Jul 31 15:39:28.441742 ip-10-0-143-167 kubenswrapper[2560]: E0731 15:39:28.441718 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f\": container with ID starting with f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f not found: ID does not exist" containerID="f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f" Jul 31 15:39:28.441921 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.441881 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f"} err="failed to get container status \"f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f\": rpc error: code = NotFound desc = could not find container \"f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f\": container with ID starting with f0591626486dbc19f35e79887c77abda3e00423435a4421e54bcd52be6b2362f not found: ID does not exist" Jul 31 15:39:28.780418 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:28.780333 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" path="/var/lib/kubelet/pods/dcf09855-aae9-4a36-b020-810265a0d24d/volumes" Jul 31 15:39:30.489494 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:30.489448 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-6p9ks_716e7166-1d2c-4b23-97b0-9cb65e38f7db/cluster-monitoring-operator/0.log" Jul 31 15:39:30.640799 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:30.640762 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-48bv4_2c80cb60-16ab-451c-87a0-713dfc14b1c9/monitoring-plugin/0.log" Jul 31 15:39:30.872676 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:30.872642 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpl5n_6592dc69-e826-4270-8f9e-8bd149bd99db/node-exporter/0.log" Jul 31 15:39:30.896190 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:30.896164 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpl5n_6592dc69-e826-4270-8f9e-8bd149bd99db/kube-rbac-proxy/0.log" Jul 31 15:39:30.922691 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:30.922666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vpl5n_6592dc69-e826-4270-8f9e-8bd149bd99db/init-textfile/0.log" Jul 31 15:39:31.054732 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.054698 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/prometheus/0.log" Jul 31 15:39:31.082719 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.082691 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/config-reloader/0.log" Jul 31 15:39:31.108889 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.108857 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/thanos-sidecar/0.log" Jul 31 15:39:31.137466 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.137396 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/kube-rbac-proxy-web/0.log" Jul 31 15:39:31.161915 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.161886 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/kube-rbac-proxy/0.log" Jul 31 15:39:31.190378 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.190348 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/kube-rbac-proxy-thanos/0.log" Jul 31 15:39:31.220081 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.220051 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_02ea7647-7689-4faa-9151-490993462d11/init-config-reloader/0.log" Jul 31 15:39:31.529075 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.528993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-669cbb5cb8-zfdgd_436dc9ae-a658-4eb6-9d98-c64c7a548088/thanos-query/0.log" Jul 31 15:39:31.592345 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.592317 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-669cbb5cb8-zfdgd_436dc9ae-a658-4eb6-9d98-c64c7a548088/kube-rbac-proxy-web/0.log" Jul 31 15:39:31.636601 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.636567 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-669cbb5cb8-zfdgd_436dc9ae-a658-4eb6-9d98-c64c7a548088/kube-rbac-proxy/0.log" Jul 31 15:39:31.678744 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.678714 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-669cbb5cb8-zfdgd_436dc9ae-a658-4eb6-9d98-c64c7a548088/prom-label-proxy/0.log" Jul 31 15:39:31.717147 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.717096 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-669cbb5cb8-zfdgd_436dc9ae-a658-4eb6-9d98-c64c7a548088/kube-rbac-proxy-rules/0.log" Jul 31 15:39:31.747266 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:31.747226 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-669cbb5cb8-zfdgd_436dc9ae-a658-4eb6-9d98-c64c7a548088/kube-rbac-proxy-metrics/0.log" Jul 31 15:39:32.944807 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:32.944765 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-p4nb4_fe953075-526b-4133-81b9-a0d9a28fb43c/networking-console-plugin/0.log" Jul 31 15:39:33.418795 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.418762 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/2.log" Jul 31 15:39:33.424227 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.424203 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hpgvd_20e9d578-befb-479e-a4fb-8446a9bf99b5/console-operator/3.log" Jul 31 15:39:33.729024 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.728941 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd"] Jul 31 15:39:33.729451 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.729428 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="copy" Jul 31 15:39:33.729551 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.729454 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="copy" Jul 31 15:39:33.729551 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.729470 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="gather" Jul 31 15:39:33.729551 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.729481 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="gather" Jul 31 15:39:33.729714 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.729586 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="gather" Jul 31 15:39:33.729714 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.729604 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf09855-aae9-4a36-b020-810265a0d24d" containerName="copy" Jul 31 15:39:33.732380 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.732357 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.747495 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.747465 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd"] Jul 31 15:39:33.816683 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.816641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-sys\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.816904 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.816704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q97v\" (UniqueName: \"kubernetes.io/projected/46c05c74-68e7-42cd-925b-945acf3acdf2-kube-api-access-6q97v\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.816904 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.816739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-podres\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.816904 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.816778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-lib-modules\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.816904 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.816809 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-proc\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.917883 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.917850 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-lib-modules\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.917883 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.917889 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-proc\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.917952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-sys\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.917980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q97v\" (UniqueName: \"kubernetes.io/projected/46c05c74-68e7-42cd-925b-945acf3acdf2-kube-api-access-6q97v\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.918010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-podres\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.918036 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-sys\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.918035 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-lib-modules\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918078 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.918039 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-proc\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.918404 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.918126 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46c05c74-68e7-42cd-925b-945acf3acdf2-podres\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:33.928130 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:33.928102 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q97v\" (UniqueName: \"kubernetes.io/projected/46c05c74-68e7-42cd-925b-945acf3acdf2-kube-api-access-6q97v\") pod \"perf-node-gather-daemonset-h97jd\" (UID: \"46c05c74-68e7-42cd-925b-945acf3acdf2\") " pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:34.045661 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.045587 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:34.195250 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.195224 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd"] Jul 31 15:39:34.423437 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.423405 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" event={"ID":"46c05c74-68e7-42cd-925b-945acf3acdf2","Type":"ContainerStarted","Data":"05a4b55def143caff40de98326a552a457f8028aa5741972ccae21d32bb4fe2e"} Jul 31 15:39:34.423623 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.423464 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" event={"ID":"46c05c74-68e7-42cd-925b-945acf3acdf2","Type":"ContainerStarted","Data":"ab55ec1fa2b1c1097bf691897be5b10b9ccb44fe94224a01ff66f1b056e3bf3b"} Jul 31 15:39:34.423696 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.423638 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:34.443796 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.443737 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" podStartSLOduration=1.443719359 podStartE2EDuration="1.443719359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 15:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 15:39:34.442003339 +0000 UTC m=+3130.287691885" watchObservedRunningTime="2026-07-31 15:39:34.443719359 +0000 UTC m=+3130.289407908" Jul 31 15:39:34.511200 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:34.511174 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-zvpjh_1112877a-8af3-47c3-9731-8c6df30d0281/volume-data-source-validator/0.log" Jul 31 15:39:35.432050 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:35.432021 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6ctks_b54f5fcf-bea1-4521-af00-e4388825ddf1/dns/0.log" Jul 31 15:39:35.461217 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:35.461174 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6ctks_b54f5fcf-bea1-4521-af00-e4388825ddf1/kube-rbac-proxy/0.log" Jul 31 15:39:35.769285 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:35.769215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n6mxj_d937e575-c105-4322-ab37-a7130a158f6e/dns-node-resolver/0.log" Jul 31 15:39:36.321802 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:36.321773 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rmk2d_b02538e3-a004-4422-9360-9b27ad6d8adc/node-ca/0.log" Jul 31 15:39:37.203629 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:37.203592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7758b75b96-jp5tv_152bf7b5-8e6e-4f17-9b60-d23c24287110/router/0.log" Jul 31 15:39:37.610648 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:37.610620 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nxqts_adc07795-e3d1-4c0f-9ff4-64298b2e8386/serve-healthcheck-canary/0.log" Jul 31 15:39:37.990381 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:37.990304 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-8zj96_76459ad2-12db-4330-9042-be87b3365cba/insights-operator/0.log" Jul 31 15:39:37.991068 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:37.991050 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-8zj96_76459ad2-12db-4330-9042-be87b3365cba/insights-operator/1.log" Jul 31 15:39:38.025926 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:38.025895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5q6ms_fdedd0b8-decb-447e-96d8-01b8d67f3dc1/kube-rbac-proxy/0.log" Jul 31 15:39:38.064854 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:38.064289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5q6ms_fdedd0b8-decb-447e-96d8-01b8d67f3dc1/exporter/0.log" Jul 31 15:39:38.105926 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:38.105901 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5q6ms_fdedd0b8-decb-447e-96d8-01b8d67f3dc1/extractor/0.log" Jul 31 15:39:40.437971 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:40.437944 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cd56f/perf-node-gather-daemonset-h97jd" Jul 31 15:39:41.081863 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:41.081818 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-v787p_17283790-b945-4e3c-b8e1-96d7554f3d4d/s3-init/0.log" Jul 31 15:39:41.117843 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:41.117805 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-v787p_17283790-b945-4e3c-b8e1-96d7554f3d4d/download-hf-model/0.log" Jul 31 15:39:46.266498 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:46.266466 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-sdh6n_a4b42702-60bb-4c51-956f-8646edf947ac/kube-storage-version-migrator-operator/1.log" Jul 31 15:39:46.267296 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:46.267275 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-sdh6n_a4b42702-60bb-4c51-956f-8646edf947ac/kube-storage-version-migrator-operator/0.log" Jul 31 15:39:47.764848 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.764747 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/kube-multus-additional-cni-plugins/0.log" Jul 31 15:39:47.790557 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.790528 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/egress-router-binary-copy/0.log" Jul 31 15:39:47.822530 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.822501 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/cni-plugins/0.log" Jul 31 15:39:47.846166 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.846137 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/bond-cni-plugin/0.log" Jul 31 15:39:47.870994 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.870968 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/routeoverride-cni/0.log" Jul 31 15:39:47.895345 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.895316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/whereabouts-cni-bincopy/0.log" Jul 31 15:39:47.924511 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.924485 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xqtm4_a7cafd9d-437a-4dde-a61e-9a3d5859db3c/whereabouts-cni/0.log" Jul 31 15:39:47.991026 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:47.990995 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xgg6x_215ceb81-5dd4-4903-821f-97e22caec11d/kube-multus/0.log" Jul 31 15:39:48.151750 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:48.151721 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tfmsm_5fb7fa83-52a0-40e4-b330-f5e759c766b1/network-metrics-daemon/0.log" Jul 31 15:39:48.173533 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:48.173505 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tfmsm_5fb7fa83-52a0-40e4-b330-f5e759c766b1/kube-rbac-proxy/0.log" Jul 31 15:39:48.937914 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:48.937880 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/ovn-controller/0.log" Jul 31 15:39:48.962017 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:48.961991 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/ovn-acl-logging/0.log" Jul 31 15:39:48.987551 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:48.987522 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/kube-rbac-proxy-node/0.log" Jul 31 15:39:49.011394 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:49.011363 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/kube-rbac-proxy-ovn-metrics/0.log" Jul 31 15:39:49.033286 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:49.033263 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/northd/0.log" Jul 31 15:39:49.056217 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:49.056192 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/nbdb/0.log" Jul 31 15:39:49.081453 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:49.081433 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/sbdb/0.log" Jul 31 15:39:49.123871 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:49.123837 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-76j6l_edb11af6-61e7-46ee-869b-43e5f2d58470/ovnkube-controller/0.log" Jul 31 15:39:50.592767 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:50.592742 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-65bdbbff45-6frvt_8a0ce514-a697-47a3-aa49-e5b76df3a2ab/check-endpoints/0.log" Jul 31 15:39:50.643510 ip-10-0-143-167 kubenswrapper[2560]: I0731 15:39:50.643482 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rdv99_12727d0b-6de8-4da8-9130-4e29acf07a7d/network-check-target-container/0.log"