Jul 14 04:57:13.551657 ip-10-0-142-96 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 04:57:13.551669 ip-10-0-142-96 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 04:57:13.551676 ip-10-0-142-96 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 04:57:13.551908 ip-10-0-142-96 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 04:57:23.756879 ip-10-0-142-96 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 04:57:23.756900 ip-10-0-142-96 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 074b7ad1de7845e885c08c2a729187d7 -- Jul 14 04:59:22.569917 ip-10-0-142-96 systemd[1]: Starting Kubernetes Kubelet... Jul 14 04:59:22.983999 ip-10-0-142-96 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 04:59:22.983999 ip-10-0-142-96 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 04:59:22.983999 ip-10-0-142-96 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 04:59:22.983999 ip-10-0-142-96 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 04:59:22.983999 ip-10-0-142-96 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 04:59:22.984857 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.984765 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 04:59:22.990399 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990381 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:59:22.990399 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990399 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990402 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990407 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990410 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990413 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990415 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990418 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990421 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990423 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990431 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990436 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990439 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990442 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990445 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990447 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990450 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990453 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990455 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990458 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:59:22.990469 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990461 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990463 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990466 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990469 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990472 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990475 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990478 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990481 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990484 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990486 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990489 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990491 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990494 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990496 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990499 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990501 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990504 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990507 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990509 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990512 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990514 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:59:22.990925 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990517 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990519 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990522 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990524 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990526 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990529 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990531 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990535 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990537 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990539 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990542 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990544 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990547 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990550 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990553 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990555 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990558 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990560 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990563 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990565 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990568 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:59:22.991425 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990570 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990585 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990587 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990592 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990595 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990598 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990601 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990604 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990607 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990611 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990613 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990616 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990618 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990620 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990623 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990626 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990628 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990631 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990633 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:59:22.991951 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990636 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990640 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990642 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990645 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990647 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990652 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990656 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990659 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990661 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990664 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990667 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990670 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990672 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990675 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990678 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990680 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990683 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.990685 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991423 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:59:22.992440 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991429 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991433 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991436 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991439 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991443 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991446 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991449 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991451 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991454 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991456 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991461 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991465 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991468 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991471 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991473 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991476 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991479 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991481 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991486 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:59:22.992898 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991488 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991491 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991494 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991496 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991499 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991502 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991505 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991507 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991509 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991512 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991515 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991518 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991520 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991523 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991526 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991528 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991530 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991533 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991536 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:59:22.993365 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991539 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991541 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991544 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991546 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991548 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991551 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991553 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991556 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991558 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991560 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991563 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991566 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991569 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991586 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991589 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991592 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991595 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991597 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991600 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991602 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:59:22.993848 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991605 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991608 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991610 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991612 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991615 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991617 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991620 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991623 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991625 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991628 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991630 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991633 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991636 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991640 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991644 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991647 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991650 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991653 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991655 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991657 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:59:22.994332 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991660 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991663 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991666 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991668 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991671 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991674 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991677 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991679 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991682 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991684 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991688 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991692 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991695 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991698 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991701 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991703 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991706 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991708 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991711 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.991714 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:59:22.994833 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992107 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992113 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992116 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992119 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992123 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992125 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992128 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992130 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992133 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992135 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992138 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992140 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992143 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992146 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992148 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992151 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992154 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992157 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992159 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992162 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:59:22.995318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992164 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992167 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992170 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992172 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992176 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992180 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992183 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992185 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992188 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992191 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992194 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992196 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992199 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992201 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992204 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992207 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992210 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992213 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992216 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:59:22.995813 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992218 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992221 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992223 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992225 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992228 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992231 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992233 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992235 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992250 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992254 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992258 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992260 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992263 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992265 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992268 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992270 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992273 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992275 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992278 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:59:22.996283 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992280 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992283 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992285 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992290 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992292 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992295 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992297 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992300 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992302 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992304 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992307 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992312 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992315 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992318 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992321 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992323 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992326 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992330 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992333 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992337 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:59:22.996791 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992340 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992342 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992346 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992350 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992353 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992355 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992358 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992360 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992363 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992365 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992368 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992370 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992373 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992375 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992378 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992382 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992385 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992387 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992390 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992392 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:59:22.997318 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.992395 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992477 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992499 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992509 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992514 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992519 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992523 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992527 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992531 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992534 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992538 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992541 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992544 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992548 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992551 2560 flags.go:64] FLAG: --cgroup-root="" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992554 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992557 2560 flags.go:64] FLAG: --client-ca-file="" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992560 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992563 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992568 2560 flags.go:64] FLAG: --cluster-domain="" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992571 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992586 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992589 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992592 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 04:59:22.997813 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992596 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992599 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992603 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992607 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992610 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992613 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992616 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992620 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992623 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992627 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992630 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992635 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992638 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992642 2560 flags.go:64] FLAG: --enable-server="true" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992645 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992651 2560 flags.go:64] FLAG: --event-burst="100" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992654 2560 flags.go:64] FLAG: --event-qps="50" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992657 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992660 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992663 2560 flags.go:64] FLAG: --eviction-hard="" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992667 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992670 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992674 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992677 2560 flags.go:64] FLAG: --eviction-soft="" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992679 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 04:59:22.998390 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992682 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992685 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992688 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992691 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992694 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992697 2560 flags.go:64] FLAG: --feature-gates="" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992700 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992704 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992707 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992710 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992713 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992716 2560 flags.go:64] FLAG: --help="false" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992719 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-142-96.ec2.internal" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992722 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992726 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992728 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992732 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992735 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992739 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992742 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992745 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992748 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992752 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992755 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 04:59:22.999107 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992758 2560 flags.go:64] FLAG: --kube-reserved="" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992766 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992769 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992772 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992775 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992778 2560 flags.go:64] FLAG: --lock-file="" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992780 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992783 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992786 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992792 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992795 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992798 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992801 2560 flags.go:64] FLAG: --logging-format="text" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992804 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992807 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992811 2560 flags.go:64] FLAG: --manifest-url="" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992813 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992818 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992821 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992825 2560 flags.go:64] FLAG: --max-pods="110" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992829 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992832 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992834 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992838 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992840 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 04:59:22.999935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992843 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992848 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992856 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992860 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992863 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992866 2560 flags.go:64] FLAG: --pod-cidr="" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992869 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992875 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992878 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992881 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992884 2560 flags.go:64] FLAG: --port="10250" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992888 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992890 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058f3cdb97dad44a1" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992893 2560 flags.go:64] FLAG: --qos-reserved="" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992896 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992899 2560 flags.go:64] FLAG: --register-node="true" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992902 2560 flags.go:64] FLAG: --register-with-taints="" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992906 2560 flags.go:64] FLAG: --registry-burst="10" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992909 2560 flags.go:64] FLAG: --registry-qps="5" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992912 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992915 2560 flags.go:64] FLAG: --reserved-memory="" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992919 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992922 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992925 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992928 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 04:59:23.001022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992931 2560 flags.go:64] FLAG: --runonce="false" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992934 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992937 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992940 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992943 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992946 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992949 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992952 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992955 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992960 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992963 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992965 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992968 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992971 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992978 2560 flags.go:64] FLAG: --system-cgroups="" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992981 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992986 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992989 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.992992 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993001 2560 flags.go:64] FLAG: --tls-min-version="" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993004 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993006 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993009 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993014 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993017 2560 flags.go:64] FLAG: --v="2" Jul 14 04:59:23.002155 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993021 2560 flags.go:64] FLAG: --version="false" Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993025 2560 flags.go:64] FLAG: --vmodule="" Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993029 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.993032 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993156 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993161 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993164 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993167 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993170 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993173 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993176 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993178 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993181 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993183 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993186 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993189 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993194 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993198 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993202 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993205 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:59:23.003212 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993207 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993210 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993219 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993222 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993225 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993228 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993231 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993233 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993236 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993238 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993242 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993245 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993248 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993251 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993253 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993256 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993258 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993261 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993263 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993266 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:59:23.004128 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993268 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993271 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993275 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993278 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993281 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993284 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993287 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993290 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993295 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993298 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993300 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993303 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993305 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993308 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993311 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993319 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993322 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993325 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993327 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:59:23.004928 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993331 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993334 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993337 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993341 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993343 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993346 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993348 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993351 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993354 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993356 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993358 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993361 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993364 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993366 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993369 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993372 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993375 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993378 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993380 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993383 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:59:23.005471 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993385 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993389 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993392 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993394 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993397 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993399 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993402 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993404 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993407 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993416 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993418 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993421 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993423 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993426 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993429 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993432 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993435 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993438 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993440 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993442 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:59:23.005983 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993445 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993447 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993450 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:22.993452 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:22.994263 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.001697 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.001719 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.001737 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.001748 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001836 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001846 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001851 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001855 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001859 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:59:23.006470 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001864 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001868 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001876 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001882 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001886 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001892 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001896 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001901 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001905 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001911 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001916 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001920 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001924 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001929 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001933 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001937 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001941 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001945 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001949 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001954 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:59:23.006850 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001958 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001963 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001967 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001973 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001979 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001983 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001988 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001992 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.001996 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002001 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002005 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002009 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002013 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002017 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002022 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002026 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002030 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002035 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002039 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:59:23.007345 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002043 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002047 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002054 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002060 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002064 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002069 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002073 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002078 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002082 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002086 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002091 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002095 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002099 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002103 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002107 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002111 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002116 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002123 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002130 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:59:23.007967 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002135 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002139 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002143 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002148 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002151 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002156 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002160 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002163 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002168 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002171 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002175 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002179 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002183 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002187 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002192 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002196 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002200 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002205 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002209 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002213 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:59:23.008444 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002218 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002222 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002226 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002230 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002234 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002237 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002242 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002246 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002250 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002255 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002261 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002266 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002271 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002276 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002279 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:59:23.008956 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002284 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.002292 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002473 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002481 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002486 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002491 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002496 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002500 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002504 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002509 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002512 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002517 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002521 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002525 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002530 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 04:59:23.009319 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002534 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002538 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002542 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002546 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002550 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002555 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002559 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002563 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002568 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002589 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002594 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002599 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002604 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002608 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002612 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002617 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002622 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002626 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002629 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002633 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 04:59:23.009692 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002637 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002641 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002646 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002650 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002654 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002659 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002663 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002667 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002671 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002676 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002680 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002684 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002688 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002694 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002698 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002702 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002706 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002710 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002714 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 04:59:23.010166 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002718 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002722 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002726 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002732 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002737 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002741 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002745 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002749 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002753 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002758 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002762 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002766 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002773 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002779 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002784 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002788 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002793 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002797 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002802 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 04:59:23.010635 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002805 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002810 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002814 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002818 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002822 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002826 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002830 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002834 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002841 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002846 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002850 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002855 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002859 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002863 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002869 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002874 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002878 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002883 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002888 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 04:59:23.011105 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002892 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002896 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002900 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002904 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002909 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002913 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002917 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002921 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:23.002925 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.002933 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.003235 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.007153 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.008538 2560 server.go:1019] "Starting client certificate rotation" Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.008641 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 04:59:23.011564 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.009507 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 04:59:23.011945 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.011726 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 04:59:23.012971 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.012953 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 04:59:23.019126 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.019109 2560 log.go:25] "Validated CRI v1 runtime API" Jul 14 04:59:23.021301 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.021285 2560 log.go:25] "Validated CRI v1 image API" Jul 14 04:59:23.024943 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.024925 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 04:59:23.027229 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.027198 2560 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 adbb1493-4867-450a-99a6-2b474c79067c:/dev/nvme0n1p4 fb9f0a55-efb4-4dcf-bdea-b36112ddc963:/dev/nvme0n1p3] Jul 14 04:59:23.027318 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.027229 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 04:59:23.032809 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.032696 2560 manager.go:216] Machine: {Timestamp:2026-07-14 04:59:23.031347521 +0000 UTC m=+0.345998303 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097386 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23c4f080f77866afc84bfefe5337b6 SystemUUID:ec23c4f0-80f7-7866-afc8-4bfefe5337b6 BootID:074b7ad1-de78-45e8-85c0-8c2a729187d7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9b:ed:a1:9c:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9b:ed:a1:9c:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:3e:6f:35:be:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 04:59:23.032809 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.032800 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 04:59:23.033002 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.032919 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 04:59:23.034688 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.034658 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 04:59:23.034860 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.034692 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 04:59:23.035447 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.035430 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 04:59:23.035447 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.035447 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 04:59:23.035603 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.035457 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 04:59:23.035603 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.035477 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 04:59:23.035674 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.035665 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 04:59:23.036765 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.036752 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 04:59:23.044744 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044727 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 14 04:59:23.044897 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044887 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 04:59:23.044950 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044917 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 14 04:59:23.044950 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044926 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 04:59:23.044950 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044945 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 04:59:23.045070 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044955 2560 kubelet.go:398] "Adding apiserver pod source" Jul 14 04:59:23.045070 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.044972 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 04:59:23.045405 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.045393 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 04:59:23.045440 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.045414 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 04:59:23.048678 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.048556 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 04:59:23.050682 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050662 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 04:59:23.050790 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050702 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 04:59:23.050911 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050897 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 04:59:23.050980 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050920 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 04:59:23.050980 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050929 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 04:59:23.050980 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050937 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 04:59:23.050980 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050950 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 04:59:23.050980 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.050959 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 04:59:23.051422 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.051412 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 04:59:23.051477 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.051425 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 04:59:23.051477 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.051437 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 04:59:23.051477 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.051447 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 04:59:23.051477 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.051459 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 04:59:23.051477 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.051471 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 04:59:23.052974 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.052955 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 04:59:23.052974 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.052976 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 04:59:23.055090 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.055051 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 04:59:23.055090 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.055063 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 04:59:23.055232 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.055106 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 04:59:23.056543 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.056328 2560 server.go:1268] "Started kubelet" Jul 14 04:59:23.056762 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.056615 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 04:59:23.056762 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.056403 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 04:59:23.056762 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.056690 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 04:59:23.058113 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.058092 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 04:59:23.058252 ip-10-0-142-96 systemd[1]: Started Kubernetes Kubelet. Jul 14 04:59:23.058965 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.058952 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 14 04:59:23.060903 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.060886 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 04:59:23.061045 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.060160 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-96.ec2.internal.18c20f3e656dfe11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-96.ec2.internal,UID:ip-10-0-142-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-96.ec2.internal,},FirstTimestamp:2026-07-14 04:59:23.056234001 +0000 UTC m=+0.370884785,LastTimestamp:2026-07-14 04:59:23.056234001 +0000 UTC m=+0.370884785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-96.ec2.internal,}" Jul 14 04:59:23.062741 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.062726 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 04:59:23.062806 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.062732 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 04:59:23.062858 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.062845 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.063407 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063388 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 04:59:23.063487 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063458 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 04:59:23.063487 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063472 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 04:59:23.063604 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063515 2560 factory.go:55] Registering systemd factory Jul 14 04:59:23.063604 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063531 2560 factory.go:223] Registration of the systemd container factory successfully Jul 14 04:59:23.063686 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063632 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 14 04:59:23.063686 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063643 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 14 04:59:23.063763 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063750 2560 factory.go:153] Registering CRI-O factory Jul 14 04:59:23.063799 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063767 2560 factory.go:223] Registration of the crio container factory successfully Jul 14 04:59:23.063843 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063816 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 04:59:23.063900 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063847 2560 factory.go:103] Registering Raw factory Jul 14 04:59:23.063900 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.063860 2560 manager.go:1196] Started watching for new ooms in manager Jul 14 04:59:23.064526 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.064513 2560 manager.go:349] Starting recovery of all containers Jul 14 04:59:23.071436 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.071401 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 04:59:23.074242 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.074196 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 04:59:23.074423 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.074392 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 04:59:23.076031 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.075852 2560 manager.go:354] Recovery completed Jul 14 04:59:23.081407 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.081388 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.083317 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083287 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.083396 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083331 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.083396 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083344 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.083886 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083872 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 04:59:23.083886 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083882 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 04:59:23.083990 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083885 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.083990 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.083898 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 14 04:59:23.084549 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.084534 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.084608 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.084562 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.084608 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.084585 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.085073 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.085061 2560 policy_none.go:49] "None policy: Start" Jul 14 04:59:23.085106 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.085079 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 04:59:23.085106 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.085089 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 04:59:23.085758 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.085743 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kj96m" Jul 14 04:59:23.085936 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.085867 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-96.ec2.internal.18c20f3e670b394d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-96.ec2.internal,UID:ip-10-0-142-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-96.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-96.ec2.internal,},FirstTimestamp:2026-07-14 04:59:23.083315533 +0000 UTC m=+0.397966316,LastTimestamp:2026-07-14 04:59:23.083315533 +0000 UTC m=+0.397966316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-96.ec2.internal,}" Jul 14 04:59:23.086084 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.086074 2560 policy_none.go:47] "Start" Jul 14 04:59:23.094278 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.094257 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kj96m" Jul 14 04:59:23.095960 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.095892 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-96.ec2.internal.18c20f3e670b9017 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-96.ec2.internal,UID:ip-10-0-142-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-96.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-96.ec2.internal,},FirstTimestamp:2026-07-14 04:59:23.083337751 +0000 UTC m=+0.397988537,LastTimestamp:2026-07-14 04:59:23.083337751 +0000 UTC m=+0.397988537,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-96.ec2.internal,}" Jul 14 04:59:23.098301 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.098237 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-96.ec2.internal.18c20f3e670bb857 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-96.ec2.internal,UID:ip-10-0-142-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-96.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-96.ec2.internal,},FirstTimestamp:2026-07-14 04:59:23.083348055 +0000 UTC m=+0.397998838,LastTimestamp:2026-07-14 04:59:23.083348055 +0000 UTC m=+0.397998838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-96.ec2.internal,}" Jul 14 04:59:23.135284 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135261 2560 manager.go:337] "Starting Device Plugin manager" Jul 14 04:59:23.135440 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.135303 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 04:59:23.135440 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135320 2560 server.go:87] "Starting device plugin registration server" Jul 14 04:59:23.135673 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135661 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 04:59:23.135736 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135678 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 04:59:23.135800 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135786 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 04:59:23.135882 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135870 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 04:59:23.135882 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.135882 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 04:59:23.136474 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.136449 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 04:59:23.136588 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.136513 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.236052 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.235968 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.237406 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.236917 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.237406 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.236947 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.237406 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.236963 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.237406 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.236996 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.243116 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.243101 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.243168 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.243124 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-96.ec2.internal\": node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.252735 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.252712 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 04:59:23.252863 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.252751 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 04:59:23.252863 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.252772 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 04:59:23.252863 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.252802 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 04:59:23.256097 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.256076 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:23.261043 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.261028 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.353749 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.353700 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal"] Jul 14 04:59:23.353927 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.353793 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.354809 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.354793 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.354879 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.354825 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.354879 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.354838 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.356264 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.356249 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.356353 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.356338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.356407 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.356366 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.357091 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.357071 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.357179 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.357103 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.357179 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.357173 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.357245 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.357104 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.357276 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.357246 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.357276 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.357262 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.358411 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.358397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.358473 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.358432 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:23.359175 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.359159 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:23.359246 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.359186 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:23.359246 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.359201 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:23.361699 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.361687 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.364836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.364819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2d7a3a435eaf2a33d2e303e52961b6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal\" (UID: \"d2d7a3a435eaf2a33d2e303e52961b6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.364894 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.364844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2d7a3a435eaf2a33d2e303e52961b6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal\" (UID: \"d2d7a3a435eaf2a33d2e303e52961b6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.364894 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.364861 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73dd704072130945e0f1c07d602a42f6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-96.ec2.internal\" (UID: \"73dd704072130945e0f1c07d602a42f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.391535 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.391503 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-96.ec2.internal\" not found" node="ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.396003 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.395982 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-96.ec2.internal\" not found" node="ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.462351 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.462324 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.465123 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.465106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2d7a3a435eaf2a33d2e303e52961b6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal\" (UID: \"d2d7a3a435eaf2a33d2e303e52961b6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.465186 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.465131 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2d7a3a435eaf2a33d2e303e52961b6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal\" (UID: \"d2d7a3a435eaf2a33d2e303e52961b6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.465186 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.465148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73dd704072130945e0f1c07d602a42f6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-96.ec2.internal\" (UID: \"73dd704072130945e0f1c07d602a42f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.465263 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.465189 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2d7a3a435eaf2a33d2e303e52961b6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal\" (UID: \"d2d7a3a435eaf2a33d2e303e52961b6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.465263 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.465197 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2d7a3a435eaf2a33d2e303e52961b6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal\" (UID: \"d2d7a3a435eaf2a33d2e303e52961b6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.465263 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.465226 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73dd704072130945e0f1c07d602a42f6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-96.ec2.internal\" (UID: \"73dd704072130945e0f1c07d602a42f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.562768 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.562693 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.663240 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.663210 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.693674 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.693646 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.699345 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:23.699326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" Jul 14 04:59:23.764123 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.764084 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.864563 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.864492 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:23.964925 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:23.964896 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:24.008234 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.008200 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 04:59:24.008781 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.008371 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 04:59:24.065328 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:24.065292 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:24.097890 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.097843 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 04:54:25 +0000 UTC" deadline="2028-02-20 11:44:01.29908992 +0000 UTC" Jul 14 04:59:24.097890 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.097881 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14070h44m37.201212307s" Jul 14 04:59:24.166368 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:24.166336 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:24.246654 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:24.246622 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d7a3a435eaf2a33d2e303e52961b6c.slice/crio-c796c4957ba0527f2d9c56c2c04245013a53f4e4b24d2cab2692cebcb1932b5e WatchSource:0}: Error finding container c796c4957ba0527f2d9c56c2c04245013a53f4e4b24d2cab2692cebcb1932b5e: Status 404 returned error can't find the container with id c796c4957ba0527f2d9c56c2c04245013a53f4e4b24d2cab2692cebcb1932b5e Jul 14 04:59:24.247488 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:24.247468 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dd704072130945e0f1c07d602a42f6.slice/crio-e136098377a63f9cb9c8b995ddd15f298e8d1d27dd9a1368478e668bcc43a997 WatchSource:0}: Error finding container e136098377a63f9cb9c8b995ddd15f298e8d1d27dd9a1368478e668bcc43a997: Status 404 returned error can't find the container with id e136098377a63f9cb9c8b995ddd15f298e8d1d27dd9a1368478e668bcc43a997 Jul 14 04:59:24.252380 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.252360 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 04:59:24.256233 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.256189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" event={"ID":"d2d7a3a435eaf2a33d2e303e52961b6c","Type":"ContainerStarted","Data":"c796c4957ba0527f2d9c56c2c04245013a53f4e4b24d2cab2692cebcb1932b5e"} Jul 14 04:59:24.257172 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.257152 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" event={"ID":"73dd704072130945e0f1c07d602a42f6","Type":"ContainerStarted","Data":"e136098377a63f9cb9c8b995ddd15f298e8d1d27dd9a1368478e668bcc43a997"} Jul 14 04:59:24.267220 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:24.267197 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:24.289497 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.289459 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 04:59:24.291234 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.291218 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientMemory" Jul 14 04:59:24.291322 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.291248 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 04:59:24.291322 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.291257 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeHasSufficientPID" Jul 14 04:59:24.332440 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:24.332416 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:24.367745 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:24.367713 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:24.468256 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:24.468171 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:26.563022 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:26.562990 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-96.ec2.internal\" not found" Jul 14 04:59:26.563512 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:26.563499 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:26.618074 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:26.618043 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:26.657714 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:26.657540 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" Jul 14 04:59:26.671095 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:26.671060 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 04:59:26.672143 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:26.672123 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" Jul 14 04:59:26.680570 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:26.680545 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 04:59:27.040560 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.040519 2560 apiserver.go:52] "Watching apiserver" Jul 14 04:59:27.048330 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.048295 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 04:59:27.048715 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.048684 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-kmvxx","kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pktpj","openshift-dns/node-resolver-lvxpf","openshift-image-registry/node-ca-wgpgl","openshift-multus/multus-additional-cni-plugins-wzfhr","openshift-network-diagnostics/network-check-target-z9zls","openshift-network-operator/iptables-alerter-p8qxj","kube-system/konnectivity-agent-mn6z8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal","openshift-multus/multus-f9dv2","openshift-multus/network-metrics-daemon-q8tq9","openshift-ovn-kubernetes/ovnkube-node-gczhh"] Jul 14 04:59:27.051230 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.051114 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:27.051230 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.051204 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:27.053240 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.053216 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.053345 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.053283 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:27.055368 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.055347 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.058090 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.057427 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 04:59:27.058090 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.057727 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.058346 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.058303 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.058596 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.058449 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vhpl5\"" Jul 14 04:59:27.058596 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.058476 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.060346 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.059950 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.060438 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.060409 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tlwwg\"" Jul 14 04:59:27.060528 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.060437 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.060675 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.060655 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.062425 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.062404 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.063042 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.063025 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 04:59:27.063131 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.063040 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.064675 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.064287 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2cqf\"" Jul 14 04:59:27.064675 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.064613 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.065019 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.064993 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.065164 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.065142 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.065323 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.065298 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.065534 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.065517 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 04:59:27.065620 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.065551 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 04:59:27.065884 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.065686 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 04:59:27.065884 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.065762 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmlnd\"" Jul 14 04:59:27.067372 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.067332 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.067492 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.067420 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:27.067923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.067831 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 04:59:27.067923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.067911 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fwthw\"" Jul 14 04:59:27.068069 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.067941 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 04:59:27.069863 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.069844 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.071514 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.071493 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysctl-d\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072123 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-run\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-lib-modules\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072171 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-host\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072191 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-modprobe-d\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072231 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-sys\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072238 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/539917cf-5fe2-4860-99e4-c24190995bd6-tmp\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072254 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b666e712-652e-43d6-b8e3-821a0768d8a0-hosts-file\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b666e712-652e-43d6-b8e3-821a0768d8a0-tmp-dir\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072301 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl4fm\" (UniqueName: \"kubernetes.io/projected/c4e4f4e9-23c4-4351-9058-5593fae027ec-kube-api-access-gl4fm\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysconfig\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072401 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-var-lib-kubelet\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072424 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttsw9\" (UniqueName: \"kubernetes.io/projected/539917cf-5fe2-4860-99e4-c24190995bd6-kube-api-access-ttsw9\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072449 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcv7g\" (UniqueName: \"kubernetes.io/projected/b666e712-652e-43d6-b8e3-821a0768d8a0-kube-api-access-hcv7g\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-kubernetes\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072525 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysctl-conf\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-systemd\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.072627 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.072580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/539917cf-5fe2-4860-99e4-c24190995bd6-etc-tuned\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.073211 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.073198 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 04:59:27.073248 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.073220 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fsknn\"" Jul 14 04:59:27.073302 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.073278 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 04:59:27.073367 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.073313 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 04:59:27.073556 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.073455 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 04:59:27.073556 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.073531 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.074420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.074402 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.075562 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.075535 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.076563 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.076543 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.077664 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.077545 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jvqtr\"" Jul 14 04:59:27.077664 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.077565 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 04:59:27.077979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.077949 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.078472 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.078440 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 04:59:27.078750 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.078733 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d7wd7\"" Jul 14 04:59:27.079759 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.079742 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 04:59:27.080031 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.079821 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 04:59:27.081339 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.081281 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.083891 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.083863 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nm64x\"" Jul 14 04:59:27.083891 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.083887 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 04:59:27.093900 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.093875 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wm9p" Jul 14 04:59:27.101432 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.101390 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6wm9p" Jul 14 04:59:27.158431 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.158400 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 04:59:27.173680 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:27.173846 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173693 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-var-lib-kubelet\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.173846 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.173846 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-var-lib-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.173997 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173856 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-var-lib-kubelet\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.173997 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-multus-certs\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.173997 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.173924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysctl-conf\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.174133 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-kubelet\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174133 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3f3c541-7373-4636-8662-5fddc1d28fc3-iptables-alerter-script\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.174133 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174049 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6rcp\" (UniqueName: \"kubernetes.io/projected/b3f3c541-7373-4636-8662-5fddc1d28fc3-kube-api-access-p6rcp\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.174133 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174084 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysctl-conf\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.174133 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-os-release\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174143 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-cni-bin\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/539917cf-5fe2-4860-99e4-c24190995bd6-tmp\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174277 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b666e712-652e-43d6-b8e3-821a0768d8a0-hosts-file\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-k8s-cni-cncf-io\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-os-release\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.174350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-etc-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174352 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b666e712-652e-43d6-b8e3-821a0768d8a0-hosts-file\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174363 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-cnibin\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174407 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-cni-binary-copy\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174438 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-systemd\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-node-log\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174520 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-systemd\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovnkube-config\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-sys-fs\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-cni-bin\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-hostroot\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174639 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-cni-netd\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174702 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-sys\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.174728 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-systemd-units\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174776 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3f3c541-7373-4636-8662-5fddc1d28fc3-host-slash\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174779 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-sys\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9k69\" (UniqueName: \"kubernetes.io/projected/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-kube-api-access-z9k69\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cedfbd0a-7dea-496c-9fcc-7fcb7e52259c-agent-certs\") pod \"konnectivity-agent-mn6z8\" (UID: \"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c\") " pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cedfbd0a-7dea-496c-9fcc-7fcb7e52259c-konnectivity-ca\") pod \"konnectivity-agent-mn6z8\" (UID: \"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c\") " pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.174861 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.174949 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 04:59:27.67491295 +0000 UTC m=+2.995678313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174969 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-system-cni-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.174995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-kubelet\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175023 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-kubernetes\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175042 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/539917cf-5fe2-4860-99e4-c24190995bd6-etc-tuned\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-serviceca\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175102 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-kubernetes\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.175495 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovnkube-script-lib\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-daemon-config\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-run\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175223 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-host\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175248 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-host\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175262 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-run\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-system-cni-dir\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175281 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-host\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175298 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-systemd\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-env-overrides\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175346 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-cni-multus\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175389 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b666e712-652e-43d6-b8e3-821a0768d8a0-tmp-dir\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ea96973-aa43-444d-9bf1-1809b00cf89a-kubelet-config\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ea96973-aa43-444d-9bf1-1809b00cf89a-dbus\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-log-socket\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qrdh\" (UniqueName: \"kubernetes.io/projected/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-kube-api-access-6qrdh\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176210 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-device-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-socket-dir-parent\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175564 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-conf-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175609 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl4fm\" (UniqueName: \"kubernetes.io/projected/c4e4f4e9-23c4-4351-9058-5593fae027ec-kube-api-access-gl4fm\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175634 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysconfig\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttsw9\" (UniqueName: \"kubernetes.io/projected/539917cf-5fe2-4860-99e4-c24190995bd6-kube-api-access-ttsw9\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175681 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcv7g\" (UniqueName: \"kubernetes.io/projected/b666e712-652e-43d6-b8e3-821a0768d8a0-kube-api-access-hcv7g\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175707 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b666e712-652e-43d6-b8e3-821a0768d8a0-tmp-dir\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175712 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175748 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-socket-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175783 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wttc\" (UniqueName: \"kubernetes.io/projected/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-kube-api-access-4wttc\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-cnibin\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysconfig\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.175895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7jld\" (UniqueName: \"kubernetes.io/projected/3c88a251-0244-450f-84d3-6f6c661b1bb2-kube-api-access-m7jld\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176037 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovn-node-metrics-cert\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.176923 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-etc-kubernetes\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysctl-d\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-lib-modules\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-slash\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176200 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-ovn\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-netns\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176246 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-modprobe-d\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176256 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-sysctl-d\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176270 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-run-netns\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176261 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-lib-modules\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-registration-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176326 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4zsx\" (UniqueName: \"kubernetes.io/projected/ce06781e-2c8b-4fdc-8f83-692a591653f5-kube-api-access-s4zsx\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/539917cf-5fe2-4860-99e4-c24190995bd6-etc-modprobe-d\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.177536 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.176349 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-cni-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.178323 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.178299 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/539917cf-5fe2-4860-99e4-c24190995bd6-tmp\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.178436 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.178336 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/539917cf-5fe2-4860-99e4-c24190995bd6-etc-tuned\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.183825 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.183806 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:27.183955 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.183829 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:27.183955 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.183842 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:27.183955 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.183899 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 04:59:27.683884843 +0000 UTC m=+3.004650184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:27.188853 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.188831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl4fm\" (UniqueName: \"kubernetes.io/projected/c4e4f4e9-23c4-4351-9058-5593fae027ec-kube-api-access-gl4fm\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.188971 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.188831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttsw9\" (UniqueName: \"kubernetes.io/projected/539917cf-5fe2-4860-99e4-c24190995bd6-kube-api-access-ttsw9\") pod \"tuned-pktpj\" (UID: \"539917cf-5fe2-4860-99e4-c24190995bd6\") " pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.188971 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.188834 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcv7g\" (UniqueName: \"kubernetes.io/projected/b666e712-652e-43d6-b8e3-821a0768d8a0-kube-api-access-hcv7g\") pod \"node-resolver-lvxpf\" (UID: \"b666e712-652e-43d6-b8e3-821a0768d8a0\") " pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.277319 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-node-log\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277319 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovnkube-config\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277341 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-sys-fs\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277355 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-cni-bin\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277397 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-cni-bin\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277411 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-node-log\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-hostroot\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-cni-netd\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277521 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-sys-fs\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-systemd-units\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277575 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-cni-netd\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.277593 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277590 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-hostroot\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3f3c541-7373-4636-8662-5fddc1d28fc3-host-slash\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277660 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9k69\" (UniqueName: \"kubernetes.io/projected/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-kube-api-access-z9k69\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277665 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-systemd-units\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277695 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cedfbd0a-7dea-496c-9fcc-7fcb7e52259c-agent-certs\") pod \"konnectivity-agent-mn6z8\" (UID: \"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c\") " pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277700 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3f3c541-7373-4636-8662-5fddc1d28fc3-host-slash\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cedfbd0a-7dea-496c-9fcc-7fcb7e52259c-konnectivity-ca\") pod \"konnectivity-agent-mn6z8\" (UID: \"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c\") " pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277743 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277752 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277766 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-system-cni-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-kubelet\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277824 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-serviceca\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovnkube-script-lib\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-daemon-config\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278169 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-host\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277940 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-kubelet\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277996 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.277946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-system-cni-dir\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278022 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovnkube-config\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-systemd\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-env-overrides\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-cni-multus\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ea96973-aa43-444d-9bf1-1809b00cf89a-kubelet-config\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278172 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ea96973-aa43-444d-9bf1-1809b00cf89a-dbus\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-log-socket\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qrdh\" (UniqueName: \"kubernetes.io/projected/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-kube-api-access-6qrdh\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-device-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-socket-dir-parent\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278287 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-conf-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-socket-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.278979 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278401 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wttc\" (UniqueName: \"kubernetes.io/projected/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-kube-api-access-4wttc\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278411 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-serviceca\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-cnibin\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278477 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7jld\" (UniqueName: \"kubernetes.io/projected/3c88a251-0244-450f-84d3-6f6c661b1bb2-kube-api-access-m7jld\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278522 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-system-cni-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovn-node-metrics-cert\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278566 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovnkube-script-lib\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278568 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-etc-kubernetes\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278629 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-daemon-config\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-slash\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278001 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-system-cni-dir\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278665 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278679 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-ovn\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278702 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-host\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278706 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-netns\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.279836 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278718 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-systemd\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278745 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-slash\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-run-netns\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278787 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-registration-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4zsx\" (UniqueName: \"kubernetes.io/projected/ce06781e-2c8b-4fdc-8f83-692a591653f5-kube-api-access-s4zsx\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278841 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-cni-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278904 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-var-lib-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278928 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-multus-certs\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-kubelet\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278979 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3f3c541-7373-4636-8662-5fddc1d28fc3-iptables-alerter-script\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278993 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-socket-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6rcp\" (UniqueName: \"kubernetes.io/projected/b3f3c541-7373-4636-8662-5fddc1d28fc3-kube-api-access-p6rcp\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279036 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-conf-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279047 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-etc-kubernetes\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.278995 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-registration-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279055 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-socket-dir-parent\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.280642 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279086 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-run-ovn\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279099 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-os-release\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279105 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-env-overrides\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279114 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce06781e-2c8b-4fdc-8f83-692a591653f5-device-dir\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279040 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-os-release\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279124 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-netns\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279148 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-kubelet\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279168 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-run-netns\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279229 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-log-socket\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.279236 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279253 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-multus-cni-dir\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279251 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279266 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-cni-multus\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.279285 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:27.779271899 +0000 UTC m=+3.100037239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279103 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279301 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ea96973-aa43-444d-9bf1-1809b00cf89a-kubelet-config\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.281584 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279321 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-cnibin\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279335 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-var-lib-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279404 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ea96973-aa43-444d-9bf1-1809b00cf89a-dbus\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279444 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-multus-certs\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279489 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-cni-bin\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-k8s-cni-cncf-io\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-os-release\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279581 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-etc-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-var-lib-cni-bin\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279623 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-cnibin\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-cni-binary-copy\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279679 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c88a251-0244-450f-84d3-6f6c661b1bb2-os-release\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279680 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-etc-openvswitch\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279711 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-host-run-k8s-cni-cncf-io\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279723 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279741 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-cnibin\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.282223 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.279974 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cedfbd0a-7dea-496c-9fcc-7fcb7e52259c-konnectivity-ca\") pod \"konnectivity-agent-mn6z8\" (UID: \"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c\") " pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.283022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.280173 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-cni-binary-copy\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.283022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.280211 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c88a251-0244-450f-84d3-6f6c661b1bb2-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.283022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.280285 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3f3c541-7373-4636-8662-5fddc1d28fc3-iptables-alerter-script\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.283022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.281510 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cedfbd0a-7dea-496c-9fcc-7fcb7e52259c-agent-certs\") pod \"konnectivity-agent-mn6z8\" (UID: \"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c\") " pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.283022 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.281862 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-ovn-node-metrics-cert\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.286216 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.286196 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9k69\" (UniqueName: \"kubernetes.io/projected/865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e-kube-api-access-z9k69\") pod \"node-ca-wgpgl\" (UID: \"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e\") " pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.288935 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.288899 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wttc\" (UniqueName: \"kubernetes.io/projected/8bb04b68-aa46-482b-bb3b-106ae6ff69c3-kube-api-access-4wttc\") pod \"multus-f9dv2\" (UID: \"8bb04b68-aa46-482b-bb3b-106ae6ff69c3\") " pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.289035 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.288969 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6rcp\" (UniqueName: \"kubernetes.io/projected/b3f3c541-7373-4636-8662-5fddc1d28fc3-kube-api-access-p6rcp\") pod \"iptables-alerter-p8qxj\" (UID: \"b3f3c541-7373-4636-8662-5fddc1d28fc3\") " pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.289361 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.289345 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qrdh\" (UniqueName: \"kubernetes.io/projected/108c5802-60a1-4d8d-aeb0-be2e47e67a3a-kube-api-access-6qrdh\") pod \"ovnkube-node-gczhh\" (UID: \"108c5802-60a1-4d8d-aeb0-be2e47e67a3a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.290023 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.290001 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4zsx\" (UniqueName: \"kubernetes.io/projected/ce06781e-2c8b-4fdc-8f83-692a591653f5-kube-api-access-s4zsx\") pod \"aws-ebs-csi-driver-node-wv5cn\" (UID: \"ce06781e-2c8b-4fdc-8f83-692a591653f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.290115 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.290075 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7jld\" (UniqueName: \"kubernetes.io/projected/3c88a251-0244-450f-84d3-6f6c661b1bb2-kube-api-access-m7jld\") pod \"multus-additional-cni-plugins-wzfhr\" (UID: \"3c88a251-0244-450f-84d3-6f6c661b1bb2\") " pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.368204 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.368124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pktpj" Jul 14 04:59:27.377861 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.377843 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lvxpf" Jul 14 04:59:27.385807 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.385788 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgpgl" Jul 14 04:59:27.392588 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.392563 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" Jul 14 04:59:27.400441 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.400415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:27.409211 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.409189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:27.417069 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.417045 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" Jul 14 04:59:27.428665 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.428640 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p8qxj" Jul 14 04:59:27.434431 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.434410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f9dv2" Jul 14 04:59:27.457235 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.457206 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 04:59:27.681934 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.681865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:27.682060 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.682007 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:27.682098 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.682067 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 04:59:28.68205217 +0000 UTC m=+4.002817531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:27.782355 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.782315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:27.782540 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:27.782373 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:27.782540 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.782500 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:27.782540 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.782536 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:27.782648 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.782542 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:27.782648 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.782604 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:28.782591142 +0000 UTC m=+4.103356483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:27.782648 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.782548 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:27.782741 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:27.782677 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 04:59:28.782664982 +0000 UTC m=+4.103430323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:28.090943 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.090919 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb666e712_652e_43d6_b8e3_821a0768d8a0.slice/crio-1695267a6049cb16daa931275c4f7332c5d0d593b0fc9443058528b9d18b83d0 WatchSource:0}: Error finding container 1695267a6049cb16daa931275c4f7332c5d0d593b0fc9443058528b9d18b83d0: Status 404 returned error can't find the container with id 1695267a6049cb16daa931275c4f7332c5d0d593b0fc9443058528b9d18b83d0 Jul 14 04:59:28.092210 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.092183 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865b5f3c_f4c9_46d6_b8ab_6b719a1bfd8e.slice/crio-fc4070e7ac6fd205cedfc7aec00061974355853abfa7f89bb3dc3229d0e02866 WatchSource:0}: Error finding container fc4070e7ac6fd205cedfc7aec00061974355853abfa7f89bb3dc3229d0e02866: Status 404 returned error can't find the container with id fc4070e7ac6fd205cedfc7aec00061974355853abfa7f89bb3dc3229d0e02866 Jul 14 04:59:28.093385 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.093361 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539917cf_5fe2_4860_99e4_c24190995bd6.slice/crio-f59712563de85fdcfaaf4d231cc0729f6de78262efa7564f5635b7dc73b031df WatchSource:0}: Error finding container f59712563de85fdcfaaf4d231cc0729f6de78262efa7564f5635b7dc73b031df: Status 404 returned error can't find the container with id f59712563de85fdcfaaf4d231cc0729f6de78262efa7564f5635b7dc73b031df Jul 14 04:59:28.096655 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.096620 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcedfbd0a_7dea_496c_9fcc_7fcb7e52259c.slice/crio-4797ad77b0c64a9f23a376d593bed8fd580cee65d0d95c9dcc257e17560fed65 WatchSource:0}: Error finding container 4797ad77b0c64a9f23a376d593bed8fd580cee65d0d95c9dcc257e17560fed65: Status 404 returned error can't find the container with id 4797ad77b0c64a9f23a376d593bed8fd580cee65d0d95c9dcc257e17560fed65 Jul 14 04:59:28.097816 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.097791 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce06781e_2c8b_4fdc_8f83_692a591653f5.slice/crio-f9e0b1bc530f6a54c9ea6bd4cacf9a48914949df18fcb12b9251cdc7a8067fba WatchSource:0}: Error finding container f9e0b1bc530f6a54c9ea6bd4cacf9a48914949df18fcb12b9251cdc7a8067fba: Status 404 returned error can't find the container with id f9e0b1bc530f6a54c9ea6bd4cacf9a48914949df18fcb12b9251cdc7a8067fba Jul 14 04:59:28.098699 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.098678 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f3c541_7373_4636_8662_5fddc1d28fc3.slice/crio-b7be238dac6be81c0e8c30fb4e615ba0f237b345175c4ab32ef771d86b53ef15 WatchSource:0}: Error finding container b7be238dac6be81c0e8c30fb4e615ba0f237b345175c4ab32ef771d86b53ef15: Status 404 returned error can't find the container with id b7be238dac6be81c0e8c30fb4e615ba0f237b345175c4ab32ef771d86b53ef15 Jul 14 04:59:28.099750 ip-10-0-142-96 kubenswrapper[2560]: W0714 04:59:28.099592 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod108c5802_60a1_4d8d_aeb0_be2e47e67a3a.slice/crio-f5966825f62efe305b22923850a674e6d17d6d83e76be196b67d142346b687af WatchSource:0}: Error finding container f5966825f62efe305b22923850a674e6d17d6d83e76be196b67d142346b687af: Status 404 returned error can't find the container with id f5966825f62efe305b22923850a674e6d17d6d83e76be196b67d142346b687af Jul 14 04:59:28.104719 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.104685 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 04:54:27 +0000 UTC" deadline="2028-03-12 20:15:40.666666818 +0000 UTC" Jul 14 04:59:28.104805 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.104721 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14583h16m12.561951219s" Jul 14 04:59:28.248053 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.247867 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:28.248219 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.248140 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:28.258172 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.258139 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pktpj" event={"ID":"539917cf-5fe2-4860-99e4-c24190995bd6","Type":"ContainerStarted","Data":"f59712563de85fdcfaaf4d231cc0729f6de78262efa7564f5635b7dc73b031df"} Jul 14 04:59:28.259266 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.259241 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvxpf" event={"ID":"b666e712-652e-43d6-b8e3-821a0768d8a0","Type":"ContainerStarted","Data":"1695267a6049cb16daa931275c4f7332c5d0d593b0fc9443058528b9d18b83d0"} Jul 14 04:59:28.260421 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.260398 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerStarted","Data":"c41ac2e7805097a837fc0bb6cbd5c9e06a1dd6fe5961ab76ce981158105c4b00"} Jul 14 04:59:28.261341 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.261325 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f9dv2" event={"ID":"8bb04b68-aa46-482b-bb3b-106ae6ff69c3","Type":"ContainerStarted","Data":"1a972e77d0a0dc9ea4b1b1440b27f7ac88da52de5af2684f2b79df38363bdf8e"} Jul 14 04:59:28.262347 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.262327 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"f5966825f62efe305b22923850a674e6d17d6d83e76be196b67d142346b687af"} Jul 14 04:59:28.263226 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.263207 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" event={"ID":"ce06781e-2c8b-4fdc-8f83-692a591653f5","Type":"ContainerStarted","Data":"f9e0b1bc530f6a54c9ea6bd4cacf9a48914949df18fcb12b9251cdc7a8067fba"} Jul 14 04:59:28.264410 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.264379 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mn6z8" event={"ID":"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c","Type":"ContainerStarted","Data":"4797ad77b0c64a9f23a376d593bed8fd580cee65d0d95c9dcc257e17560fed65"} Jul 14 04:59:28.266189 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.266168 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" event={"ID":"73dd704072130945e0f1c07d602a42f6","Type":"ContainerStarted","Data":"fb7ea16fb3f678c3b7f32b7f5c7123ba06ba4991d4fcfa1f581197254160a33e"} Jul 14 04:59:28.267143 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.267125 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p8qxj" event={"ID":"b3f3c541-7373-4636-8662-5fddc1d28fc3","Type":"ContainerStarted","Data":"b7be238dac6be81c0e8c30fb4e615ba0f237b345175c4ab32ef771d86b53ef15"} Jul 14 04:59:28.268079 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.268061 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgpgl" event={"ID":"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e","Type":"ContainerStarted","Data":"fc4070e7ac6fd205cedfc7aec00061974355853abfa7f89bb3dc3229d0e02866"} Jul 14 04:59:28.285897 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.285840 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-96.ec2.internal" podStartSLOduration=2.285824083 podStartE2EDuration="2.285824083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:28.285024214 +0000 UTC m=+3.605789577" watchObservedRunningTime="2026-07-14 04:59:28.285824083 +0000 UTC m=+3.606589445" Jul 14 04:59:28.688720 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.688630 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:28.688897 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.688814 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:28.688897 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.688880 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 04:59:30.688860389 +0000 UTC m=+6.009625734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:28.789272 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.789234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:28.789454 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:28.789286 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:28.789454 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.789439 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:28.789661 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.789518 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:30.789499268 +0000 UTC m=+6.110264608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:28.789956 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.789930 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:28.790048 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.789963 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:28.790048 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.789975 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:28.790048 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:28.790025 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 04:59:30.790007945 +0000 UTC m=+6.110773291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:29.104996 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:29.104845 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 04:54:27 +0000 UTC" deadline="2028-01-04 22:25:51.180797812 +0000 UTC" Jul 14 04:59:29.104996 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:29.104927 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12953h26m22.075875115s" Jul 14 04:59:29.250146 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:29.249671 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:29.250146 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:29.249805 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:29.250146 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:29.249919 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:29.250146 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:29.250033 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:29.279762 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:29.279726 2560 generic.go:356] "Generic (PLEG): container finished" podID="d2d7a3a435eaf2a33d2e303e52961b6c" containerID="7a8adc27200304d138e5553f31b545a46aacfea85a8a5361ac39ab49e50f4b20" exitCode=0 Jul 14 04:59:29.279954 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:29.279805 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" event={"ID":"d2d7a3a435eaf2a33d2e303e52961b6c","Type":"ContainerDied","Data":"7a8adc27200304d138e5553f31b545a46aacfea85a8a5361ac39ab49e50f4b20"} Jul 14 04:59:30.247743 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:30.247554 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:30.247743 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.247691 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:30.314676 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:30.314600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" event={"ID":"d2d7a3a435eaf2a33d2e303e52961b6c","Type":"ContainerStarted","Data":"5886e2e3a25815540ed91fddefb311cb0c78486f46e71534a71889c4369ec37f"} Jul 14 04:59:30.331645 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:30.330718 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-96.ec2.internal" podStartSLOduration=4.330667013 podStartE2EDuration="4.330667013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:30.330627549 +0000 UTC m=+5.651392915" watchObservedRunningTime="2026-07-14 04:59:30.330667013 +0000 UTC m=+5.651432378" Jul 14 04:59:30.705641 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:30.705413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:30.705641 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.705599 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:30.705865 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.705677 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.705655159 +0000 UTC m=+10.026420698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:30.806849 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:30.806903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.807058 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.807125 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.807106671 +0000 UTC m=+10.127872017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.807539 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.807561 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.807573 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:30.807664 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:30.807618 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 04:59:34.807603667 +0000 UTC m=+10.128369012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:31.251192 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:31.251158 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:31.251658 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:31.251283 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:31.251724 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:31.251673 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:31.251849 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:31.251768 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:32.247376 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:32.247126 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:32.247376 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:32.247257 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:33.251364 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:33.251282 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:33.251364 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:33.251328 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:33.251889 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:33.251423 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:33.251889 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:33.251573 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:34.247678 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:34.247649 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:34.247872 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.247778 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:34.742709 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:34.742672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:34.743193 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.742848 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:34.743193 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.742919 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 04:59:42.742898634 +0000 UTC m=+18.063663992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:34.843647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:34.843704 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.843874 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.843935 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:42.843918127 +0000 UTC m=+18.164683484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.843981 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.843998 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.844009 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:34.844302 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:34.844049 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 04:59:42.844037024 +0000 UTC m=+18.164802368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:35.249290 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:35.248661 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:35.249290 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:35.248771 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:35.249290 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:35.249144 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:35.249290 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:35.249246 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:36.247496 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:36.247397 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:36.247953 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:36.247558 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:37.247440 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:37.247400 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:37.247440 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:37.247423 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:37.247987 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:37.247547 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:37.247987 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:37.247679 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:38.246953 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:38.246921 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:38.247093 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:38.247055 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:39.247351 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:39.247319 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:39.247832 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:39.247495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:39.247832 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:39.247557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:39.247832 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:39.247650 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:40.247681 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:40.247639 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:40.248127 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:40.247770 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:41.247111 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:41.247069 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:41.247303 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:41.247205 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:41.247303 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:41.247244 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:41.247409 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:41.247322 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:42.247283 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:42.247246 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:42.247801 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.247360 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:42.807093 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:42.807063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:42.807326 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.807227 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:42.807326 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.807302 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 04:59:58.807281972 +0000 UTC m=+34.128047325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:42.908131 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:42.908101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:42.908131 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:42.908143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:42.908377 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.908281 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:42.908377 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.908312 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:42.908377 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.908328 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:42.908532 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.908374 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:42.908532 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.908387 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 04:59:58.908372598 +0000 UTC m=+34.229137940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:42.908532 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:42.908429 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 04:59:58.908412144 +0000 UTC m=+34.229177499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:43.250537 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:43.250500 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:43.250997 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:43.250542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:43.250997 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:43.250629 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:43.250997 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:43.250770 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:44.247661 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:44.247627 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:44.247880 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:44.247747 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:45.248455 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:45.248421 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:45.248886 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:45.248551 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:45.248886 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:45.248608 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:45.248886 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:45.248724 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:46.247766 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:46.247730 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:46.247939 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:46.247875 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:47.247946 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.247869 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:47.248296 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:47.247983 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:47.248296 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.248042 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:47.248296 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:47.248166 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:47.351056 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.351011 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgpgl" event={"ID":"865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e","Type":"ContainerStarted","Data":"d3deb894972e2ad2f1776a5fa13ba41915278f79d7054658e96bf77539c12d6a"} Jul 14 04:59:47.352613 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.352584 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pktpj" event={"ID":"539917cf-5fe2-4860-99e4-c24190995bd6","Type":"ContainerStarted","Data":"2e97cb9e9032858a3475c39f28fb7363358bd6959f1cf3cec5501f6743494330"} Jul 14 04:59:47.354476 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.354430 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lvxpf" event={"ID":"b666e712-652e-43d6-b8e3-821a0768d8a0","Type":"ContainerStarted","Data":"ef133bed9d5b51681ec8e28fb790ee077b7f3443976903158d54f779af1771b4"} Jul 14 04:59:47.356177 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.356143 2560 generic.go:356] "Generic (PLEG): container finished" podID="3c88a251-0244-450f-84d3-6f6c661b1bb2" containerID="097733d420a8c0dc039bb2d9bb34aeaab032ddbc45ad670b469af5e647308506" exitCode=0 Jul 14 04:59:47.356270 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.356216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerDied","Data":"097733d420a8c0dc039bb2d9bb34aeaab032ddbc45ad670b469af5e647308506"} Jul 14 04:59:47.357820 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.357786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f9dv2" event={"ID":"8bb04b68-aa46-482b-bb3b-106ae6ff69c3","Type":"ContainerStarted","Data":"903dee38d1bd7258a90f823deb6f94d9a6994b37db1170295300a3ae04a6373c"} Jul 14 04:59:47.359754 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.359691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" event={"ID":"ce06781e-2c8b-4fdc-8f83-692a591653f5","Type":"ContainerStarted","Data":"f1a4a4a6c75401aa917b6bf1ed3d5e6fc4b53283c6265fa57edc858ea62b6c31"} Jul 14 04:59:47.361090 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.361065 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mn6z8" event={"ID":"cedfbd0a-7dea-496c-9fcc-7fcb7e52259c","Type":"ContainerStarted","Data":"1b242483d05403e21ef067b11f44033c925e0eea4a8beae4088718232021e201"} Jul 14 04:59:47.388268 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.388213 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgpgl" podStartSLOduration=3.679712655 podStartE2EDuration="22.388189833s" totalImagesPullingTime="18.708477178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:47.369324454 +0000 UTC m=+22.690089834" watchObservedRunningTime="2026-07-14 04:59:47.388189833 +0000 UTC m=+22.708955197" Jul 14 04:59:47.403713 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.403667 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pktpj" podStartSLOduration=3.6730253299999998 podStartE2EDuration="22.403642739s" totalImagesPullingTime="18.730617409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:47.388133024 +0000 UTC m=+22.708898387" watchObservedRunningTime="2026-07-14 04:59:47.403642739 +0000 UTC m=+22.724408145" Jul 14 04:59:47.426555 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.426509 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lvxpf" podStartSLOduration=3.69567902 podStartE2EDuration="22.426491657s" totalImagesPullingTime="18.730812637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:47.403785174 +0000 UTC m=+22.724550528" watchObservedRunningTime="2026-07-14 04:59:47.426491657 +0000 UTC m=+22.747256998" Jul 14 04:59:47.442890 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.442842 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f9dv2" podStartSLOduration=3.704694854 podStartE2EDuration="22.442825326s" totalImagesPullingTime="18.738130472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:47.442382832 +0000 UTC m=+22.763148195" watchObservedRunningTime="2026-07-14 04:59:47.442825326 +0000 UTC m=+22.763590688" Jul 14 04:59:47.463372 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:47.463324 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mn6z8" podStartSLOduration=12.101896681 podStartE2EDuration="22.463310298s" totalImagesPullingTime="10.361413617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:47.463049601 +0000 UTC m=+22.783814983" watchObservedRunningTime="2026-07-14 04:59:47.463310298 +0000 UTC m=+22.784075662" Jul 14 04:59:48.247634 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.247390 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:48.247806 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:48.247715 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:48.367599 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.367511 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368016 2560 generic.go:356] "Generic (PLEG): container finished" podID="108c5802-60a1-4d8d-aeb0-be2e47e67a3a" containerID="a7fa9a6643c8481f802516ea06010a2532d022b3eaaf542da54614e0171f8408" exitCode=1 Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"27308aad06a2fdb2dd977cac267aea6a115934ad7283d66f2a7248e9584bd600"} Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368197 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"522110819a48065221abaf7fe294f796e50ae64efe144f7f04330bda3225ff6d"} Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368246 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"56ed5bc1925d207276d5c6bbbfe8818904f00ad68ddb5691f6fff1a4338e458d"} Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368292 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"7b389d311e4762f785d11b7d427d12e1c9d240fb9441118810ebfa98b9d6fa4d"} Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368332 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerDied","Data":"a7fa9a6643c8481f802516ea06010a2532d022b3eaaf542da54614e0171f8408"} Jul 14 04:59:48.368420 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.368375 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"019dc769322c93b9c28cf5499306eeacd2e08cf5e21226cc278a91edfa433562"} Jul 14 04:59:48.370287 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.370258 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p8qxj" event={"ID":"b3f3c541-7373-4636-8662-5fddc1d28fc3","Type":"ContainerStarted","Data":"f1e7ba9f1b6962a358bb3e5bfdabd3eb40922f29dfb39f00b12174c7f3b4b570"} Jul 14 04:59:48.386412 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.386358 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p8qxj" podStartSLOduration=4.6629444719999995 podStartE2EDuration="23.386342832s" totalImagesPullingTime="18.72339836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:48.385852952 +0000 UTC m=+23.706618315" watchObservedRunningTime="2026-07-14 04:59:48.386342832 +0000 UTC m=+23.707108195" Jul 14 04:59:48.443280 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:48.443203 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 04:59:49.140948 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.140844 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T04:59:48.443227576Z","UUID":"819675a2-1687-4622-b057-c513ac6ac928","Handler":null,"Name":"","Endpoint":""} Jul 14 04:59:49.142609 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.142582 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 04:59:49.142745 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.142632 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 04:59:49.247954 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.247917 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:49.248132 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:49.248055 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:49.248401 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.248386 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:49.248543 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:49.248521 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:49.272860 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.272825 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:49.273571 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.273549 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:49.375083 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.375042 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" event={"ID":"ce06781e-2c8b-4fdc-8f83-692a591653f5","Type":"ContainerStarted","Data":"f57786474da05620c4a07d993b592bbd63288314c2d8940a34d06974085f072e"} Jul 14 04:59:49.375590 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.375351 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:49.376000 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:49.375981 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mn6z8" Jul 14 04:59:50.247581 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:50.247547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:50.247770 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:50.247686 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:50.380255 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:50.380214 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" event={"ID":"ce06781e-2c8b-4fdc-8f83-692a591653f5","Type":"ContainerStarted","Data":"2f510c62a518924bae69f0110a9898b6e474917f847648e285e35cc062bb8d0d"} Jul 14 04:59:50.399165 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:50.399104 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wv5cn" podStartSLOduration=4.416186855 podStartE2EDuration="25.399079781s" totalImagesPullingTime="20.982892926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:50.398821348 +0000 UTC m=+25.719586712" watchObservedRunningTime="2026-07-14 04:59:50.399079781 +0000 UTC m=+25.719845146" Jul 14 04:59:51.247405 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:51.247214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:51.247599 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:51.247247 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:51.247599 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:51.247498 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:51.247599 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:51.247554 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:51.789329 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:51.789268 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvxpf_b666e712-652e-43d6-b8e3-821a0768d8a0/dns-node-resolver/0.log" Jul 14 04:59:52.247739 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:52.247703 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:52.247952 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:52.247805 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:52.386876 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:52.386838 2560 generic.go:356] "Generic (PLEG): container finished" podID="3c88a251-0244-450f-84d3-6f6c661b1bb2" containerID="ec676523e6a08ec9ab6d0fd425f6eaaa3e2f0113a1ebbe0a78e464788bda5b65" exitCode=0 Jul 14 04:59:52.387143 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:52.386935 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerDied","Data":"ec676523e6a08ec9ab6d0fd425f6eaaa3e2f0113a1ebbe0a78e464788bda5b65"} Jul 14 04:59:52.390248 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:52.390230 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 04:59:52.390616 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:52.390596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"9f33c50acccf7e5ea0c145cb4a0253375858f4e696444a9d5275a9ca1226114a"} Jul 14 04:59:53.169976 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:53.169945 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgpgl_865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e/node-ca/0.log" Jul 14 04:59:53.247251 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:53.247162 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:53.247399 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:53.247170 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:53.247399 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:53.247307 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:53.247399 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:53.247349 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:54.247562 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.247344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:54.248066 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:54.247635 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:54.396310 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.396277 2560 generic.go:356] "Generic (PLEG): container finished" podID="3c88a251-0244-450f-84d3-6f6c661b1bb2" containerID="6fc48ec37c5895d57b7117bf8485850760686c07cc9beb8f20dbfe40a4b9ffca" exitCode=0 Jul 14 04:59:54.396555 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.396356 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerDied","Data":"6fc48ec37c5895d57b7117bf8485850760686c07cc9beb8f20dbfe40a4b9ffca"} Jul 14 04:59:54.399773 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.399757 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 04:59:54.400126 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.400105 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"020669420cb102f45330afd652173bfc429068c5754da4d9215b0a4b51d78e12"} Jul 14 04:59:54.400350 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.400334 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:54.400510 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.400496 2560 scope.go:117] "RemoveContainer" containerID="a7fa9a6643c8481f802516ea06010a2532d022b3eaaf542da54614e0171f8408" Jul 14 04:59:54.416657 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:54.416631 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:55.248513 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.248480 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:55.248990 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:55.248587 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:55.248990 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.248597 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:55.248990 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:55.248694 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:55.405514 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.405487 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 04:59:55.405826 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.405803 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" event={"ID":"108c5802-60a1-4d8d-aeb0-be2e47e67a3a","Type":"ContainerStarted","Data":"fded19d2f464bf6ad4e95d21735f9bcc04b09921a033a13b27d251384c7af9da"} Jul 14 04:59:55.405972 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.405959 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:55.406016 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.406004 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:55.422212 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.422186 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 04:59:55.470588 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:55.470534 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" podStartSLOduration=11.240068769 podStartE2EDuration="30.470519238s" totalImagesPullingTime="19.230450469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 04:59:55.470404889 +0000 UTC m=+30.791170253" watchObservedRunningTime="2026-07-14 04:59:55.470519238 +0000 UTC m=+30.791284602" Jul 14 04:59:56.247357 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:56.247320 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:56.247524 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:56.247423 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:56.409876 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:56.409838 2560 generic.go:356] "Generic (PLEG): container finished" podID="3c88a251-0244-450f-84d3-6f6c661b1bb2" containerID="4540dcdc059c21b05c29df4c098200b011ec556a0a7aaaa61554665620196e3c" exitCode=0 Jul 14 04:59:56.410320 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:56.409915 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerDied","Data":"4540dcdc059c21b05c29df4c098200b011ec556a0a7aaaa61554665620196e3c"} Jul 14 04:59:57.247592 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:57.247543 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:57.247592 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:57.247592 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:57.247793 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:57.247683 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 04:59:57.247867 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:57.247835 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:58.247262 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:58.247225 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:58.247790 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.247370 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 04:59:58.821331 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:58.821294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:58.821561 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.821427 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:58.821561 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.821509 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs podName:c4e4f4e9-23c4-4351-9058-5593fae027ec nodeName:}" failed. No retries permitted until 2026-07-14 05:00:30.821493939 +0000 UTC m=+66.142259283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs") pod "network-metrics-daemon-q8tq9" (UID: "c4e4f4e9-23c4-4351-9058-5593fae027ec") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 04:59:58.921660 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:58.921616 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 04:59:58.921853 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:58.921714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:58.921853 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.921793 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:58.921853 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.921832 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 04:59:58.921853 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.921849 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 04:59:58.922038 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.921863 2560 projected.go:196] Error preparing data for projected volume kube-api-access-9wmzf for pod openshift-network-diagnostics/network-check-target-z9zls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:58.922038 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.921875 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret podName:1ea96973-aa43-444d-9bf1-1809b00cf89a nodeName:}" failed. No retries permitted until 2026-07-14 05:00:30.921851792 +0000 UTC m=+66.242617135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret") pod "global-pull-secret-syncer-kmvxx" (UID: "1ea96973-aa43-444d-9bf1-1809b00cf89a") : object "kube-system"/"original-pull-secret" not registered Jul 14 04:59:58.922038 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:58.921912 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf podName:b2d58eda-602f-4b76-9cf1-6a459b1e26ae nodeName:}" failed. No retries permitted until 2026-07-14 05:00:30.921896541 +0000 UTC m=+66.242661899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wmzf" (UniqueName: "kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf") pod "network-check-target-z9zls" (UID: "b2d58eda-602f-4b76-9cf1-6a459b1e26ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 04:59:59.247854 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:59.247816 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 04:59:59.248288 ip-10-0-142-96 kubenswrapper[2560]: I0714 04:59:59.247816 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 04:59:59.248288 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:59.247970 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 04:59:59.248288 ip-10-0-142-96 kubenswrapper[2560]: E0714 04:59:59.248032 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:00.247551 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:00.247518 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:00.247720 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:00.247631 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:00.424244 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:00.424019 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerStarted","Data":"cb1424a88aa0db7a13495e63a0dfd5ebf9c5eabce555f0ba55a3d4c12a0ff45b"} Jul 14 05:00:01.247278 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:01.247239 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:01.247448 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:01.247375 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:01.247448 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:01.247422 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:01.247576 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:01.247554 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:01.428349 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:01.428316 2560 generic.go:356] "Generic (PLEG): container finished" podID="3c88a251-0244-450f-84d3-6f6c661b1bb2" containerID="cb1424a88aa0db7a13495e63a0dfd5ebf9c5eabce555f0ba55a3d4c12a0ff45b" exitCode=0 Jul 14 05:00:01.428349 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:01.428353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerDied","Data":"cb1424a88aa0db7a13495e63a0dfd5ebf9c5eabce555f0ba55a3d4c12a0ff45b"} Jul 14 05:00:02.246846 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:02.246802 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:02.247030 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:02.246910 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:02.433223 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:02.433193 2560 generic.go:356] "Generic (PLEG): container finished" podID="3c88a251-0244-450f-84d3-6f6c661b1bb2" containerID="d7864491e41f3e6dd1f19d870b74609bcf5ea493e455274c1aeb4d35d554f928" exitCode=0 Jul 14 05:00:02.433590 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:02.433231 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerDied","Data":"d7864491e41f3e6dd1f19d870b74609bcf5ea493e455274c1aeb4d35d554f928"} Jul 14 05:00:03.247557 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:03.247523 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:03.247557 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:03.247536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:03.247839 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:03.247616 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:03.247839 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:03.247760 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:03.438550 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:03.438522 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" event={"ID":"3c88a251-0244-450f-84d3-6f6c661b1bb2","Type":"ContainerStarted","Data":"c280516b8228869d89ec22c55e930d5491d97423fd38a985524c6d535e9bda91"} Jul 14 05:00:03.465220 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:03.465172 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wzfhr" podStartSLOduration=9.416742256 podStartE2EDuration="38.465157547s" totalImagesPullingTime="29.048415291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:03.464935699 +0000 UTC m=+38.785701062" watchObservedRunningTime="2026-07-14 05:00:03.465157547 +0000 UTC m=+38.785922910" Jul 14 05:00:04.247641 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:04.247603 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:04.247813 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:04.247709 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:05.248008 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:05.247975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:05.248393 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:05.248059 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:05.248393 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:05.248060 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:05.248393 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:05.248127 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:06.247188 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:06.247156 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:06.247364 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:06.247268 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:07.247542 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:07.247507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:07.247542 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:07.247542 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:07.247974 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:07.247616 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:07.247974 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:07.247725 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:08.246975 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:08.246938 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:08.247145 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:08.247048 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:09.247093 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:09.247059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:09.247491 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:09.247059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:09.247491 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:09.247167 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:09.247491 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:09.247237 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:10.247611 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:10.247579 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:10.247960 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:10.247681 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:11.247439 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:11.247400 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:11.247612 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:11.247527 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:11.247612 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:11.247603 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:11.247899 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:11.247691 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:12.247750 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:12.247708 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:12.248179 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:12.247846 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:13.246895 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:13.246859 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:13.247079 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:13.246974 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:13.247079 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:13.247028 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:13.247149 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:13.247110 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:14.247592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:14.247557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:14.248119 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:14.247662 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:15.247778 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:15.247741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:15.248249 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:15.247844 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:15.248249 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:15.247912 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:15.248249 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:15.247994 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:16.246856 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:16.246824 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:16.247035 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:16.246933 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:17.246926 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:17.246892 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:17.247407 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:17.246994 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:17.247407 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:17.247048 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:17.247407 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:17.247118 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:18.247728 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.247691 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:18.248204 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:18.247800 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:18.859672 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.859640 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmvxx"] Jul 14 05:00:18.859868 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.859786 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:18.859938 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:18.859903 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:18.861992 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.861962 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q8tq9"] Jul 14 05:00:18.862139 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.862078 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:18.862229 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:18.862207 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:18.862703 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.862680 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9zls"] Jul 14 05:00:18.862825 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:18.862755 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:18.862896 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:18.862843 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:20.247571 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:20.247367 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:20.248130 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:20.247410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:20.248130 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:20.247642 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:20.248130 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:20.247433 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:20.248130 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:20.247715 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:20.248130 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:20.247799 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:22.247440 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:22.247405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:22.247847 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:22.247405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:22.247847 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:22.247534 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kmvxx" podUID="1ea96973-aa43-444d-9bf1-1809b00cf89a" Jul 14 05:00:22.247847 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:22.247405 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:22.247847 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:22.247602 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q8tq9" podUID="c4e4f4e9-23c4-4351-9058-5593fae027ec" Jul 14 05:00:22.247847 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:22.247657 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9zls" podUID="b2d58eda-602f-4b76-9cf1-6a459b1e26ae" Jul 14 05:00:23.033327 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.033301 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-96.ec2.internal" event="NodeReady" Jul 14 05:00:23.033512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.033436 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 05:00:23.080187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.080157 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7np52"] Jul 14 05:00:23.081962 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.081945 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.084794 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.084770 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 05:00:23.084950 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.084857 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 05:00:23.084950 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.084863 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nm2tc\"" Jul 14 05:00:23.085073 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.085013 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 05:00:23.087502 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.087481 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bmmhp"] Jul 14 05:00:23.090057 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.090037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.092587 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.092569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 05:00:23.092817 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.092802 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 05:00:23.092905 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.092855 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6l8db\"" Jul 14 05:00:23.094232 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.094213 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7np52"] Jul 14 05:00:23.105659 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.105631 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmmhp"] Jul 14 05:00:23.108940 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.108918 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7vdzd"] Jul 14 05:00:23.110675 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.110656 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.113722 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.113700 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 05:00:23.113722 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.113721 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 05:00:23.113876 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.113756 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 05:00:23.113876 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.113777 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 05:00:23.113876 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.113789 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5h9dw\"" Jul 14 05:00:23.122200 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.122179 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7vdzd"] Jul 14 05:00:23.197140 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fc7b090-f345-4c8c-af65-7b548ec27799-cert\") pod \"ingress-canary-7np52\" (UID: \"6fc7b090-f345-4c8c-af65-7b548ec27799\") " pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.197140 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41bab6bc-bf01-452b-a893-4b16a897001c-tmp-dir\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.197335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197173 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4f40e57-96f9-413a-bb30-7dde49268b82-crio-socket\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.197335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4f40e57-96f9-413a-bb30-7dde49268b82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.197335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197257 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4f40e57-96f9-413a-bb30-7dde49268b82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.197335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxswn\" (UniqueName: \"kubernetes.io/projected/41bab6bc-bf01-452b-a893-4b16a897001c-kube-api-access-nxswn\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.197335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqqx7\" (UniqueName: \"kubernetes.io/projected/d4f40e57-96f9-413a-bb30-7dde49268b82-kube-api-access-rqqx7\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.197514 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g8z7\" (UniqueName: \"kubernetes.io/projected/6fc7b090-f345-4c8c-af65-7b548ec27799-kube-api-access-9g8z7\") pod \"ingress-canary-7np52\" (UID: \"6fc7b090-f345-4c8c-af65-7b548ec27799\") " pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.197514 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41bab6bc-bf01-452b-a893-4b16a897001c-metrics-tls\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.197514 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197393 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4f40e57-96f9-413a-bb30-7dde49268b82-data-volume\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.197514 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.197409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41bab6bc-bf01-452b-a893-4b16a897001c-config-volume\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.297992 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.297902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxswn\" (UniqueName: \"kubernetes.io/projected/41bab6bc-bf01-452b-a893-4b16a897001c-kube-api-access-nxswn\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.297992 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.297939 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqqx7\" (UniqueName: \"kubernetes.io/projected/d4f40e57-96f9-413a-bb30-7dde49268b82-kube-api-access-rqqx7\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.297992 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.297958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8z7\" (UniqueName: \"kubernetes.io/projected/6fc7b090-f345-4c8c-af65-7b548ec27799-kube-api-access-9g8z7\") pod \"ingress-canary-7np52\" (UID: \"6fc7b090-f345-4c8c-af65-7b548ec27799\") " pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.297992 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.297975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41bab6bc-bf01-452b-a893-4b16a897001c-metrics-tls\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.297992 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.297993 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4f40e57-96f9-413a-bb30-7dde49268b82-data-volume\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41bab6bc-bf01-452b-a893-4b16a897001c-config-volume\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fc7b090-f345-4c8c-af65-7b548ec27799-cert\") pod \"ingress-canary-7np52\" (UID: \"6fc7b090-f345-4c8c-af65-7b548ec27799\") " pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298198 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41bab6bc-bf01-452b-a893-4b16a897001c-tmp-dir\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298234 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4f40e57-96f9-413a-bb30-7dde49268b82-crio-socket\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298258 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4f40e57-96f9-413a-bb30-7dde49268b82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298435 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4f40e57-96f9-413a-bb30-7dde49268b82-data-volume\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298603 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d4f40e57-96f9-413a-bb30-7dde49268b82-crio-socket\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298631 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4f40e57-96f9-413a-bb30-7dde49268b82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.298654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298637 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41bab6bc-bf01-452b-a893-4b16a897001c-tmp-dir\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.298958 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.298759 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41bab6bc-bf01-452b-a893-4b16a897001c-config-volume\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.299069 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.299052 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d4f40e57-96f9-413a-bb30-7dde49268b82-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.302149 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.302127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d4f40e57-96f9-413a-bb30-7dde49268b82-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.302254 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.302191 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41bab6bc-bf01-452b-a893-4b16a897001c-metrics-tls\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.302435 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.302415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fc7b090-f345-4c8c-af65-7b548ec27799-cert\") pod \"ingress-canary-7np52\" (UID: \"6fc7b090-f345-4c8c-af65-7b548ec27799\") " pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.305950 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.305923 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqqx7\" (UniqueName: \"kubernetes.io/projected/d4f40e57-96f9-413a-bb30-7dde49268b82-kube-api-access-rqqx7\") pod \"insights-runtime-extractor-7vdzd\" (UID: \"d4f40e57-96f9-413a-bb30-7dde49268b82\") " pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.306064 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.306047 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8z7\" (UniqueName: \"kubernetes.io/projected/6fc7b090-f345-4c8c-af65-7b548ec27799-kube-api-access-9g8z7\") pod \"ingress-canary-7np52\" (UID: \"6fc7b090-f345-4c8c-af65-7b548ec27799\") " pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.306413 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.306394 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxswn\" (UniqueName: \"kubernetes.io/projected/41bab6bc-bf01-452b-a893-4b16a897001c-kube-api-access-nxswn\") pod \"dns-default-bmmhp\" (UID: \"41bab6bc-bf01-452b-a893-4b16a897001c\") " pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.391530 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.391476 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7np52" Jul 14 05:00:23.399276 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.399247 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:23.419202 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.419164 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7vdzd" Jul 14 05:00:23.528873 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.527652 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84f4b6d74f-2t2vd"] Jul 14 05:00:23.530042 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.529969 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.544170 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.544129 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 05:00:23.544325 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.544129 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 05:00:23.544325 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.544129 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gln6k\"" Jul 14 05:00:23.544684 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.544667 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 05:00:23.546700 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.546670 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 05:00:23.546790 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.546738 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 05:00:23.546948 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.546680 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 05:00:23.547225 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.547205 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 05:00:23.547720 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.547703 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f4b6d74f-2t2vd"] Jul 14 05:00:23.565453 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.565422 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7np52"] Jul 14 05:00:23.569259 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:23.569236 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc7b090_f345_4c8c_af65_7b548ec27799.slice/crio-e2d2f958bfda58e7be9dcc45aa9cf637e23f342ecc2d0801b97f4bdd9e65777b WatchSource:0}: Error finding container e2d2f958bfda58e7be9dcc45aa9cf637e23f342ecc2d0801b97f4bdd9e65777b: Status 404 returned error can't find the container with id e2d2f958bfda58e7be9dcc45aa9cf637e23f342ecc2d0801b97f4bdd9e65777b Jul 14 05:00:23.581600 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.581576 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bmmhp"] Jul 14 05:00:23.584260 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:23.584231 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41bab6bc_bf01_452b_a893_4b16a897001c.slice/crio-df846f9987fd4cb37efae49903c8f6c727fb071a76347b208e1e133d1ee6e82d WatchSource:0}: Error finding container df846f9987fd4cb37efae49903c8f6c727fb071a76347b208e1e133d1ee6e82d: Status 404 returned error can't find the container with id df846f9987fd4cb37efae49903c8f6c727fb071a76347b208e1e133d1ee6e82d Jul 14 05:00:23.598645 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.598621 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7vdzd"] Jul 14 05:00:23.600819 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.600789 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmd2m\" (UniqueName: \"kubernetes.io/projected/ab58022b-4137-48c5-b569-3e527b4149c1-kube-api-access-mmd2m\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.600928 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.600869 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-serving-cert\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.600987 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.600927 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-oauth-serving-cert\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.600987 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.600955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-service-ca\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.601079 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.600989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-oauth-config\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.601079 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.601027 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-console-config\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.601379 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:23.601359 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f40e57_96f9_413a_bb30_7dde49268b82.slice/crio-e564220c93b1cf7850bed17ea3c493b472ff5888abd638eea3086aa581f72ba9 WatchSource:0}: Error finding container e564220c93b1cf7850bed17ea3c493b472ff5888abd638eea3086aa581f72ba9: Status 404 returned error can't find the container with id e564220c93b1cf7850bed17ea3c493b472ff5888abd638eea3086aa581f72ba9 Jul 14 05:00:23.702254 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.702213 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-serving-cert\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.702451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.702264 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-oauth-serving-cert\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.702451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.702290 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-service-ca\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.702451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.702315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-oauth-config\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.702451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.702351 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-console-config\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.702451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.702391 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmd2m\" (UniqueName: \"kubernetes.io/projected/ab58022b-4137-48c5-b569-3e527b4149c1-kube-api-access-mmd2m\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.703225 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.703202 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-oauth-serving-cert\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.703334 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.703280 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-console-config\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.703334 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.703309 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-service-ca\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.704794 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.704773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-oauth-config\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.704879 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.704782 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-serving-cert\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.710547 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.710531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmd2m\" (UniqueName: \"kubernetes.io/projected/ab58022b-4137-48c5-b569-3e527b4149c1-kube-api-access-mmd2m\") pod \"console-84f4b6d74f-2t2vd\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.841353 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.841267 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:23.960908 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:23.960874 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84f4b6d74f-2t2vd"] Jul 14 05:00:23.963933 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:23.963896 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab58022b_4137_48c5_b569_3e527b4149c1.slice/crio-ed83702e9cb0a2e460b228a4d789e46af40489f6b26cdd656523104db9f450b6 WatchSource:0}: Error finding container ed83702e9cb0a2e460b228a4d789e46af40489f6b26cdd656523104db9f450b6: Status 404 returned error can't find the container with id ed83702e9cb0a2e460b228a4d789e46af40489f6b26cdd656523104db9f450b6 Jul 14 05:00:24.247955 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.247800 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:24.247955 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.247825 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:24.247955 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.247826 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:24.255099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.253475 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 05:00:24.255099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.253706 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 05:00:24.255099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.253928 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 05:00:24.255099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.254119 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 05:00:24.255099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.254304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jntlj\"" Jul 14 05:00:24.255099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.254500 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpjvf\"" Jul 14 05:00:24.499882 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.499775 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7np52" event={"ID":"6fc7b090-f345-4c8c-af65-7b548ec27799","Type":"ContainerStarted","Data":"e2d2f958bfda58e7be9dcc45aa9cf637e23f342ecc2d0801b97f4bdd9e65777b"} Jul 14 05:00:24.504311 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.504275 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmmhp" event={"ID":"41bab6bc-bf01-452b-a893-4b16a897001c","Type":"ContainerStarted","Data":"df846f9987fd4cb37efae49903c8f6c727fb071a76347b208e1e133d1ee6e82d"} Jul 14 05:00:24.508009 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.507970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f4b6d74f-2t2vd" event={"ID":"ab58022b-4137-48c5-b569-3e527b4149c1","Type":"ContainerStarted","Data":"ed83702e9cb0a2e460b228a4d789e46af40489f6b26cdd656523104db9f450b6"} Jul 14 05:00:24.513327 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:24.513295 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdzd" event={"ID":"d4f40e57-96f9-413a-bb30-7dde49268b82","Type":"ContainerStarted","Data":"e564220c93b1cf7850bed17ea3c493b472ff5888abd638eea3086aa581f72ba9"} Jul 14 05:00:27.423853 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:27.423822 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gczhh" Jul 14 05:00:29.303510 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.303451 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs"] Jul 14 05:00:29.309235 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.309202 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.312063 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.312034 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 14 05:00:29.312221 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.312125 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 05:00:29.312221 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.312173 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 14 05:00:29.312335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.312126 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 05:00:29.313508 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.313486 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 05:00:29.313631 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.313555 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bv62h\"" Jul 14 05:00:29.316333 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.316306 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs"] Jul 14 05:00:29.320003 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.319984 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-vspn6"] Jul 14 05:00:29.322889 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.322872 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.326708 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.326689 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 05:00:29.326818 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.326753 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 05:00:29.326818 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.326768 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 05:00:29.327081 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.327060 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6skzg\"" Jul 14 05:00:29.342767 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.342739 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-vspn6"] Jul 14 05:00:29.351322 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351252 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr9h6\" (UniqueName: \"kubernetes.io/projected/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-kube-api-access-zr9h6\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.351322 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351296 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.351569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351353 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.351569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351376 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.351569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q55k8\" (UniqueName: \"kubernetes.io/projected/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-api-access-q55k8\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.351569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351494 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.351569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.351569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.351876 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351638 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/062c49a8-ece7-412a-bd62-96ec663e4ca7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.351876 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.351672 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/062c49a8-ece7-412a-bd62-96ec663e4ca7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.352588 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.352565 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fwhsg"] Jul 14 05:00:29.355760 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.355741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.358803 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.358551 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 05:00:29.358803 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.358556 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 05:00:29.358803 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.358561 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 05:00:29.358803 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.358677 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m22l6\"" Jul 14 05:00:29.452774 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.452735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-tls\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.452774 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.452768 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-metrics-client-ca\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.452989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.452844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q55k8\" (UniqueName: \"kubernetes.io/projected/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-api-access-q55k8\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.452989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.452904 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-root\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.452989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.452940 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.452989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.452972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.453149 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453002 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.453149 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/062c49a8-ece7-412a-bd62-96ec663e4ca7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.453149 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/062c49a8-ece7-412a-bd62-96ec663e4ca7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.453149 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453091 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m69mx\" (UniqueName: \"kubernetes.io/projected/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-kube-api-access-m69mx\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.453149 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr9h6\" (UniqueName: \"kubernetes.io/projected/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-kube-api-access-zr9h6\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.453402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-wtmp\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.453402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.453402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453207 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.453402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-sys\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.453402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453311 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.453402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.453832 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-textfile\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.453832 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453452 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/062c49a8-ece7-412a-bd62-96ec663e4ca7-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.453832 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.453832 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:29.453615 2560 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 05:00:29.453832 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:29.453682 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-tls podName:062c49a8-ece7-412a-bd62-96ec663e4ca7 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:29.953664024 +0000 UTC m=+65.274429368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-vspn6" (UID: "062c49a8-ece7-412a-bd62-96ec663e4ca7") : secret "kube-state-metrics-tls" not found Jul 14 05:00:29.454055 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.453904 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.454102 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.454074 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.454151 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.454124 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/062c49a8-ece7-412a-bd62-96ec663e4ca7-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.455944 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.455911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.456078 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.456059 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.456140 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.456110 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.462540 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.462519 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr9h6\" (UniqueName: \"kubernetes.io/projected/4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389-kube-api-access-zr9h6\") pod \"openshift-state-metrics-84bd68b896-k5dgs\" (UID: \"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.462540 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.462529 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q55k8\" (UniqueName: \"kubernetes.io/projected/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-api-access-q55k8\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.554939 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.554901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-textfile\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555124 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.554974 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-tls\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555124 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.554998 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-metrics-client-ca\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555124 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-root\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555124 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m69mx\" (UniqueName: \"kubernetes.io/projected/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-kube-api-access-m69mx\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-wtmp\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:29.555166 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555186 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-root\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:29.555245 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-tls podName:0bd1b775-cf5e-4a94-b68b-d7b23ad23c33 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:30.055222471 +0000 UTC m=+65.375987818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-tls") pod "node-exporter-fwhsg" (UID: "0bd1b775-cf5e-4a94-b68b-d7b23ad23c33") : secret "node-exporter-tls" not found Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555259 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-wtmp\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555321 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555304 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-textfile\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555627 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-sys\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555627 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555341 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-sys\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555627 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555760 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555623 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-metrics-client-ca\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.555864 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.555838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-accelerators-collector-config\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.557726 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.557705 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.565247 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.565225 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m69mx\" (UniqueName: \"kubernetes.io/projected/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-kube-api-access-m69mx\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:29.621138 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.621053 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" Jul 14 05:00:29.960078 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.960039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:29.962806 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:29.962784 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/062c49a8-ece7-412a-bd62-96ec663e4ca7-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-vspn6\" (UID: \"062c49a8-ece7-412a-bd62-96ec663e4ca7\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:30.060733 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.060624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-tls\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:30.063315 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.063295 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0bd1b775-cf5e-4a94-b68b-d7b23ad23c33-node-exporter-tls\") pod \"node-exporter-fwhsg\" (UID: \"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33\") " pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:30.166235 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.165756 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs"] Jul 14 05:00:30.232738 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.232717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" Jul 14 05:00:30.265729 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.265557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fwhsg" Jul 14 05:00:30.392556 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.392514 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-vspn6"] Jul 14 05:00:30.393590 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.393570 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:00:30.395218 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:30.395198 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062c49a8_ece7_412a_bd62_96ec663e4ca7.slice/crio-5d58567cd6c0ca015478a538b39dc8904f496614cd64879fde4944c121f858b1 WatchSource:0}: Error finding container 5d58567cd6c0ca015478a538b39dc8904f496614cd64879fde4944c121f858b1: Status 404 returned error can't find the container with id 5d58567cd6c0ca015478a538b39dc8904f496614cd64879fde4944c121f858b1 Jul 14 05:00:30.396721 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.396703 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.403234 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.402972 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 05:00:30.403312 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403246 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 05:00:30.403370 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403321 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kv8x9\"" Jul 14 05:00:30.403589 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 05:00:30.403652 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403573 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 05:00:30.403652 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403639 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 05:00:30.403748 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403647 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 05:00:30.403748 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403656 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 05:00:30.403748 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403730 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 05:00:30.403976 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.403959 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 05:00:30.413951 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.413923 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:00:30.463912 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.463827 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7nbq\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-kube-api-access-s7nbq\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.463912 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.463870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.463912 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.463889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-config-out\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.463912 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.463909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.463990 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-web-config\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464381 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464381 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.464381 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.464317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.533740 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.533705 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmmhp" event={"ID":"41bab6bc-bf01-452b-a893-4b16a897001c","Type":"ContainerStarted","Data":"e6b1d119b5c529bfeae0ddd71121dbb3ed44c53b06aa1d199655b206ba4a85fc"} Jul 14 05:00:30.533924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.533758 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bmmhp" event={"ID":"41bab6bc-bf01-452b-a893-4b16a897001c","Type":"ContainerStarted","Data":"ac6ccc9d3e849d52cc8ff86a3263141a66b8d6a88764252f1275a4fe6ceb92cd"} Jul 14 05:00:30.533924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.533805 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:30.535023 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.534995 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwhsg" event={"ID":"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33","Type":"ContainerStarted","Data":"62a173626ccc7012520e49b655a19d1f6176c24ac4bf17621ef293d2580e5854"} Jul 14 05:00:30.536410 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.536388 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f4b6d74f-2t2vd" event={"ID":"ab58022b-4137-48c5-b569-3e527b4149c1","Type":"ContainerStarted","Data":"aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655"} Jul 14 05:00:30.541757 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.541734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdzd" event={"ID":"d4f40e57-96f9-413a-bb30-7dde49268b82","Type":"ContainerStarted","Data":"12aa6b2a8b5d3b83e01adb740bfc0f16c2a5929a160bc2b8a4d01efdb0fb621f"} Jul 14 05:00:30.542799 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.542778 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" event={"ID":"062c49a8-ece7-412a-bd62-96ec663e4ca7","Type":"ContainerStarted","Data":"5d58567cd6c0ca015478a538b39dc8904f496614cd64879fde4944c121f858b1"} Jul 14 05:00:30.544028 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.544009 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7np52" event={"ID":"6fc7b090-f345-4c8c-af65-7b548ec27799","Type":"ContainerStarted","Data":"2a5c8db3b2e93a5dc92a2da979b25af933876254256036ace335cc240fac60d2"} Jul 14 05:00:30.545637 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.545616 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" event={"ID":"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389","Type":"ContainerStarted","Data":"eddb8b7e85ea27a28e76e6bbf73cb4365f652a08085080f36ce723d63723d68e"} Jul 14 05:00:30.545714 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.545684 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" event={"ID":"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389","Type":"ContainerStarted","Data":"64f0ad09d6328ff4d09bf350bf55e375d9d68bc8f1f8f6fa0f5c88909e750abb"} Jul 14 05:00:30.545714 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.545703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" event={"ID":"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389","Type":"ContainerStarted","Data":"36f46a1d1aa444070f59a54e43b79fb7b49dd29c7111e4735f8f52ee1b03df0a"} Jul 14 05:00:30.552572 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.552529 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bmmhp" podStartSLOduration=1.117551041 podStartE2EDuration="7.552516247s" totalImagesPullingTime="6.434965206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:30.551399214 +0000 UTC m=+65.872164577" watchObservedRunningTime="2026-07-14 05:00:30.552516247 +0000 UTC m=+65.873281599" Jul 14 05:00:30.565557 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.565526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7nbq\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-kube-api-access-s7nbq\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.565679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.565580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.565679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.565611 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-config-out\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.565960 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566094 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566166 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566511 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566206 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566511 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566228 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-web-config\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566511 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566511 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566304 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566899 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:30.566591 2560 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 14 05:00:30.566899 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.566899 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:30.566650 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls podName:9760021e-488e-45b7-8ad0-c0a7979859e1 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:31.066632499 +0000 UTC m=+66.387397843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1") : secret "alertmanager-main-tls" not found Jul 14 05:00:30.566899 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.566845 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.567114 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:00:30.566986 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle podName:9760021e-488e-45b7-8ad0-c0a7979859e1 nodeName:}" failed. No retries permitted until 2026-07-14 05:00:31.066967648 +0000 UTC m=+66.387733006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1") : configmap references non-existent config key: ca-bundle.crt Jul 14 05:00:30.567580 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.567230 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.567580 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.567421 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7np52" podStartSLOduration=1.117469863 podStartE2EDuration="7.567404904s" totalImagesPullingTime="6.449935041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:30.565427728 +0000 UTC m=+65.886193117" watchObservedRunningTime="2026-07-14 05:00:30.567404904 +0000 UTC m=+65.888170268" Jul 14 05:00:30.569569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.569526 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-config-out\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.570131 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.570098 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.570302 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.570281 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.570759 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.570738 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.570858 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.570788 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.570858 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.570813 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.570858 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.570791 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-web-config\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.571099 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.571079 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.578883 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.578859 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7nbq\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-kube-api-access-s7nbq\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:30.584522 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.584481 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84f4b6d74f-2t2vd" podStartSLOduration=1.529026861 podStartE2EDuration="7.58445162s" totalImagesPullingTime="6.055424759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:30.583451056 +0000 UTC m=+65.904216421" watchObservedRunningTime="2026-07-14 05:00:30.58445162 +0000 UTC m=+65.905216961" Jul 14 05:00:30.869251 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.869170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:30.872221 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.872197 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 05:00:30.881828 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.881806 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4e4f4e9-23c4-4351-9058-5593fae027ec-metrics-certs\") pod \"network-metrics-daemon-q8tq9\" (UID: \"c4e4f4e9-23c4-4351-9058-5593fae027ec\") " pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:30.890622 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.890594 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jntlj\"" Jul 14 05:00:30.898200 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.898175 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q8tq9" Jul 14 05:00:30.970198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.970170 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:30.970358 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.970240 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:30.973114 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.973091 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 05:00:30.973239 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.973126 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 05:00:30.983913 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.983881 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 05:00:30.984426 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.984402 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ea96973-aa43-444d-9bf1-1809b00cf89a-original-pull-secret\") pod \"global-pull-secret-syncer-kmvxx\" (UID: \"1ea96973-aa43-444d-9bf1-1809b00cf89a\") " pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:30.995064 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:30.995036 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wmzf\" (UniqueName: \"kubernetes.io/projected/b2d58eda-602f-4b76-9cf1-6a459b1e26ae-kube-api-access-9wmzf\") pod \"network-check-target-z9zls\" (UID: \"b2d58eda-602f-4b76-9cf1-6a459b1e26ae\") " pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:31.044179 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.044145 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q8tq9"] Jul 14 05:00:31.048152 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:31.048123 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e4f4e9_23c4_4351_9058_5593fae027ec.slice/crio-3c4490bf985814f8d77ab5ca34bdd5bb96ba53a7311479ad0d922da70edfe0da WatchSource:0}: Error finding container 3c4490bf985814f8d77ab5ca34bdd5bb96ba53a7311479ad0d922da70edfe0da: Status 404 returned error can't find the container with id 3c4490bf985814f8d77ab5ca34bdd5bb96ba53a7311479ad0d922da70edfe0da Jul 14 05:00:31.071114 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.071078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:31.071279 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.071146 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:31.071889 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.071870 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:31.073400 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.073378 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:31.169818 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.169780 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kmvxx" Jul 14 05:00:31.183326 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.183292 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpjvf\"" Jul 14 05:00:31.191695 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.191667 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:31.307830 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.307391 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:00:31.344696 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.344619 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kmvxx"] Jul 14 05:00:31.364116 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.364039 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9zls"] Jul 14 05:00:31.403368 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.403333 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7456587457-pfw49"] Jul 14 05:00:31.408981 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.408829 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.411915 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.411890 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rsvfq\"" Jul 14 05:00:31.412152 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.412107 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 05:00:31.412307 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.412291 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ckkg6ma8mus8e\"" Jul 14 05:00:31.412489 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.412473 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 05:00:31.412704 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.412685 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 05:00:31.412788 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.412737 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 05:00:31.412986 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.412886 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 05:00:31.420290 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.419814 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7456587457-pfw49"] Jul 14 05:00:31.473783 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.473732 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-metrics-client-ca\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.473954 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.473813 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.473954 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.473893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.473954 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.473941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clq7m\" (UniqueName: \"kubernetes.io/projected/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-kube-api-access-clq7m\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.474126 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.473995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-grpc-tls\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.474126 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.474023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.474126 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.474071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.474277 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.474155 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-tls\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.552396 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.552304 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdzd" event={"ID":"d4f40e57-96f9-413a-bb30-7dde49268b82","Type":"ContainerStarted","Data":"8fa66aabc643a3edb3cec551f820865bd9b6bd3f89e049e9abf40c4595974227"} Jul 14 05:00:31.554870 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.554409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q8tq9" event={"ID":"c4e4f4e9-23c4-4351-9058-5593fae027ec","Type":"ContainerStarted","Data":"3c4490bf985814f8d77ab5ca34bdd5bb96ba53a7311479ad0d922da70edfe0da"} Jul 14 05:00:31.565740 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:31.565704 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea96973_aa43_444d_9bf1_1809b00cf89a.slice/crio-41d0c6c25fdcb311832883005ca313d001d1e9ad3659cab2ab69f0e1b4d237fd WatchSource:0}: Error finding container 41d0c6c25fdcb311832883005ca313d001d1e9ad3659cab2ab69f0e1b4d237fd: Status 404 returned error can't find the container with id 41d0c6c25fdcb311832883005ca313d001d1e9ad3659cab2ab69f0e1b4d237fd Jul 14 05:00:31.574812 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-tls\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.574911 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574823 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-metrics-client-ca\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.574911 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574860 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.574911 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.575060 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clq7m\" (UniqueName: \"kubernetes.io/projected/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-kube-api-access-clq7m\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.575060 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-grpc-tls\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.575060 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.574971 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.575060 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.575011 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.576032 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.575696 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-metrics-client-ca\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.577890 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.577866 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.578120 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.578082 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.578237 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.578216 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-tls\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.578366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.578339 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-grpc-tls\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.578493 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.578428 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.578852 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.578831 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.584274 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.584255 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clq7m\" (UniqueName: \"kubernetes.io/projected/f91dc92d-7c19-4a9e-a2d5-3ea571363ab8-kube-api-access-clq7m\") pod \"thanos-querier-7456587457-pfw49\" (UID: \"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8\") " pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.723083 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:31.722978 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:31.835314 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:31.835276 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d58eda_602f_4b76_9cf1_6a459b1e26ae.slice/crio-22c599c0793a4da79fc06b6729ddc385bd395891b13515bb950e50e3e534f57a WatchSource:0}: Error finding container 22c599c0793a4da79fc06b6729ddc385bd395891b13515bb950e50e3e534f57a: Status 404 returned error can't find the container with id 22c599c0793a4da79fc06b6729ddc385bd395891b13515bb950e50e3e534f57a Jul 14 05:00:32.558242 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:32.558201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmvxx" event={"ID":"1ea96973-aa43-444d-9bf1-1809b00cf89a","Type":"ContainerStarted","Data":"41d0c6c25fdcb311832883005ca313d001d1e9ad3659cab2ab69f0e1b4d237fd"} Jul 14 05:00:32.559258 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:32.559235 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9zls" event={"ID":"b2d58eda-602f-4b76-9cf1-6a459b1e26ae","Type":"ContainerStarted","Data":"22c599c0793a4da79fc06b6729ddc385bd395891b13515bb950e50e3e534f57a"} Jul 14 05:00:32.956159 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:32.956110 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:00:32.973808 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:32.973706 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7456587457-pfw49"] Jul 14 05:00:33.265376 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:33.265332 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91dc92d_7c19_4a9e_a2d5_3ea571363ab8.slice/crio-189e52658f802f88fbf9339a0b6a6c4f6905f5b9c25e2e3f3f48eb55110bd6ce WatchSource:0}: Error finding container 189e52658f802f88fbf9339a0b6a6c4f6905f5b9c25e2e3f3f48eb55110bd6ce: Status 404 returned error can't find the container with id 189e52658f802f88fbf9339a0b6a6c4f6905f5b9c25e2e3f3f48eb55110bd6ce Jul 14 05:00:33.268941 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:33.268907 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9760021e_488e_45b7_8ad0_c0a7979859e1.slice/crio-1b42ac7049bd50c1ebbc41921be7a63d9ed90e28be6c6af830d2132a4cc6173a WatchSource:0}: Error finding container 1b42ac7049bd50c1ebbc41921be7a63d9ed90e28be6c6af830d2132a4cc6173a: Status 404 returned error can't find the container with id 1b42ac7049bd50c1ebbc41921be7a63d9ed90e28be6c6af830d2132a4cc6173a Jul 14 05:00:33.571817 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.571703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" event={"ID":"062c49a8-ece7-412a-bd62-96ec663e4ca7","Type":"ContainerStarted","Data":"ae6ff21303cb998b750ac1b5495e83fa3ad370a899942ad98cf9324c1ca9c0b2"} Jul 14 05:00:33.571817 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.571775 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" event={"ID":"062c49a8-ece7-412a-bd62-96ec663e4ca7","Type":"ContainerStarted","Data":"2948db00da5fedc92e3304461d0727f119f3e853b249c05b937f8529286520d3"} Jul 14 05:00:33.578035 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.577996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q8tq9" event={"ID":"c4e4f4e9-23c4-4351-9058-5593fae027ec","Type":"ContainerStarted","Data":"0684a360c58f1e00ab0eb3f122a599b6fd2f8bfa7e9fed68a5a0cffe4de4049b"} Jul 14 05:00:33.579435 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.579410 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"189e52658f802f88fbf9339a0b6a6c4f6905f5b9c25e2e3f3f48eb55110bd6ce"} Jul 14 05:00:33.582686 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.582611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"1b42ac7049bd50c1ebbc41921be7a63d9ed90e28be6c6af830d2132a4cc6173a"} Jul 14 05:00:33.586679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.586569 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" event={"ID":"4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389","Type":"ContainerStarted","Data":"6b93e035791f748f6ee3f1f06cc394ec7bb6e1cbf6822a53930c3a5647de3a52"} Jul 14 05:00:33.594044 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.593945 2560 generic.go:356] "Generic (PLEG): container finished" podID="0bd1b775-cf5e-4a94-b68b-d7b23ad23c33" containerID="3f87ac53f82e1e009b0f3dfe0417984728ccf0539aa28f3a23a7cb95096f8e3e" exitCode=0 Jul 14 05:00:33.594044 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.593996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwhsg" event={"ID":"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33","Type":"ContainerDied","Data":"3f87ac53f82e1e009b0f3dfe0417984728ccf0539aa28f3a23a7cb95096f8e3e"} Jul 14 05:00:33.609933 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.608832 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-k5dgs" podStartSLOduration=2.144082585 podStartE2EDuration="4.608809148s" totalImagesPullingTime="2.464726563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:33.608341933 +0000 UTC m=+68.929107297" watchObservedRunningTime="2026-07-14 05:00:33.608809148 +0000 UTC m=+68.929574512" Jul 14 05:00:33.830893 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.829509 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-bbfd457b5-jhx5j"] Jul 14 05:00:33.832443 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.832416 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.836891 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.836081 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 14 05:00:33.836891 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.836285 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 14 05:00:33.836891 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.836476 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 14 05:00:33.836891 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.836583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7oohe10h59l2c\"" Jul 14 05:00:33.836891 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.836721 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-s7tt2\"" Jul 14 05:00:33.836891 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.836757 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 14 05:00:33.845169 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.844571 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:33.845169 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.844890 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:00:33.845169 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.844970 2560 patch_prober.go:28] interesting pod/console-84f4b6d74f-2t2vd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jul 14 05:00:33.845169 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.845032 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-84f4b6d74f-2t2vd" podUID="ab58022b-4137-48c5-b569-3e527b4149c1" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jul 14 05:00:33.846627 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.846595 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bbfd457b5-jhx5j"] Jul 14 05:00:33.899263 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-metrics-server-audit-profiles\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.899451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899285 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-client-ca-bundle\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.899451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899341 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.899451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899432 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-secret-metrics-server-tls\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.899645 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899493 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-audit-log\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.899645 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbzmq\" (UniqueName: \"kubernetes.io/projected/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-kube-api-access-wbzmq\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:33.899645 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:33.899591 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-secret-metrics-server-client-certs\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.000720 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.000910 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000761 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-secret-metrics-server-tls\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.000910 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-audit-log\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.000910 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbzmq\" (UniqueName: \"kubernetes.io/projected/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-kube-api-access-wbzmq\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.000910 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000867 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-secret-metrics-server-client-certs\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.001131 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-metrics-server-audit-profiles\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.001131 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.000948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-client-ca-bundle\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.001975 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.001832 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-audit-log\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.003026 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.002685 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.003026 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.002983 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-metrics-server-audit-profiles\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.004890 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.004868 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-client-ca-bundle\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.006760 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.006715 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-secret-metrics-server-tls\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.009001 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.008952 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-secret-metrics-server-client-certs\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.018679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.017887 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbzmq\" (UniqueName: \"kubernetes.io/projected/a2df6e72-358e-4c7a-825f-3bf1e5758c3f-kube-api-access-wbzmq\") pod \"metrics-server-bbfd457b5-jhx5j\" (UID: \"a2df6e72-358e-4c7a-825f-3bf1e5758c3f\") " pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.150721 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.150341 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:34.329297 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.329203 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-bbfd457b5-jhx5j"] Jul 14 05:00:34.334033 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:34.334001 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2df6e72_358e_4c7a_825f_3bf1e5758c3f.slice/crio-205cb02807f00fafc2b836d6c8074b3ba5abafba2c152ffcf611cb0409b86c9f WatchSource:0}: Error finding container 205cb02807f00fafc2b836d6c8074b3ba5abafba2c152ffcf611cb0409b86c9f: Status 404 returned error can't find the container with id 205cb02807f00fafc2b836d6c8074b3ba5abafba2c152ffcf611cb0409b86c9f Jul 14 05:00:34.603802 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.603534 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwhsg" event={"ID":"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33","Type":"ContainerStarted","Data":"10db3d8e2277a31771fddf037394e9fa0760bbd7f37b6ffd56dc143b99f348ff"} Jul 14 05:00:34.603802 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.603602 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fwhsg" event={"ID":"0bd1b775-cf5e-4a94-b68b-d7b23ad23c33","Type":"ContainerStarted","Data":"fd1c0772f8d01db4625f9ee32165fd591ae792b946e405910a336304960765ec"} Jul 14 05:00:34.607803 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.607121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" event={"ID":"062c49a8-ece7-412a-bd62-96ec663e4ca7","Type":"ContainerStarted","Data":"510b83cfcdbb9984a978c11d331a9da929182e98e2252e9a69ffbee03aec5883"} Jul 14 05:00:34.611912 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.611882 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q8tq9" event={"ID":"c4e4f4e9-23c4-4351-9058-5593fae027ec","Type":"ContainerStarted","Data":"02ef0e458031d9b3bbf294f13d46f1ecbdcea5225e45c46ed06f339f4ef22cce"} Jul 14 05:00:34.614690 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.614657 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" event={"ID":"a2df6e72-358e-4c7a-825f-3bf1e5758c3f","Type":"ContainerStarted","Data":"205cb02807f00fafc2b836d6c8074b3ba5abafba2c152ffcf611cb0409b86c9f"} Jul 14 05:00:34.626904 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.626127 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fwhsg" podStartSLOduration=3.014438078 podStartE2EDuration="5.626097639s" totalImagesPullingTime="2.490966678s" totalInitContainerRuntime="120.692883ms" isStatefulPod=true podCreationTimestamp="2026-07-14 05:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:34.624410674 +0000 UTC m=+69.945176065" watchObservedRunningTime="2026-07-14 05:00:34.626097639 +0000 UTC m=+69.946863004" Jul 14 05:00:34.641864 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.641569 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q8tq9" podStartSLOduration=67.374082512 podStartE2EDuration="1m9.641548169s" totalImagesPullingTime="2.267465657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:34.640315152 +0000 UTC m=+69.961080534" watchObservedRunningTime="2026-07-14 05:00:34.641548169 +0000 UTC m=+69.962313532" Jul 14 05:00:34.661413 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:34.661354 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-vspn6" podStartSLOduration=3.27863698 podStartE2EDuration="5.661333251s" totalImagesPullingTime="2.382696271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:34.660061488 +0000 UTC m=+69.980826852" watchObservedRunningTime="2026-07-14 05:00:34.661333251 +0000 UTC m=+69.982098616" Jul 14 05:00:35.588665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.585228 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:00:35.595092 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.591909 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.598071 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.596474 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 05:00:35.598071 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.596580 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.598715 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.598919 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.599662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.599962 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.600171 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.600360 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-st2lh\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.601017 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.601154 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 05:00:35.601494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.601350 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 05:00:35.602041 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.601988 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 05:00:35.602896 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.602359 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 05:00:35.602896 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.602563 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eagpfghcv779m\"" Jul 14 05:00:35.609222 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.608912 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 05:00:35.609601 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.609251 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 05:00:35.612054 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.612034 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 05:00:35.717654 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6zxn\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-kube-api-access-j6zxn\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.717848 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.717848 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717698 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.717848 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718013 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717848 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718013 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718013 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718013 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.717964 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718097 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718170 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718209 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718416 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718416 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718416 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718347 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718593 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718593 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718593 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718570 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718751 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.718751 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.718620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.819952 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.819914 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.819967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6zxn\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-kube-api-access-j6zxn\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820135 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820150 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820352 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820387 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.820512 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.820440 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.821278 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.821252 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.821374 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.821293 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.821980 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.821955 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.822174 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.822151 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.823050 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.823026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.823142 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.823071 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.823381 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.823353 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.823704 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.823647 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.826826 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.826233 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.826826 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.826282 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.826826 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.826672 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.826826 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.826774 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.827596 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.827555 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.827596 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.827579 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.827736 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.827608 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.827736 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.827647 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.828052 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.828028 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.829026 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.828982 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.830604 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.830581 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.830705 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.830643 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6zxn\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-kube-api-access-j6zxn\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.830765 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.830718 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.831083 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.831061 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:35.913303 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:35.913259 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:38.937738 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:38.937707 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f4b6d74f-2t2vd"] Jul 14 05:00:39.636994 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.636898 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"ff187944c19d80a829a189cdcd24802fcf236d93e26d2a00c505df3d31b18750"} Jul 14 05:00:39.639057 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.638827 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d" exitCode=0 Jul 14 05:00:39.639057 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.638903 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d"} Jul 14 05:00:39.642179 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.642147 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" event={"ID":"a2df6e72-358e-4c7a-825f-3bf1e5758c3f","Type":"ContainerStarted","Data":"5e5351f241e6f25be6ad6de242cc972b01af94436a8b7c7f149918f00227396b"} Jul 14 05:00:39.644786 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.644766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdzd" event={"ID":"d4f40e57-96f9-413a-bb30-7dde49268b82","Type":"ContainerStarted","Data":"f907ce3ab78fbd2b8aefd602f021423947d96d02cfa0040be33417f875e72aae"} Jul 14 05:00:39.647006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.646962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9zls" event={"ID":"b2d58eda-602f-4b76-9cf1-6a459b1e26ae","Type":"ContainerStarted","Data":"68da35c1bc3100469ce574322b7f9a7588abfa84a79f291967129851e5cf7a5c"} Jul 14 05:00:39.649480 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.649329 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:00:39.651250 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.651153 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:00:39.675584 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:00:39.675554 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9184eddb_54fe_415c_9a2d_a5bc5ed140b7.slice/crio-cf2a096bdb56e0d68142b2ff62d8df5e72981c0c3926c0c155ac0517b5fd0fd2 WatchSource:0}: Error finding container cf2a096bdb56e0d68142b2ff62d8df5e72981c0c3926c0c155ac0517b5fd0fd2: Status 404 returned error can't find the container with id cf2a096bdb56e0d68142b2ff62d8df5e72981c0c3926c0c155ac0517b5fd0fd2 Jul 14 05:00:39.692671 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.692624 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z9zls" podStartSLOduration=67.202782333 podStartE2EDuration="1m14.692608787s" totalImagesPullingTime="7.489826454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:39.691850808 +0000 UTC m=+75.012616174" watchObservedRunningTime="2026-07-14 05:00:39.692608787 +0000 UTC m=+75.013374150" Jul 14 05:00:39.711646 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.711432 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" podStartSLOduration=1.5357491680000002 podStartE2EDuration="6.711411225s" totalImagesPullingTime="5.175662057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:39.708909116 +0000 UTC m=+75.029674480" watchObservedRunningTime="2026-07-14 05:00:39.711411225 +0000 UTC m=+75.032176590" Jul 14 05:00:39.735951 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:39.730819 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7vdzd" podStartSLOduration=1.046164607 podStartE2EDuration="16.730795632s" totalImagesPullingTime="15.684631025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 05:00:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:39.729000893 +0000 UTC m=+75.049766272" watchObservedRunningTime="2026-07-14 05:00:39.730795632 +0000 UTC m=+75.051560997" Jul 14 05:00:40.557871 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.557838 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bmmhp" Jul 14 05:00:40.654150 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.653717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kmvxx" event={"ID":"1ea96973-aa43-444d-9bf1-1809b00cf89a","Type":"ContainerStarted","Data":"9ffcdb8979d439b1da3b05d202a810584a58173eb09d99a666f80c88d9919d32"} Jul 14 05:00:40.655791 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.655757 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" exitCode=0 Jul 14 05:00:40.655928 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.655809 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} Jul 14 05:00:40.655928 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.655872 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"cf2a096bdb56e0d68142b2ff62d8df5e72981c0c3926c0c155ac0517b5fd0fd2"} Jul 14 05:00:40.658768 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.658737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"e8dbee5d2972e89720100358f406937cb233526e8f935b6a72e94dfc12f7b700"} Jul 14 05:00:40.658866 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.658811 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"d31be16a47cd29439356c26a053d757e23c999ed61b6a0b970884e0ac40db547"} Jul 14 05:00:40.670440 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:40.670385 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kmvxx" podStartSLOduration=67.764730551 podStartE2EDuration="1m15.670364644s" totalImagesPullingTime="7.905634093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:40.669779869 +0000 UTC m=+75.990545232" watchObservedRunningTime="2026-07-14 05:00:40.670364644 +0000 UTC m=+75.991129989" Jul 14 05:00:41.666521 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.666486 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"8a2ef72ffb4b3d28ecd7fd9efa3edecf9dc7c7208530ff8de16c71c36bbcfeac"} Jul 14 05:00:41.666971 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.666563 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"b8655b7c25bb7887cdf140a0cdf90f89cea9ada2e94e10a71db51445232c96d7"} Jul 14 05:00:41.666971 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.666600 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" event={"ID":"f91dc92d-7c19-4a9e-a2d5-3ea571363ab8","Type":"ContainerStarted","Data":"edc9341960d4d45cc84b0d9402d258d40ab37d61b427fe49c1b8f0e2f587ae5e"} Jul 14 05:00:41.666971 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.666631 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:41.670202 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.670166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472"} Jul 14 05:00:41.670330 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.670248 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6"} Jul 14 05:00:41.670330 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.670282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45"} Jul 14 05:00:41.670330 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.670320 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2"} Jul 14 05:00:41.670454 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.670353 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df"} Jul 14 05:00:41.670454 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.670384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerStarted","Data":"9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320"} Jul 14 05:00:41.693756 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.693695 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" podStartSLOduration=3.1343527939999998 podStartE2EDuration="10.693671309s" totalImagesPullingTime="7.559318515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:41.69204259 +0000 UTC m=+77.012807953" watchObservedRunningTime="2026-07-14 05:00:41.693671309 +0000 UTC m=+77.014436673" Jul 14 05:00:41.719627 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:41.719575 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.964391386 podStartE2EDuration="11.719556022s" totalImagesPullingTime="7.740361392s" totalInitContainerRuntime="14.803244ms" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:41.717704244 +0000 UTC m=+77.038469609" watchObservedRunningTime="2026-07-14 05:00:41.719556022 +0000 UTC m=+77.040321397" Jul 14 05:00:44.686770 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.686730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} Jul 14 05:00:44.687232 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.686810 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} Jul 14 05:00:44.687232 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.686860 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} Jul 14 05:00:44.687232 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.686904 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} Jul 14 05:00:44.687232 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.686945 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} Jul 14 05:00:44.687232 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.686982 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerStarted","Data":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} Jul 14 05:00:44.717687 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:44.717627 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.093180642 podStartE2EDuration="9.717609483s" totalImagesPullingTime="3.600265944s" totalInitContainerRuntime="24.162897ms" isStatefulPod=false podCreationTimestamp="2026-07-14 05:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:00:44.716019709 +0000 UTC m=+80.036785117" watchObservedRunningTime="2026-07-14 05:00:44.717609483 +0000 UTC m=+80.038374846" Jul 14 05:00:45.914006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:45.913957 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:00:47.680807 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:47.680781 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7456587457-pfw49" Jul 14 05:00:54.151278 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:54.151234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:00:54.151835 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:00:54.151308 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:01:03.965735 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:03.965684 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84f4b6d74f-2t2vd" podUID="ab58022b-4137-48c5-b569-3e527b4149c1" containerName="console" containerID="cri-o://aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655" gracePeriod=15 Jul 14 05:01:04.741193 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.741154 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:01:04.766753 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.766721 2560 generic.go:356] "Generic (PLEG): container finished" podID="ab58022b-4137-48c5-b569-3e527b4149c1" containerID="aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655" exitCode=0 Jul 14 05:01:04.766926 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.766771 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84f4b6d74f-2t2vd" Jul 14 05:01:04.766926 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.766785 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f4b6d74f-2t2vd" event={"ID":"ab58022b-4137-48c5-b569-3e527b4149c1","Type":"ContainerDied","Data":"aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655"} Jul 14 05:01:04.766926 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.766828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84f4b6d74f-2t2vd" event={"ID":"ab58022b-4137-48c5-b569-3e527b4149c1","Type":"ContainerDied","Data":"ed83702e9cb0a2e460b228a4d789e46af40489f6b26cdd656523104db9f450b6"} Jul 14 05:01:04.766926 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.766850 2560 scope.go:117] "RemoveContainer" containerID="aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655" Jul 14 05:01:04.776659 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.776640 2560 scope.go:117] "RemoveContainer" containerID="aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655" Jul 14 05:01:04.776988 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:04.776968 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655\": container with ID starting with aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655 not found: ID does not exist" containerID="aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655" Jul 14 05:01:04.777046 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.776997 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655"} err="failed to get container status \"aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655\": rpc error: code = NotFound desc = could not find container \"aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655\": container with ID starting with aa17e73d9ca1591b04a351a009b1969d413793cbb9625c6452e19111e9f2f655 not found: ID does not exist" Jul 14 05:01:04.788388 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.788363 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-oauth-config\") pod \"ab58022b-4137-48c5-b569-3e527b4149c1\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " Jul 14 05:01:04.788544 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.788401 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-oauth-serving-cert\") pod \"ab58022b-4137-48c5-b569-3e527b4149c1\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " Jul 14 05:01:04.788544 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.788422 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-service-ca\") pod \"ab58022b-4137-48c5-b569-3e527b4149c1\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " Jul 14 05:01:04.788544 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.788498 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmd2m\" (UniqueName: \"kubernetes.io/projected/ab58022b-4137-48c5-b569-3e527b4149c1-kube-api-access-mmd2m\") pod \"ab58022b-4137-48c5-b569-3e527b4149c1\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " Jul 14 05:01:04.788696 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.788546 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-serving-cert\") pod \"ab58022b-4137-48c5-b569-3e527b4149c1\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " Jul 14 05:01:04.788696 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.788579 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-console-config\") pod \"ab58022b-4137-48c5-b569-3e527b4149c1\" (UID: \"ab58022b-4137-48c5-b569-3e527b4149c1\") " Jul 14 05:01:04.789165 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.789119 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab58022b-4137-48c5-b569-3e527b4149c1" (UID: "ab58022b-4137-48c5-b569-3e527b4149c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:04.793734 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.789358 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab58022b-4137-48c5-b569-3e527b4149c1" (UID: "ab58022b-4137-48c5-b569-3e527b4149c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:04.793734 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.789425 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-console-config" (OuterVolumeSpecName: "console-config") pod "ab58022b-4137-48c5-b569-3e527b4149c1" (UID: "ab58022b-4137-48c5-b569-3e527b4149c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:04.794408 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.794243 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab58022b-4137-48c5-b569-3e527b4149c1" (UID: "ab58022b-4137-48c5-b569-3e527b4149c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:04.795345 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.795312 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab58022b-4137-48c5-b569-3e527b4149c1" (UID: "ab58022b-4137-48c5-b569-3e527b4149c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:04.795472 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.795438 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab58022b-4137-48c5-b569-3e527b4149c1-kube-api-access-mmd2m" (OuterVolumeSpecName: "kube-api-access-mmd2m") pod "ab58022b-4137-48c5-b569-3e527b4149c1" (UID: "ab58022b-4137-48c5-b569-3e527b4149c1"). InnerVolumeSpecName "kube-api-access-mmd2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:04.890351 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.890321 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-serving-cert\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:04.890351 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.890350 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-console-config\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:04.890577 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.890361 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58022b-4137-48c5-b569-3e527b4149c1-console-oauth-config\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:04.890577 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.890370 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-oauth-serving-cert\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:04.890577 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.890378 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58022b-4137-48c5-b569-3e527b4149c1-service-ca\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:04.890577 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:04.890388 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmd2m\" (UniqueName: \"kubernetes.io/projected/ab58022b-4137-48c5-b569-3e527b4149c1-kube-api-access-mmd2m\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:05.089183 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:05.089150 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84f4b6d74f-2t2vd"] Jul 14 05:01:05.092833 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:05.092808 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84f4b6d74f-2t2vd"] Jul 14 05:01:05.251893 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:05.251816 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab58022b-4137-48c5-b569-3e527b4149c1" path="/var/lib/kubelet/pods/ab58022b-4137-48c5-b569-3e527b4149c1/volumes" Jul 14 05:01:11.672672 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:11.672643 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z9zls" Jul 14 05:01:14.156424 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:14.156386 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:01:14.160169 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:14.160149 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-bbfd457b5-jhx5j" Jul 14 05:01:35.913652 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:35.913617 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:35.932963 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:35.932932 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:36.907849 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:36.907822 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:49.618780 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.618739 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:01:49.619338 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.619152 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="alertmanager" containerID="cri-o://9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320" gracePeriod=120 Jul 14 05:01:49.619338 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.619167 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy" containerID="cri-o://93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45" gracePeriod=120 Jul 14 05:01:49.619338 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.619167 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="prom-label-proxy" containerID="cri-o://59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472" gracePeriod=120 Jul 14 05:01:49.619561 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.619337 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-web" containerID="cri-o://430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2" gracePeriod=120 Jul 14 05:01:49.619561 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.619359 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-metric" containerID="cri-o://50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6" gracePeriod=120 Jul 14 05:01:49.619561 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.619427 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="config-reloader" containerID="cri-o://dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df" gracePeriod=120 Jul 14 05:01:49.944560 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944524 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472" exitCode=0 Jul 14 05:01:49.944560 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944549 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6" exitCode=0 Jul 14 05:01:49.944560 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944558 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45" exitCode=0 Jul 14 05:01:49.944560 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944565 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df" exitCode=0 Jul 14 05:01:49.944560 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944571 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320" exitCode=0 Jul 14 05:01:49.944924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472"} Jul 14 05:01:49.944924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944682 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6"} Jul 14 05:01:49.944924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944722 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45"} Jul 14 05:01:49.944924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944758 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df"} Jul 14 05:01:49.944924 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:49.944798 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320"} Jul 14 05:01:50.864346 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.864320 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:50.884860 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.884827 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-metrics-client-ca\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.884860 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.884865 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7nbq\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-kube-api-access-s7nbq\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885041 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.884888 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-config-out\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885041 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.884916 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885138 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885040 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-cluster-tls-config\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885138 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885084 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885138 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885123 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-main-db\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885288 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885176 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885288 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885208 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885288 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885232 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-web-config\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885288 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885262 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-config-volume\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885288 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885264 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:50.885573 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885356 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.885573 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.885409 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-tls-assets\") pod \"9760021e-488e-45b7-8ad0-c0a7979859e1\" (UID: \"9760021e-488e-45b7-8ad0-c0a7979859e1\") " Jul 14 05:01:50.886408 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.886287 2560 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-metrics-client-ca\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.888413 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.888236 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.888662 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.888612 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:01:50.888730 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.888663 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-config-out" (OuterVolumeSpecName: "config-out") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:01:50.889322 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.888830 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.889322 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.889143 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-kube-api-access-s7nbq" (OuterVolumeSpecName: "kube-api-access-s7nbq") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "kube-api-access-s7nbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:50.889778 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.889348 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:50.890142 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.890098 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.890253 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.890171 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:50.902620 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.901450 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-config-volume" (OuterVolumeSpecName: "config-volume") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.902620 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.902130 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.902620 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.902580 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.912804 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.912765 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-web-config" (OuterVolumeSpecName: "web-config") pod "9760021e-488e-45b7-8ad0-c0a7979859e1" (UID: "9760021e-488e-45b7-8ad0-c0a7979859e1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:50.951181 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.951079 2560 generic.go:356] "Generic (PLEG): container finished" podID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerID="430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2" exitCode=0 Jul 14 05:01:50.951181 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.951134 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2"} Jul 14 05:01:50.951181 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.951166 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:50.951435 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.951226 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9760021e-488e-45b7-8ad0-c0a7979859e1","Type":"ContainerDied","Data":"1b42ac7049bd50c1ebbc41921be7a63d9ed90e28be6c6af830d2132a4cc6173a"} Jul 14 05:01:50.951435 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.951263 2560 scope.go:117] "RemoveContainer" containerID="59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472" Jul 14 05:01:50.959648 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.959631 2560 scope.go:117] "RemoveContainer" containerID="50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6" Jul 14 05:01:50.966964 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.966947 2560 scope.go:117] "RemoveContainer" containerID="93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45" Jul 14 05:01:50.974431 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.974404 2560 scope.go:117] "RemoveContainer" containerID="430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2" Jul 14 05:01:50.975088 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.975068 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:01:50.979677 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.979658 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:01:50.982978 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.982962 2560 scope.go:117] "RemoveContainer" containerID="dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df" Jul 14 05:01:50.987343 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987318 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987343 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987341 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-tls-assets\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987353 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7nbq\" (UniqueName: \"kubernetes.io/projected/9760021e-488e-45b7-8ad0-c0a7979859e1-kube-api-access-s7nbq\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987362 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-config-out\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987371 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987380 2560 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-cluster-tls-config\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987388 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987396 2560 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9760021e-488e-45b7-8ad0-c0a7979859e1-alertmanager-main-db\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987404 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-main-tls\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987412 2560 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987442 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-web-config\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.987451 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.987452 2560 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9760021e-488e-45b7-8ad0-c0a7979859e1-config-volume\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:50.991829 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.991812 2560 scope.go:117] "RemoveContainer" containerID="9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320" Jul 14 05:01:50.999604 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:50.999587 2560 scope.go:117] "RemoveContainer" containerID="d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d" Jul 14 05:01:51.005263 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005239 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:01:51.005594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005578 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="init-config-reloader" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005597 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="init-config-reloader" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005611 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005623 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005634 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="config-reloader" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005643 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="config-reloader" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005657 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="prom-label-proxy" Jul 14 05:01:51.005665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005666 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="prom-label-proxy" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005678 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-metric" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005687 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-metric" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005712 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-web" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005720 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-web" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005733 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab58022b-4137-48c5-b569-3e527b4149c1" containerName="console" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005741 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab58022b-4137-48c5-b569-3e527b4149c1" containerName="console" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005752 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="alertmanager" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005761 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="alertmanager" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005836 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005851 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab58022b-4137-48c5-b569-3e527b4149c1" containerName="console" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005860 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="config-reloader" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005869 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="alertmanager" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005881 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="prom-label-proxy" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005890 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-web" Jul 14 05:01:51.006006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.005899 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" containerName="kube-rbac-proxy-metric" Jul 14 05:01:51.007693 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.007676 2560 scope.go:117] "RemoveContainer" containerID="59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472" Jul 14 05:01:51.008026 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.008002 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472\": container with ID starting with 59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472 not found: ID does not exist" containerID="59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472" Jul 14 05:01:51.008077 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008039 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472"} err="failed to get container status \"59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472\": rpc error: code = NotFound desc = could not find container \"59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472\": container with ID starting with 59874667a9d71c5e5981e372c8519b26dc1bc9e9cc64378e09a4478da3356472 not found: ID does not exist" Jul 14 05:01:51.008077 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008067 2560 scope.go:117] "RemoveContainer" containerID="50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6" Jul 14 05:01:51.008326 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.008306 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6\": container with ID starting with 50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6 not found: ID does not exist" containerID="50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6" Jul 14 05:01:51.008367 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008333 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6"} err="failed to get container status \"50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6\": rpc error: code = NotFound desc = could not find container \"50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6\": container with ID starting with 50d97aef851f4f450d5ee46d4d36cf2b90dd450669cd0405b79323538a58acb6 not found: ID does not exist" Jul 14 05:01:51.008367 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008350 2560 scope.go:117] "RemoveContainer" containerID="93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45" Jul 14 05:01:51.008676 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.008660 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45\": container with ID starting with 93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45 not found: ID does not exist" containerID="93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45" Jul 14 05:01:51.008735 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008679 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45"} err="failed to get container status \"93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45\": rpc error: code = NotFound desc = could not find container \"93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45\": container with ID starting with 93b8e6566cbcfd1ad5687bf9184384cb317087b840c5ce1af7f851055ea1ba45 not found: ID does not exist" Jul 14 05:01:51.008735 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008693 2560 scope.go:117] "RemoveContainer" containerID="430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2" Jul 14 05:01:51.008909 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.008892 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2\": container with ID starting with 430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2 not found: ID does not exist" containerID="430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2" Jul 14 05:01:51.008951 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008915 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2"} err="failed to get container status \"430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2\": rpc error: code = NotFound desc = could not find container \"430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2\": container with ID starting with 430d2cf086154ae001bb87f79bf08e4997a6c20d026c0d9e536b147d38cc1fe2 not found: ID does not exist" Jul 14 05:01:51.008951 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.008930 2560 scope.go:117] "RemoveContainer" containerID="dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df" Jul 14 05:01:51.009164 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.009149 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df\": container with ID starting with dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df not found: ID does not exist" containerID="dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df" Jul 14 05:01:51.009207 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.009167 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df"} err="failed to get container status \"dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df\": rpc error: code = NotFound desc = could not find container \"dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df\": container with ID starting with dad4ced9871b982559e77672a99fdba06ab7fdadb7cebe591d924c94b92648df not found: ID does not exist" Jul 14 05:01:51.009207 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.009180 2560 scope.go:117] "RemoveContainer" containerID="9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320" Jul 14 05:01:51.009365 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.009350 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320\": container with ID starting with 9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320 not found: ID does not exist" containerID="9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320" Jul 14 05:01:51.009404 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.009367 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320"} err="failed to get container status \"9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320\": rpc error: code = NotFound desc = could not find container \"9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320\": container with ID starting with 9524933c7650618eee4514f77b20711d52c18ea1ef0f99765b9695eded9e7320 not found: ID does not exist" Jul 14 05:01:51.009404 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.009378 2560 scope.go:117] "RemoveContainer" containerID="d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d" Jul 14 05:01:51.009577 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:51.009558 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d\": container with ID starting with d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d not found: ID does not exist" containerID="d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d" Jul 14 05:01:51.009620 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.009582 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d"} err="failed to get container status \"d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d\": rpc error: code = NotFound desc = could not find container \"d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d\": container with ID starting with d11f5107c8e8b984cb8acd601d7ba0e4f6b33a2cdfcf381f2ee8ef7d3f90c62d not found: ID does not exist" Jul 14 05:01:51.009984 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.009971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.012690 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012669 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 05:01:51.012798 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012670 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 05:01:51.012798 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012735 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kv8x9\"" Jul 14 05:01:51.012798 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012763 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 05:01:51.012798 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012761 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 05:01:51.012798 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012673 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 05:01:51.013040 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012951 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 05:01:51.013040 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.012964 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 05:01:51.013271 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.013253 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 05:01:51.017763 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.017746 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 05:01:51.025166 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.025147 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:01:51.087969 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.087936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088145 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.087992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-config-volume\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088145 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088018 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088145 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088145 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088145 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088132 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-web-config\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088199 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-config-out\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rphqd\" (UniqueName: \"kubernetes.io/projected/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-kube-api-access-rphqd\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.088319 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.088288 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189664 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189664 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189687 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-web-config\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189735 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189763 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-config-out\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rphqd\" (UniqueName: \"kubernetes.io/projected/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-kube-api-access-rphqd\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.189921 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189909 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.190345 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189964 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-config-volume\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.190345 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.189989 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.190345 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.190097 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.190708 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.190680 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.190883 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.190803 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.192771 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.192747 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.192934 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.192888 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.193042 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.192984 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-web-config\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.193042 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.193003 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.193159 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.193115 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-config-out\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.193309 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.193277 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-config-volume\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.193369 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.193331 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.194029 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.194009 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.194326 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.194307 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.198989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.198967 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rphqd\" (UniqueName: \"kubernetes.io/projected/00a5aad5-e708-4ab3-a1b6-ddacd9a99bef-kube-api-access-rphqd\") pod \"alertmanager-main-0\" (UID: \"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.251810 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.251733 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9760021e-488e-45b7-8ad0-c0a7979859e1" path="/var/lib/kubelet/pods/9760021e-488e-45b7-8ad0-c0a7979859e1/volumes" Jul 14 05:01:51.319347 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.319318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 05:01:51.456506 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.456481 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 05:01:51.458495 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:01:51.458451 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a5aad5_e708_4ab3_a1b6_ddacd9a99bef.slice/crio-168e1a6a46884d9727f51bd0e99e6432691f3ef08553c49c7bff28d30cf3f884 WatchSource:0}: Error finding container 168e1a6a46884d9727f51bd0e99e6432691f3ef08553c49c7bff28d30cf3f884: Status 404 returned error can't find the container with id 168e1a6a46884d9727f51bd0e99e6432691f3ef08553c49c7bff28d30cf3f884 Jul 14 05:01:51.956978 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.956949 2560 generic.go:356] "Generic (PLEG): container finished" podID="00a5aad5-e708-4ab3-a1b6-ddacd9a99bef" containerID="fb31aceefb5f5a1cceac960744ee8085beae5263dee903740fe105bfbf29abb1" exitCode=0 Jul 14 05:01:51.957398 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.957048 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerDied","Data":"fb31aceefb5f5a1cceac960744ee8085beae5263dee903740fe105bfbf29abb1"} Jul 14 05:01:51.957398 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:51.957115 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"168e1a6a46884d9727f51bd0e99e6432691f3ef08553c49c7bff28d30cf3f884"} Jul 14 05:01:52.964624 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.964585 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"979338eecedf9f277d25a1a365cf2ab7c4cf0fb82d2672a9865403e59511c72a"} Jul 14 05:01:52.964997 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.964699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"b00f028f0c183d6abc144460510e228e8446ef2a424ea260048ef8c2d52229f4"} Jul 14 05:01:52.964997 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.964745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"b846eaa5df53bdcd779be70c5637f9cf5213c5776a5af4c3df3f02711d0492e8"} Jul 14 05:01:52.964997 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.964780 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"82bf73b1c904738f77d2c093659f906d9237e38550a99073743a926d35deae21"} Jul 14 05:01:52.964997 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.964815 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"b47910bc1c2cd636d5de8099973c08c6b53c4884275334497610f8d0880eb3cb"} Jul 14 05:01:52.964997 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.964851 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"00a5aad5-e708-4ab3-a1b6-ddacd9a99bef","Type":"ContainerStarted","Data":"cef124a4acdacc89515b77642e6d3235765be9f69d47a1e7e9467dca232d5e00"} Jul 14 05:01:52.998245 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:52.998140 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.98279219 podStartE2EDuration="2.998120631s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.328441ms" isStatefulPod=false podCreationTimestamp="2026-07-14 05:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:01:52.995412669 +0000 UTC m=+148.316178032" watchObservedRunningTime="2026-07-14 05:01:52.998120631 +0000 UTC m=+148.318886048" Jul 14 05:01:53.644539 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.644502 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-59c99dff7d-bm94m"] Jul 14 05:01:53.647008 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.646993 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.650049 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.650026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 14 05:01:53.650182 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.650130 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 14 05:01:53.650268 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.650255 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 14 05:01:53.650321 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.650266 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 14 05:01:53.650528 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.650513 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 14 05:01:53.650588 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.650534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-45scb\"" Jul 14 05:01:53.656444 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.656426 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 14 05:01:53.661710 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.661689 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59c99dff7d-bm94m"] Jul 14 05:01:53.711324 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711267 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-secret-telemeter-client\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711324 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711324 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711338 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-serving-certs-ca-bundle\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-federate-client-tls\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711390 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711452 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-metrics-client-ca\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrmjq\" (UniqueName: \"kubernetes.io/projected/013974e7-1ef9-4d01-84dd-98b18e76ea56-kube-api-access-zrmjq\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.711592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.711523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-telemeter-client-tls\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812402 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-telemeter-client-tls\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-secret-telemeter-client\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-serving-certs-ca-bundle\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812542 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-federate-client-tls\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812853 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812659 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-metrics-client-ca\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.812853 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.812686 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrmjq\" (UniqueName: \"kubernetes.io/projected/013974e7-1ef9-4d01-84dd-98b18e76ea56-kube-api-access-zrmjq\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.813398 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.813366 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-metrics-client-ca\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.813559 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.813490 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-telemeter-trusted-ca-bundle\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.813628 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.813588 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/013974e7-1ef9-4d01-84dd-98b18e76ea56-serving-certs-ca-bundle\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.815296 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.815273 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-secret-telemeter-client\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.815388 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.815367 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-telemeter-client-tls\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.815504 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.815486 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-federate-client-tls\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.815567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.815485 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/013974e7-1ef9-4d01-84dd-98b18e76ea56-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.821156 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.821136 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrmjq\" (UniqueName: \"kubernetes.io/projected/013974e7-1ef9-4d01-84dd-98b18e76ea56-kube-api-access-zrmjq\") pod \"telemeter-client-59c99dff7d-bm94m\" (UID: \"013974e7-1ef9-4d01-84dd-98b18e76ea56\") " pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:53.921597 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921511 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:01:53.921826 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921787 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="prometheus" containerID="cri-o://623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" gracePeriod=600 Jul 14 05:01:53.921961 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921812 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy" containerID="cri-o://dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" gracePeriod=600 Jul 14 05:01:53.921961 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921836 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="thanos-sidecar" containerID="cri-o://0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" gracePeriod=600 Jul 14 05:01:53.921961 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921871 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-web" containerID="cri-o://3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" gracePeriod=600 Jul 14 05:01:53.921961 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921870 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" gracePeriod=600 Jul 14 05:01:53.922136 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.921870 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="config-reloader" containerID="cri-o://c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" gracePeriod=600 Jul 14 05:01:53.956453 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:53.956428 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" Jul 14 05:01:54.116360 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.116210 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-59c99dff7d-bm94m"] Jul 14 05:01:54.120454 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:01:54.120413 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod013974e7_1ef9_4d01_84dd_98b18e76ea56.slice/crio-acb36b1a42f9f7c3927ce6b56ba6155c2446e773c2c988f5526882c6eab4ae0a WatchSource:0}: Error finding container acb36b1a42f9f7c3927ce6b56ba6155c2446e773c2c988f5526882c6eab4ae0a: Status 404 returned error can't find the container with id acb36b1a42f9f7c3927ce6b56ba6155c2446e773c2c988f5526882c6eab4ae0a Jul 14 05:01:54.168804 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.168781 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:54.219842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.219751 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.219842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.219800 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-2\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.219842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.219829 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-grpc-tls\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220097 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.219962 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-1\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220097 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220009 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-kube-rbac-proxy\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220097 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220042 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config-out\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220097 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220084 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-metrics-client-ca\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220109 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-metrics-client-certs\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220134 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220160 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-serving-certs-ca-bundle\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220181 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220201 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-tls\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220228 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-0\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220241 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220275 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-web-config\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220313 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6zxn\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-kube-api-access-j6zxn\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220344 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220370 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-db\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220416 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-thanos-prometheus-http-client-file\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220451 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-kubelet-serving-ca-bundle\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220497 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-tls-assets\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.220567 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220573 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-trusted-ca-bundle\") pod \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\" (UID: \"9184eddb-54fe-415c-9a2d-a5bc5ed140b7\") " Jul 14 05:01:54.221310 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220728 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.221310 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220858 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.221310 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220879 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.221310 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.220893 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-metrics-client-ca\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.221310 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.221088 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.221728 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.221698 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.222602 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.222442 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.223195 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.223043 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config-out" (OuterVolumeSpecName: "config-out") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:01:54.223195 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.223144 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.223195 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.223145 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 05:01:54.223381 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.223246 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 05:01:54.224304 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.224276 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config" (OuterVolumeSpecName: "config") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.224477 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.224439 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.224786 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.224756 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.224866 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.224846 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.225050 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.225022 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-kube-api-access-j6zxn" (OuterVolumeSpecName: "kube-api-access-j6zxn") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "kube-api-access-j6zxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:54.225758 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.225729 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:01:54.225850 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.225757 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.225899 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.225848 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.226089 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.226071 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.235312 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.235283 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-web-config" (OuterVolumeSpecName: "web-config") pod "9184eddb-54fe-415c-9a2d-a5bc5ed140b7" (UID: "9184eddb-54fe-415c-9a2d-a5bc5ed140b7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:01:54.322131 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322091 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322131 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322127 2560 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322131 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322137 2560 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-grpc-tls\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322147 2560 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-kube-rbac-proxy\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322156 2560 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-config-out\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322164 2560 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-metrics-client-certs\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322174 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322183 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322192 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322201 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322220 2560 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-web-config\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322227 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6zxn\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-kube-api-access-j6zxn\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322235 2560 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322244 2560 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-prometheus-k8s-db\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322252 2560 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322260 2560 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.322366 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.322268 2560 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9184eddb-54fe-415c-9a2d-a5bc5ed140b7-tls-assets\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:01:54.979707 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979673 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" exitCode=0 Jul 14 05:01:54.979707 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979699 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" exitCode=0 Jul 14 05:01:54.979707 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979708 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" exitCode=0 Jul 14 05:01:54.979707 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979713 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" exitCode=0 Jul 14 05:01:54.979707 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979718 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" exitCode=0 Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979724 2560 generic.go:356] "Generic (PLEG): container finished" podID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" exitCode=0 Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979780 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979858 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979901 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979943 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979967 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.979986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.980027 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} Jul 14 05:01:54.980187 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.980071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9184eddb-54fe-415c-9a2d-a5bc5ed140b7","Type":"ContainerDied","Data":"cf2a096bdb56e0d68142b2ff62d8df5e72981c0c3926c0c155ac0517b5fd0fd2"} Jul 14 05:01:54.981865 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.981836 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" event={"ID":"013974e7-1ef9-4d01-84dd-98b18e76ea56","Type":"ContainerStarted","Data":"acb36b1a42f9f7c3927ce6b56ba6155c2446e773c2c988f5526882c6eab4ae0a"} Jul 14 05:01:54.990178 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.989647 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:54.998793 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:54.998766 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.007237 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.007189 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.009627 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.009606 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:01:55.016286 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.016263 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:01:55.016955 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.016941 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.023796 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.023776 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.031389 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.031369 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.039006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.038984 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.039391 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.039367 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.039488 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.039404 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} err="failed to get container status \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" Jul 14 05:01:55.039488 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.039430 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.039892 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.039841 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.040008 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.039913 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} err="failed to get container status \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" Jul 14 05:01:55.040008 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.039938 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.040635 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.040405 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.040635 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.040437 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} err="failed to get container status \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" Jul 14 05:01:55.040635 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.040505 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.041116 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.041074 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.041116 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.041106 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} err="failed to get container status \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" Jul 14 05:01:55.041263 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.041130 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.041396 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.041368 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.041536 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.041401 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} err="failed to get container status \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" Jul 14 05:01:55.041536 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.041422 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.041748 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.041724 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.041843 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.041755 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} err="failed to get container status \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" Jul 14 05:01:55.041843 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.041775 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.042052 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:01:55.042031 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.042147 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042054 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} err="failed to get container status \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" Jul 14 05:01:55.042147 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042072 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.042359 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042340 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:01:55.042418 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042357 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} err="failed to get container status \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" Jul 14 05:01:55.042418 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042377 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.042763 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042741 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="init-config-reloader" Jul 14 05:01:55.042763 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042765 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="init-config-reloader" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042759 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} err="failed to get container status \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042803 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042782 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="thanos-sidecar" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042865 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="thanos-sidecar" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042886 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="config-reloader" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042893 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="config-reloader" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042900 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042905 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042917 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="prometheus" Jul 14 05:01:55.042920 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042924 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="prometheus" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042936 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-web" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042942 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-web" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042953 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-thanos" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.042960 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-thanos" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043029 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="config-reloader" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043039 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-thanos" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043051 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy-web" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043058 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="thanos-sidecar" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043069 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="prometheus" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043079 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" containerName="kube-rbac-proxy" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043078 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} err="failed to get container status \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" Jul 14 05:01:55.043390 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043216 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.043989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043512 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} err="failed to get container status \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" Jul 14 05:01:55.043989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043532 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.043989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043819 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} err="failed to get container status \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" Jul 14 05:01:55.043989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.043843 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.044279 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.044091 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} err="failed to get container status \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" Jul 14 05:01:55.044279 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.044115 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.044456 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.044417 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} err="failed to get container status \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" Jul 14 05:01:55.044456 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.044443 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.044756 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.044735 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} err="failed to get container status \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" Jul 14 05:01:55.044756 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.044755 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.045118 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045094 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} err="failed to get container status \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" Jul 14 05:01:55.045118 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045118 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.045370 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045349 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} err="failed to get container status \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" Jul 14 05:01:55.045370 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045367 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.045638 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045610 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} err="failed to get container status \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" Jul 14 05:01:55.045638 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045635 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.045863 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045847 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} err="failed to get container status \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" Jul 14 05:01:55.045915 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.045864 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.046096 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046073 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} err="failed to get container status \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" Jul 14 05:01:55.046235 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046097 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.046388 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046362 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} err="failed to get container status \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" Jul 14 05:01:55.046388 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046383 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.046689 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046667 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} err="failed to get container status \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" Jul 14 05:01:55.046765 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046690 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.046895 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046875 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} err="failed to get container status \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" Jul 14 05:01:55.046950 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.046896 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.047265 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047167 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} err="failed to get container status \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" Jul 14 05:01:55.047265 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047185 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.047491 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047436 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} err="failed to get container status \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" Jul 14 05:01:55.047491 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047477 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.047711 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047693 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} err="failed to get container status \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" Jul 14 05:01:55.047711 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047712 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.047866 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047849 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.047951 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047933 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} err="failed to get container status \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" Jul 14 05:01:55.048008 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.047952 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.048509 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.048480 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} err="failed to get container status \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" Jul 14 05:01:55.048509 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.048505 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.048794 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.048765 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} err="failed to get container status \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" Jul 14 05:01:55.048878 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.048795 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.049049 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049014 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} err="failed to get container status \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" Jul 14 05:01:55.049049 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049040 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.049267 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049251 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} err="failed to get container status \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" Jul 14 05:01:55.049313 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049267 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.049526 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049503 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} err="failed to get container status \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" Jul 14 05:01:55.049581 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049526 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.049791 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049774 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} err="failed to get container status \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" Jul 14 05:01:55.049837 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.049792 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.050028 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.050010 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} err="failed to get container status \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" Jul 14 05:01:55.050076 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.050028 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.050441 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.050405 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} err="failed to get container status \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" Jul 14 05:01:55.050575 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.050441 2560 scope.go:117] "RemoveContainer" containerID="506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81" Jul 14 05:01:55.050792 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.050744 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81"} err="failed to get container status \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": rpc error: code = NotFound desc = could not find container \"506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81\": container with ID starting with 506f4b47ee82b650831525d58745e07c16e20867899375098f45df426b035f81 not found: ID does not exist" Jul 14 05:01:55.050900 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.050822 2560 scope.go:117] "RemoveContainer" containerID="dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea" Jul 14 05:01:55.051118 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051093 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea"} err="failed to get container status \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": rpc error: code = NotFound desc = could not find container \"dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea\": container with ID starting with dadaf3c4f424b76e45c54f58e7cf7e0f1dd58f03aa815f2870293374f2f5b0ea not found: ID does not exist" Jul 14 05:01:55.051200 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051120 2560 scope.go:117] "RemoveContainer" containerID="3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6" Jul 14 05:01:55.051431 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051412 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6"} err="failed to get container status \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": rpc error: code = NotFound desc = could not find container \"3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6\": container with ID starting with 3f147b3c138cc28a4595927c0f1ca9b3f01c1d9dee36433b59de0237d99985a6 not found: ID does not exist" Jul 14 05:01:55.051525 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051432 2560 scope.go:117] "RemoveContainer" containerID="0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d" Jul 14 05:01:55.051700 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051679 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d"} err="failed to get container status \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": rpc error: code = NotFound desc = could not find container \"0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d\": container with ID starting with 0675e9dcff36509e16f82784e36f2d79965c9c2237f96b7e7317d14ddcbb049d not found: ID does not exist" Jul 14 05:01:55.051792 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051702 2560 scope.go:117] "RemoveContainer" containerID="c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24" Jul 14 05:01:55.051928 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051910 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24"} err="failed to get container status \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": rpc error: code = NotFound desc = could not find container \"c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24\": container with ID starting with c97dba920b9e1b755c9b262119f874a29eab7225aa2c1172548c7c996f608e24 not found: ID does not exist" Jul 14 05:01:55.052001 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.051929 2560 scope.go:117] "RemoveContainer" containerID="623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0" Jul 14 05:01:55.052192 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.052173 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0"} err="failed to get container status \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": rpc error: code = NotFound desc = could not find container \"623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0\": container with ID starting with 623e93faa2a901889a5f0f6c56348f774e34a7eefef3250dc71d5cf9145cefe0 not found: ID does not exist" Jul 14 05:01:55.052282 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.052194 2560 scope.go:117] "RemoveContainer" containerID="935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538" Jul 14 05:01:55.052424 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.052405 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538"} err="failed to get container status \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": rpc error: code = NotFound desc = could not find container \"935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538\": container with ID starting with 935974840dc1ec4436a30e0df588214a61b06ba8b522e44e46f9816a6a5e5538 not found: ID does not exist" Jul 14 05:01:55.053546 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.053528 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 14 05:01:55.053664 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.053574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 14 05:01:55.053804 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.053785 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 14 05:01:55.053963 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.053949 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-st2lh\"" Jul 14 05:01:55.054823 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.054803 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 14 05:01:55.054908 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.054897 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 14 05:01:55.056938 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.056901 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 14 05:01:55.057377 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.057353 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eagpfghcv779m\"" Jul 14 05:01:55.057480 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.057381 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 14 05:01:55.057480 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.057394 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 14 05:01:55.057598 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.057481 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 14 05:01:55.057862 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.057841 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 14 05:01:55.057980 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.057960 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 14 05:01:55.066748 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.066722 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 14 05:01:55.069001 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.068979 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 14 05:01:55.080773 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.080707 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 14 05:01:55.097903 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.097868 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:01:55.129195 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129165 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129195 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129300 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129373 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129413 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a61998d-0948-4724-9ef2-550de2c1ee2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129636 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6npz\" (UniqueName: \"kubernetes.io/projected/1a61998d-0948-4724-9ef2-550de2c1ee2c-kube-api-access-l6npz\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.129663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129656 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.130053 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129685 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.130053 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-config\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.130053 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.130053 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.129745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a61998d-0948-4724-9ef2-550de2c1ee2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.230944 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.230907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.230944 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.230948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-config\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.230966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a61998d-0948-4724-9ef2-550de2c1ee2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231113 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231142 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231272 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231298 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a61998d-0948-4724-9ef2-550de2c1ee2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231326 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231354 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231391 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.231516 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231503 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232020 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231538 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232020 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231566 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6npz\" (UniqueName: \"kubernetes.io/projected/1a61998d-0948-4724-9ef2-550de2c1ee2c-kube-api-access-l6npz\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232020 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232020 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.231835 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232229 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.232111 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232349 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.232321 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.232991 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.232757 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.233443 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.233417 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.234448 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.234421 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.234676 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.234622 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.235003 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.234977 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1a61998d-0948-4724-9ef2-550de2c1ee2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.235421 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.235396 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-config\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.235650 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.235612 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.236015 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.235991 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.236116 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.236096 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a61998d-0948-4724-9ef2-550de2c1ee2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.236610 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.236587 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.236697 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.236676 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.236919 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.236896 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.237725 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.237699 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.238003 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.237978 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.238882 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.238839 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a61998d-0948-4724-9ef2-550de2c1ee2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.238967 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.238864 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a61998d-0948-4724-9ef2-550de2c1ee2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.244585 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.244562 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6npz\" (UniqueName: \"kubernetes.io/projected/1a61998d-0948-4724-9ef2-550de2c1ee2c-kube-api-access-l6npz\") pod \"prometheus-k8s-0\" (UID: \"1a61998d-0948-4724-9ef2-550de2c1ee2c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.255968 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.255644 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9184eddb-54fe-415c-9a2d-a5bc5ed140b7" path="/var/lib/kubelet/pods/9184eddb-54fe-415c-9a2d-a5bc5ed140b7/volumes" Jul 14 05:01:55.360622 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.360505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:01:55.520679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.520654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 14 05:01:55.831018 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:01:55.830978 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a61998d_0948_4724_9ef2_550de2c1ee2c.slice/crio-a9fd87cd0668fb35939a6a7fd0fdfb85c4c3dd91d72a4e20b7b59968f18ee45f WatchSource:0}: Error finding container a9fd87cd0668fb35939a6a7fd0fdfb85c4c3dd91d72a4e20b7b59968f18ee45f: Status 404 returned error can't find the container with id a9fd87cd0668fb35939a6a7fd0fdfb85c4c3dd91d72a4e20b7b59968f18ee45f Jul 14 05:01:55.987752 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.987372 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" event={"ID":"013974e7-1ef9-4d01-84dd-98b18e76ea56","Type":"ContainerStarted","Data":"4df3ed4ee3469e1eb8f7927dc5fc36d89f33d76354f3ba6c2e2e0e7cadc57e02"} Jul 14 05:01:55.989618 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.989588 2560 generic.go:356] "Generic (PLEG): container finished" podID="1a61998d-0948-4724-9ef2-550de2c1ee2c" containerID="9bc32a3c56c3565cbc94db7e1e2d5474cf0732def5442f277731428bd91e8e06" exitCode=0 Jul 14 05:01:55.989726 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.989658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerDied","Data":"9bc32a3c56c3565cbc94db7e1e2d5474cf0732def5442f277731428bd91e8e06"} Jul 14 05:01:55.989726 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:55.989717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"a9fd87cd0668fb35939a6a7fd0fdfb85c4c3dd91d72a4e20b7b59968f18ee45f"} Jul 14 05:01:56.996171 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:56.996132 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" event={"ID":"013974e7-1ef9-4d01-84dd-98b18e76ea56","Type":"ContainerStarted","Data":"793dc5acb3873a535ef131d2e0469ab39f39af15b1bd0a892aa313e44fb431ba"} Jul 14 05:01:56.996582 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:56.996204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" event={"ID":"013974e7-1ef9-4d01-84dd-98b18e76ea56","Type":"ContainerStarted","Data":"c4f5030b4dd3671623a611e84156cb413377dfb7d750396f93cd5e30eb0e0363"} Jul 14 05:01:57.004035 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.004001 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"489b79be82baaa4820d0c2ef9c56658841c02911e0992c68eda437a873afc9c1"} Jul 14 05:01:57.004214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.004090 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"ae7c1d91d90aa798464040552fed6b798cc627ce85f309840ad418e27f02bc4f"} Jul 14 05:01:57.004214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.004121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"9e9b3c1130d5240c576a041eaec46267201e2ca50fe3409c6e00f2b98e1f4fa8"} Jul 14 05:01:57.004214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.004144 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"837b78e25cf73aa0368ffe1e3d835802ea293af6a7b02a5c82293646f8dbae56"} Jul 14 05:01:57.004214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.004166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"c389f8dcee9e5e83210a78985dfdb6a26fa94d9dc8c6bf4c2141443f56e55887"} Jul 14 05:01:57.004214 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.004189 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1a61998d-0948-4724-9ef2-550de2c1ee2c","Type":"ContainerStarted","Data":"93bdf7ebe61820f14bf4a56665a73e70937a25eff14846cb5cbf6a04f4ae244f"} Jul 14 05:01:57.022218 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.022132 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-59c99dff7d-bm94m" podStartSLOduration=2.273757813 podStartE2EDuration="4.022115718s" totalImagesPullingTime="1.748357905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:01:57.020476369 +0000 UTC m=+152.341241748" watchObservedRunningTime="2026-07-14 05:01:57.022115718 +0000 UTC m=+152.342881080" Jul 14 05:01:57.053283 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:01:57.053230 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.034310901 podStartE2EDuration="2.053213624s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.902723ms" isStatefulPod=false podCreationTimestamp="2026-07-14 05:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:01:57.050816715 +0000 UTC m=+152.371582090" watchObservedRunningTime="2026-07-14 05:01:57.053213624 +0000 UTC m=+152.373978986" Jul 14 05:02:00.360787 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:02:00.360753 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:02:55.361548 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:02:55.361503 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:02:55.376599 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:02:55.376572 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:02:56.240919 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:02:56.240894 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 14 05:04:25.077217 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:25.077186 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:04:25.079766 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:25.079743 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:04:25.082300 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:25.082283 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 05:04:36.923552 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:36.923515 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f"] Jul 14 05:04:36.926901 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:36.926879 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:36.929572 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:36.929547 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 05:04:36.929701 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:36.929569 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-45vlz\"" Jul 14 05:04:36.930814 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:36.930793 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 05:04:36.937371 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:36.937347 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f"] Jul 14 05:04:37.001800 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.001763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc77x\" (UniqueName: \"kubernetes.io/projected/62ba4dc1-a409-4487-8093-7953352d576b-kube-api-access-qc77x\") pod \"openshift-lws-operator-fd8ccff4c-s8k5f\" (UID: \"62ba4dc1-a409-4487-8093-7953352d576b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.001800 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.001802 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62ba4dc1-a409-4487-8093-7953352d576b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s8k5f\" (UID: \"62ba4dc1-a409-4487-8093-7953352d576b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.102550 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.102514 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc77x\" (UniqueName: \"kubernetes.io/projected/62ba4dc1-a409-4487-8093-7953352d576b-kube-api-access-qc77x\") pod \"openshift-lws-operator-fd8ccff4c-s8k5f\" (UID: \"62ba4dc1-a409-4487-8093-7953352d576b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.102740 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.102556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62ba4dc1-a409-4487-8093-7953352d576b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s8k5f\" (UID: \"62ba4dc1-a409-4487-8093-7953352d576b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.102955 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.102932 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62ba4dc1-a409-4487-8093-7953352d576b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-s8k5f\" (UID: \"62ba4dc1-a409-4487-8093-7953352d576b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.111172 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.111142 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc77x\" (UniqueName: \"kubernetes.io/projected/62ba4dc1-a409-4487-8093-7953352d576b-kube-api-access-qc77x\") pod \"openshift-lws-operator-fd8ccff4c-s8k5f\" (UID: \"62ba4dc1-a409-4487-8093-7953352d576b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.251150 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.251060 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" Jul 14 05:04:37.381519 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.381497 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f"] Jul 14 05:04:37.384246 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:04:37.384218 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62ba4dc1_a409_4487_8093_7953352d576b.slice/crio-a64faa4201e4f5aba23270cd96f31f753356dabd7d450f5baa9f1b9c476e1ac6 WatchSource:0}: Error finding container a64faa4201e4f5aba23270cd96f31f753356dabd7d450f5baa9f1b9c476e1ac6: Status 404 returned error can't find the container with id a64faa4201e4f5aba23270cd96f31f753356dabd7d450f5baa9f1b9c476e1ac6 Jul 14 05:04:37.385702 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.385683 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 05:04:37.609910 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:37.609830 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" event={"ID":"62ba4dc1-a409-4487-8093-7953352d576b","Type":"ContainerStarted","Data":"a64faa4201e4f5aba23270cd96f31f753356dabd7d450f5baa9f1b9c476e1ac6"} Jul 14 05:04:40.625174 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:40.625136 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" event={"ID":"62ba4dc1-a409-4487-8093-7953352d576b","Type":"ContainerStarted","Data":"38ae7a1b9f51679c59777d78f65e71ba0d22008903639f9738ebf77207cfc6f5"} Jul 14 05:04:40.641411 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:40.641340 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-s8k5f" podStartSLOduration=1.98622616 podStartE2EDuration="4.641317008s" totalImagesPullingTime="2.655090848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:04:40.640737826 +0000 UTC m=+315.961503196" watchObservedRunningTime="2026-07-14 05:04:40.641317008 +0000 UTC m=+315.962082371" Jul 14 05:04:59.740485 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.740431 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs"] Jul 14 05:04:59.747371 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.747343 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:04:59.750273 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.750246 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 05:04:59.751663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.751642 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 05:04:59.751663 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.751655 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ts5wc\"" Jul 14 05:04:59.751801 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.751720 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 05:04:59.755396 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.755370 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs"] Jul 14 05:04:59.906964 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.906917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-manager-config\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:04:59.907158 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.906980 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-cert\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:04:59.907158 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.907020 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk6dn\" (UniqueName: \"kubernetes.io/projected/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-kube-api-access-bk6dn\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:04:59.907158 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:04:59.907122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-metrics-cert\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.008298 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.008200 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-cert\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.008298 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.008251 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk6dn\" (UniqueName: \"kubernetes.io/projected/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-kube-api-access-bk6dn\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.008539 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.008303 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-metrics-cert\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.008539 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.008349 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-manager-config\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.009031 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.009007 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-manager-config\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.010834 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.010810 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-cert\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.010929 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.010835 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-metrics-cert\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.017893 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.017866 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk6dn\" (UniqueName: \"kubernetes.io/projected/fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab-kube-api-access-bk6dn\") pod \"lws-controller-manager-5bc55cf4-98tfs\" (UID: \"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab\") " pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.057751 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.057718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:00.208945 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.208894 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs"] Jul 14 05:05:00.211118 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:05:00.211096 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefe0f91_6bcf_4aa2_98c5_99eb7459d3ab.slice/crio-add694997a2d75d62ce4066d05be42013e9c24ccfb5aaa9bd59d8e7dfdfa12e1 WatchSource:0}: Error finding container add694997a2d75d62ce4066d05be42013e9c24ccfb5aaa9bd59d8e7dfdfa12e1: Status 404 returned error can't find the container with id add694997a2d75d62ce4066d05be42013e9c24ccfb5aaa9bd59d8e7dfdfa12e1 Jul 14 05:05:00.704686 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.704652 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" event={"ID":"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab","Type":"ContainerStarted","Data":"add694997a2d75d62ce4066d05be42013e9c24ccfb5aaa9bd59d8e7dfdfa12e1"} Jul 14 05:05:00.935062 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.935030 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt"] Jul 14 05:05:00.938721 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.938698 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:00.942082 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.942006 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 05:05:00.942313 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.942287 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 05:05:00.942406 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.942346 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gl2pb\"" Jul 14 05:05:00.942483 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.942440 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 05:05:00.942943 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.942763 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 05:05:00.958365 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:00.958297 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt"] Jul 14 05:05:01.115713 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.115682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.115918 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.115733 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-manifests\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.115918 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.115759 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-tmp\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.115918 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.115828 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.115918 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.115913 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmzfh\" (UniqueName: \"kubernetes.io/projected/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-kube-api-access-fmzfh\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.217080 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.216980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.217080 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.217031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-manifests\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.217080 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.217060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-tmp\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.217712 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.217235 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.217712 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.217340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmzfh\" (UniqueName: \"kubernetes.io/projected/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-kube-api-access-fmzfh\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.217712 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.217641 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-manifests\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.220102 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.220051 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-tmp\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.220716 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.220672 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.220819 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.220769 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.228504 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.228455 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmzfh\" (UniqueName: \"kubernetes.io/projected/b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce-kube-api-access-fmzfh\") pod \"opendatahub-operator-controller-manager-6d474f5bbf-lxvwt\" (UID: \"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce\") " pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.252583 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.252550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:01.418017 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.417976 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt"] Jul 14 05:05:01.676855 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:05:01.676818 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9fbfc2c_ca51_4b0c_96cb_b847b67c39ce.slice/crio-22f013d07e419331b577a0cbc8abd9b106ea1c63157284d9ba10bb091a304873 WatchSource:0}: Error finding container 22f013d07e419331b577a0cbc8abd9b106ea1c63157284d9ba10bb091a304873: Status 404 returned error can't find the container with id 22f013d07e419331b577a0cbc8abd9b106ea1c63157284d9ba10bb091a304873 Jul 14 05:05:01.710532 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:01.710490 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" event={"ID":"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce","Type":"ContainerStarted","Data":"22f013d07e419331b577a0cbc8abd9b106ea1c63157284d9ba10bb091a304873"} Jul 14 05:05:02.716541 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:02.716504 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" event={"ID":"fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab","Type":"ContainerStarted","Data":"b367ce8d39c828b52f240390c31d8dbc5ef55563ce0df38f95261e0053d9a8c8"} Jul 14 05:05:02.716990 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:02.716608 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:02.735221 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:02.735168 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" podStartSLOduration=2.214225737 podStartE2EDuration="3.735144958s" totalImagesPullingTime="1.520919221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:04:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:02.73385026 +0000 UTC m=+338.054615647" watchObservedRunningTime="2026-07-14 05:05:02.735144958 +0000 UTC m=+338.055910365" Jul 14 05:05:05.732323 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:05.732279 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" event={"ID":"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce","Type":"ContainerStarted","Data":"56b649210e3518f82701c84e1ace7edc6113a743b635845bf767e72a7dbc1aab"} Jul 14 05:05:06.737793 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:06.737755 2560 generic.go:356] "Generic (PLEG): container finished" podID="b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce" containerID="56b649210e3518f82701c84e1ace7edc6113a743b635845bf767e72a7dbc1aab" exitCode=0 Jul 14 05:05:06.738190 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:06.737849 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" event={"ID":"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce","Type":"ContainerDied","Data":"56b649210e3518f82701c84e1ace7edc6113a743b635845bf767e72a7dbc1aab"} Jul 14 05:05:07.744134 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:07.744099 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" event={"ID":"b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce","Type":"ContainerStarted","Data":"d54462f902999c004ca2f2df5a465841c5f9fb7a90d8f2752e20395223bcf944"} Jul 14 05:05:07.744592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:07.744240 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:07.768876 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:07.768821 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" podStartSLOduration=3.080395923 podStartE2EDuration="7.768801441s" totalImagesPullingTime="3.662508823s" totalInitContainerRuntime="1.025896695s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:07.766987971 +0000 UTC m=+343.087753358" watchObservedRunningTime="2026-07-14 05:05:07.768801441 +0000 UTC m=+343.089566804" Jul 14 05:05:13.724507 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:13.724446 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bc55cf4-98tfs" Jul 14 05:05:18.751587 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:18.751509 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d474f5bbf-lxvwt" Jul 14 05:05:20.787995 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.787955 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr"] Jul 14 05:05:20.794312 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.794283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.796729 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.796703 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 05:05:20.798177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.798149 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 05:05:20.798177 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.798149 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 05:05:20.798374 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.798179 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mpprc\"" Jul 14 05:05:20.798374 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.798346 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 05:05:20.803617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.803590 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr"] Jul 14 05:05:20.875635 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.875593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tmp\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.875824 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.875654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6cfd\" (UniqueName: \"kubernetes.io/projected/d90f6e47-8a71-4c2f-9572-66efcf8ac315-kube-api-access-f6cfd\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.875824 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.875752 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.976639 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.976600 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6cfd\" (UniqueName: \"kubernetes.io/projected/d90f6e47-8a71-4c2f-9572-66efcf8ac315-kube-api-access-f6cfd\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.976639 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.976654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.976897 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.976705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tmp\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:20.976897 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:05:20.976832 2560 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 14 05:05:20.977010 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:05:20.976904 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tls-certs podName:d90f6e47-8a71-4c2f-9572-66efcf8ac315 nodeName:}" failed. No retries permitted until 2026-07-14 05:05:21.476883316 +0000 UTC m=+356.797648673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tls-certs") pod "kube-auth-proxy-5d4dd7888d-vmtkr" (UID: "d90f6e47-8a71-4c2f-9572-66efcf8ac315") : secret "kube-auth-proxy-tls" not found Jul 14 05:05:20.978931 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:20.978910 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tmp\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:21.004396 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:21.004367 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6cfd\" (UniqueName: \"kubernetes.io/projected/d90f6e47-8a71-4c2f-9572-66efcf8ac315-kube-api-access-f6cfd\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:21.481016 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:21.480967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:21.483908 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:21.483872 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d90f6e47-8a71-4c2f-9572-66efcf8ac315-tls-certs\") pod \"kube-auth-proxy-5d4dd7888d-vmtkr\" (UID: \"d90f6e47-8a71-4c2f-9572-66efcf8ac315\") " pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:21.705335 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:21.705283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" Jul 14 05:05:21.905911 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:21.905884 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr"] Jul 14 05:05:21.908608 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:05:21.908570 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90f6e47_8a71_4c2f_9572_66efcf8ac315.slice/crio-7ee91e1ec439169533c3bda202d9a669fc450b314e4d0a6f4523020aceb0775e WatchSource:0}: Error finding container 7ee91e1ec439169533c3bda202d9a669fc450b314e4d0a6f4523020aceb0775e: Status 404 returned error can't find the container with id 7ee91e1ec439169533c3bda202d9a669fc450b314e4d0a6f4523020aceb0775e Jul 14 05:05:22.812289 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:22.812242 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" event={"ID":"d90f6e47-8a71-4c2f-9572-66efcf8ac315","Type":"ContainerStarted","Data":"7ee91e1ec439169533c3bda202d9a669fc450b314e4d0a6f4523020aceb0775e"} Jul 14 05:05:25.381140 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:25.381115 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 05:05:25.827511 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:25.827457 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" event={"ID":"d90f6e47-8a71-4c2f-9572-66efcf8ac315","Type":"ContainerStarted","Data":"699145c6f7a48c3123f0fa15627109df53367b3d353679d440f3ce9dc4a0ab2d"} Jul 14 05:05:25.844224 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:25.844171 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d4dd7888d-vmtkr" podStartSLOduration=2.376775432 podStartE2EDuration="5.844150139s" totalImagesPullingTime="3.467374707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:25.843493463 +0000 UTC m=+361.164258841" watchObservedRunningTime="2026-07-14 05:05:25.844150139 +0000 UTC m=+361.164915503" Jul 14 05:05:32.192941 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.192903 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tphwk"] Jul 14 05:05:32.195522 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.195502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.198453 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.198429 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-854tm\"" Jul 14 05:05:32.198768 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.198751 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 05:05:32.209030 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.209004 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tphwk"] Jul 14 05:05:32.280408 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.280365 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t28mx\" (UniqueName: \"kubernetes.io/projected/f2c1bcc3-87ea-4493-898e-467fd53ac401-kube-api-access-t28mx\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.280616 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.280576 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1bcc3-87ea-4493-898e-467fd53ac401-cert\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.381531 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.381498 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1bcc3-87ea-4493-898e-467fd53ac401-cert\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.381531 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.381541 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t28mx\" (UniqueName: \"kubernetes.io/projected/f2c1bcc3-87ea-4493-898e-467fd53ac401-kube-api-access-t28mx\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.381757 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:05:32.381656 2560 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 14 05:05:32.381757 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:05:32.381718 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c1bcc3-87ea-4493-898e-467fd53ac401-cert podName:f2c1bcc3-87ea-4493-898e-467fd53ac401 nodeName:}" failed. No retries permitted until 2026-07-14 05:05:32.881703951 +0000 UTC m=+368.202469291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f2c1bcc3-87ea-4493-898e-467fd53ac401-cert") pod "kserve-controller-manager-d6f4b65b8-tphwk" (UID: "f2c1bcc3-87ea-4493-898e-467fd53ac401") : secret "kserve-webhook-server-cert" not found Jul 14 05:05:32.396643 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.396609 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t28mx\" (UniqueName: \"kubernetes.io/projected/f2c1bcc3-87ea-4493-898e-467fd53ac401-kube-api-access-t28mx\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.887926 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.887883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1bcc3-87ea-4493-898e-467fd53ac401-cert\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:32.890381 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:32.890349 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c1bcc3-87ea-4493-898e-467fd53ac401-cert\") pod \"kserve-controller-manager-d6f4b65b8-tphwk\" (UID: \"f2c1bcc3-87ea-4493-898e-467fd53ac401\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:33.106389 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:33.106348 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:33.254586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:33.254494 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-tphwk"] Jul 14 05:05:33.265581 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:05:33.265550 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c1bcc3_87ea_4493_898e_467fd53ac401.slice/crio-72c2b22264b1e414c8d73fe116858a18678b77dcfa6c604427c9b958ff702202 WatchSource:0}: Error finding container 72c2b22264b1e414c8d73fe116858a18678b77dcfa6c604427c9b958ff702202: Status 404 returned error can't find the container with id 72c2b22264b1e414c8d73fe116858a18678b77dcfa6c604427c9b958ff702202 Jul 14 05:05:33.864777 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:33.864733 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" event={"ID":"f2c1bcc3-87ea-4493-898e-467fd53ac401","Type":"ContainerStarted","Data":"72c2b22264b1e414c8d73fe116858a18678b77dcfa6c604427c9b958ff702202"} Jul 14 05:05:35.875378 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:35.875341 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" event={"ID":"f2c1bcc3-87ea-4493-898e-467fd53ac401","Type":"ContainerStarted","Data":"39830b4b5c8a299a7606fdef0e70007d463f6a6e94b1fa627cf7ad9d570a05de"} Jul 14 05:05:35.875855 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:35.875428 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:05:35.900165 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:05:35.900112 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" podStartSLOduration=1.438880224 podStartE2EDuration="3.900093213s" totalImagesPullingTime="2.461212989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:05:35.899845094 +0000 UTC m=+371.220610458" watchObservedRunningTime="2026-07-14 05:05:35.900093213 +0000 UTC m=+371.220858575" Jul 14 05:06:06.886046 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:06.886013 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-tphwk" Jul 14 05:06:59.927650 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.927565 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d79b66c5-wcnkv"] Jul 14 05:06:59.931206 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.931182 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.934142 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.934109 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 05:06:59.934282 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.934161 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gln6k\"" Jul 14 05:06:59.934282 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.934247 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 05:06:59.935441 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.935420 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 05:06:59.935571 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.935420 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 05:06:59.935739 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.935713 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 05:06:59.935970 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.935955 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 05:06:59.936064 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.935966 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 05:06:59.940744 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.940724 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 05:06:59.943914 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.943892 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d79b66c5-wcnkv"] Jul 14 05:06:59.962804 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.962769 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-service-ca\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.962994 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.962815 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh9q2\" (UniqueName: \"kubernetes.io/projected/221f6d0d-193d-473d-930c-3955194eb5d8-kube-api-access-dh9q2\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.962994 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.962893 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-trusted-ca-bundle\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.962994 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.962919 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-console-config\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.962994 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.962955 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221f6d0d-193d-473d-930c-3955194eb5d8-console-serving-cert\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.963180 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.963032 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221f6d0d-193d-473d-930c-3955194eb5d8-console-oauth-config\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:06:59.963180 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:06:59.963060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-oauth-serving-cert\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.063873 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.063833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-service-ca\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.063873 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.063873 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh9q2\" (UniqueName: \"kubernetes.io/projected/221f6d0d-193d-473d-930c-3955194eb5d8-kube-api-access-dh9q2\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064137 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.063923 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-trusted-ca-bundle\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064137 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.063945 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-console-config\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064137 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.063976 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221f6d0d-193d-473d-930c-3955194eb5d8-console-serving-cert\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064137 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.064030 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221f6d0d-193d-473d-930c-3955194eb5d8-console-oauth-config\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064137 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.064055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-oauth-serving-cert\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064745 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.064695 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-console-config\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064745 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.064724 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-service-ca\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064888 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.064778 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-oauth-serving-cert\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.064888 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.064838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f6d0d-193d-473d-930c-3955194eb5d8-trusted-ca-bundle\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.066584 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.066552 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/221f6d0d-193d-473d-930c-3955194eb5d8-console-oauth-config\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.066683 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.066642 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/221f6d0d-193d-473d-930c-3955194eb5d8-console-serving-cert\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.072561 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.072533 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh9q2\" (UniqueName: \"kubernetes.io/projected/221f6d0d-193d-473d-930c-3955194eb5d8-kube-api-access-dh9q2\") pod \"console-59d79b66c5-wcnkv\" (UID: \"221f6d0d-193d-473d-930c-3955194eb5d8\") " pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.242740 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.242650 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:00.384592 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:00.384426 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d79b66c5-wcnkv"] Jul 14 05:07:00.387126 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:07:00.387099 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221f6d0d_193d_473d_930c_3955194eb5d8.slice/crio-1d24c26a592f9c4d94a99cbe87e43151dd150ff1b4bd53b32124e5807d51b3f5 WatchSource:0}: Error finding container 1d24c26a592f9c4d94a99cbe87e43151dd150ff1b4bd53b32124e5807d51b3f5: Status 404 returned error can't find the container with id 1d24c26a592f9c4d94a99cbe87e43151dd150ff1b4bd53b32124e5807d51b3f5 Jul 14 05:07:01.257389 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:01.257355 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d79b66c5-wcnkv" event={"ID":"221f6d0d-193d-473d-930c-3955194eb5d8","Type":"ContainerStarted","Data":"51c69d812795d7d49ad5d599b45b33b499c91177ee2c20898cd07e82bac79ee4"} Jul 14 05:07:01.257799 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:01.257404 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d79b66c5-wcnkv" event={"ID":"221f6d0d-193d-473d-930c-3955194eb5d8","Type":"ContainerStarted","Data":"1d24c26a592f9c4d94a99cbe87e43151dd150ff1b4bd53b32124e5807d51b3f5"} Jul 14 05:07:01.279058 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:01.279006 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d79b66c5-wcnkv" podStartSLOduration=2.278989713 podStartE2EDuration="2.278989713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:06:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:01.276985246 +0000 UTC m=+456.597750620" watchObservedRunningTime="2026-07-14 05:07:01.278989713 +0000 UTC m=+456.599755075" Jul 14 05:07:06.467849 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.467806 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m"] Jul 14 05:07:06.471591 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.471570 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.474508 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.474446 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 05:07:06.475730 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.475709 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 05:07:06.475831 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.475707 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sq87f\"" Jul 14 05:07:06.475831 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.475766 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 05:07:06.475831 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.475760 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 05:07:06.478964 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.478935 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m"] Jul 14 05:07:06.530961 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.530926 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cde7b2f-8af8-471d-a53b-e3dd21839067-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.531176 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.530984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8cde7b2f-8af8-471d-a53b-e3dd21839067-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.531176 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.531011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lpb\" (UniqueName: \"kubernetes.io/projected/8cde7b2f-8af8-471d-a53b-e3dd21839067-kube-api-access-55lpb\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.632393 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.632350 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cde7b2f-8af8-471d-a53b-e3dd21839067-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.632623 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.632402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8cde7b2f-8af8-471d-a53b-e3dd21839067-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.632623 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.632423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55lpb\" (UniqueName: \"kubernetes.io/projected/8cde7b2f-8af8-471d-a53b-e3dd21839067-kube-api-access-55lpb\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.632623 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:07:06.632517 2560 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 14 05:07:06.632623 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:07:06.632588 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cde7b2f-8af8-471d-a53b-e3dd21839067-plugin-serving-cert podName:8cde7b2f-8af8-471d-a53b-e3dd21839067 nodeName:}" failed. No retries permitted until 2026-07-14 05:07:07.132568888 +0000 UTC m=+462.453334231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8cde7b2f-8af8-471d-a53b-e3dd21839067-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9wd7m" (UID: "8cde7b2f-8af8-471d-a53b-e3dd21839067") : secret "plugin-serving-cert" not found Jul 14 05:07:06.633078 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.633057 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8cde7b2f-8af8-471d-a53b-e3dd21839067-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:06.644559 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:06.644529 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lpb\" (UniqueName: \"kubernetes.io/projected/8cde7b2f-8af8-471d-a53b-e3dd21839067-kube-api-access-55lpb\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:07.137095 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:07.137053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cde7b2f-8af8-471d-a53b-e3dd21839067-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:07.139534 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:07.139501 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cde7b2f-8af8-471d-a53b-e3dd21839067-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wd7m\" (UID: \"8cde7b2f-8af8-471d-a53b-e3dd21839067\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:07.383599 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:07.383560 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" Jul 14 05:07:07.515766 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:07.515735 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m"] Jul 14 05:07:07.519038 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:07:07.519002 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cde7b2f_8af8_471d_a53b_e3dd21839067.slice/crio-bee032e8cc2c0f11d1146d96f93722749ddb5ebb87645f040e7efb40950dedf6 WatchSource:0}: Error finding container bee032e8cc2c0f11d1146d96f93722749ddb5ebb87645f040e7efb40950dedf6: Status 404 returned error can't find the container with id bee032e8cc2c0f11d1146d96f93722749ddb5ebb87645f040e7efb40950dedf6 Jul 14 05:07:08.288682 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:08.288650 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" event={"ID":"8cde7b2f-8af8-471d-a53b-e3dd21839067","Type":"ContainerStarted","Data":"bee032e8cc2c0f11d1146d96f93722749ddb5ebb87645f040e7efb40950dedf6"} Jul 14 05:07:10.243478 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:10.243430 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:10.243958 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:10.243512 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:10.249869 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:10.249835 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:10.303425 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:10.303392 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d79b66c5-wcnkv" Jul 14 05:07:31.419917 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:31.419825 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" event={"ID":"8cde7b2f-8af8-471d-a53b-e3dd21839067","Type":"ContainerStarted","Data":"ba94d35ff880b910a31624c2162191d18eccd898855e2c59fb62b02b73658f4d"} Jul 14 05:07:31.437204 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:31.437148 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wd7m" podStartSLOduration=1.797665721 podStartE2EDuration="25.437129606s" totalImagesPullingTime="23.639463885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:31.435091497 +0000 UTC m=+486.755856889" watchObservedRunningTime="2026-07-14 05:07:31.437129606 +0000 UTC m=+486.757894969" Jul 14 05:07:48.627120 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.627082 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:07:48.630594 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.630572 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.633773 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.633743 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 05:07:48.639260 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.639235 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:07:48.669056 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.669023 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:07:48.745559 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.745521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flsrr\" (UniqueName: \"kubernetes.io/projected/7c7dd460-7de9-4bc8-ac3c-6217048958da-kube-api-access-flsrr\") pod \"limitador-limitador-54d6d988d5-c2jzd\" (UID: \"7c7dd460-7de9-4bc8-ac3c-6217048958da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.745559 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.745566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7c7dd460-7de9-4bc8-ac3c-6217048958da-config-file\") pod \"limitador-limitador-54d6d988d5-c2jzd\" (UID: \"7c7dd460-7de9-4bc8-ac3c-6217048958da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.846705 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.846665 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flsrr\" (UniqueName: \"kubernetes.io/projected/7c7dd460-7de9-4bc8-ac3c-6217048958da-kube-api-access-flsrr\") pod \"limitador-limitador-54d6d988d5-c2jzd\" (UID: \"7c7dd460-7de9-4bc8-ac3c-6217048958da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.846705 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.846711 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7c7dd460-7de9-4bc8-ac3c-6217048958da-config-file\") pod \"limitador-limitador-54d6d988d5-c2jzd\" (UID: \"7c7dd460-7de9-4bc8-ac3c-6217048958da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.847422 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.847401 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7c7dd460-7de9-4bc8-ac3c-6217048958da-config-file\") pod \"limitador-limitador-54d6d988d5-c2jzd\" (UID: \"7c7dd460-7de9-4bc8-ac3c-6217048958da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.868039 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.868012 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flsrr\" (UniqueName: \"kubernetes.io/projected/7c7dd460-7de9-4bc8-ac3c-6217048958da-kube-api-access-flsrr\") pod \"limitador-limitador-54d6d988d5-c2jzd\" (UID: \"7c7dd460-7de9-4bc8-ac3c-6217048958da\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:48.942002 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:48.941965 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:49.084917 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.077915 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:07:49.089665 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.089620 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-vsm5b"] Jul 14 05:07:49.089935 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:07:49.089901 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7dd460_7de9_4bc8_ac3c_6217048958da.slice/crio-d64109c67181cf7e16b2ec8abd9d66b486b63315eff1a7d854237a6489324b61 WatchSource:0}: Error finding container d64109c67181cf7e16b2ec8abd9d66b486b63315eff1a7d854237a6489324b61: Status 404 returned error can't find the container with id d64109c67181cf7e16b2ec8abd9d66b486b63315eff1a7d854237a6489324b61 Jul 14 05:07:49.094344 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.094322 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:49.096814 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.096782 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ghbkw\"" Jul 14 05:07:49.100358 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.100331 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vsm5b"] Jul 14 05:07:49.249560 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.249414 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cv5d\" (UniqueName: \"kubernetes.io/projected/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b-kube-api-access-6cv5d\") pod \"authorino-58cd955675-vsm5b\" (UID: \"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b\") " pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:49.350713 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.350672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cv5d\" (UniqueName: \"kubernetes.io/projected/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b-kube-api-access-6cv5d\") pod \"authorino-58cd955675-vsm5b\" (UID: \"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b\") " pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:49.359441 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.359411 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cv5d\" (UniqueName: \"kubernetes.io/projected/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b-kube-api-access-6cv5d\") pod \"authorino-58cd955675-vsm5b\" (UID: \"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b\") " pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:49.406367 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.406318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:49.504408 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.504299 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" event={"ID":"7c7dd460-7de9-4bc8-ac3c-6217048958da","Type":"ContainerStarted","Data":"d64109c67181cf7e16b2ec8abd9d66b486b63315eff1a7d854237a6489324b61"} Jul 14 05:07:49.544304 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:49.544268 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-vsm5b"] Jul 14 05:07:49.546894 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:07:49.546861 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4da251ed_f6e3_41c2_bdbd_1e4dc2750e5b.slice/crio-ab022dc343a38fbc5580837644f3b943813ccfb419911a103776d42282dbeda1 WatchSource:0}: Error finding container ab022dc343a38fbc5580837644f3b943813ccfb419911a103776d42282dbeda1: Status 404 returned error can't find the container with id ab022dc343a38fbc5580837644f3b943813ccfb419911a103776d42282dbeda1 Jul 14 05:07:50.513609 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:50.513536 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vsm5b" event={"ID":"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b","Type":"ContainerStarted","Data":"ab022dc343a38fbc5580837644f3b943813ccfb419911a103776d42282dbeda1"} Jul 14 05:07:53.531419 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:53.531384 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" event={"ID":"7c7dd460-7de9-4bc8-ac3c-6217048958da","Type":"ContainerStarted","Data":"ce837016bc204dafa891f3c52b94cef2f481ae6655b7833e5b82dde2d6dc3d22"} Jul 14 05:07:53.531936 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:53.531508 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:07:53.533717 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:53.533692 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vsm5b" event={"ID":"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b","Type":"ContainerStarted","Data":"2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db"} Jul 14 05:07:53.555355 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:53.555279 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" podStartSLOduration=1.220724589 podStartE2EDuration="5.555261874s" totalImagesPullingTime="4.334537285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:53.552716947 +0000 UTC m=+508.873482310" watchObservedRunningTime="2026-07-14 05:07:53.555261874 +0000 UTC m=+508.876027237" Jul 14 05:07:53.568424 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:53.568359 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-vsm5b" podStartSLOduration=0.682994715 podStartE2EDuration="4.568337381s" totalImagesPullingTime="3.885342666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:07:53.568087247 +0000 UTC m=+508.888852611" watchObservedRunningTime="2026-07-14 05:07:53.568337381 +0000 UTC m=+508.889102746" Jul 14 05:07:54.210347 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:54.210303 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vsm5b"] Jul 14 05:07:55.542146 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:55.542109 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-vsm5b" podUID="4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" containerName="authorino" containerID="cri-o://2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db" gracePeriod=30 Jul 14 05:07:55.787622 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:55.787589 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:55.916984 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:55.916948 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cv5d\" (UniqueName: \"kubernetes.io/projected/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b-kube-api-access-6cv5d\") pod \"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b\" (UID: \"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b\") " Jul 14 05:07:55.919173 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:55.919143 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b-kube-api-access-6cv5d" (OuterVolumeSpecName: "kube-api-access-6cv5d") pod "4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" (UID: "4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b"). InnerVolumeSpecName "kube-api-access-6cv5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:07:56.017831 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.017785 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cv5d\" (UniqueName: \"kubernetes.io/projected/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b-kube-api-access-6cv5d\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:07:56.547872 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.547836 2560 generic.go:356] "Generic (PLEG): container finished" podID="4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" containerID="2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db" exitCode=0 Jul 14 05:07:56.548272 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.547899 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-vsm5b" Jul 14 05:07:56.548272 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.547892 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vsm5b" event={"ID":"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b","Type":"ContainerDied","Data":"2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db"} Jul 14 05:07:56.548272 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.548002 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-vsm5b" event={"ID":"4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b","Type":"ContainerDied","Data":"ab022dc343a38fbc5580837644f3b943813ccfb419911a103776d42282dbeda1"} Jul 14 05:07:56.548272 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.548023 2560 scope.go:117] "RemoveContainer" containerID="2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db" Jul 14 05:07:56.557084 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.557064 2560 scope.go:117] "RemoveContainer" containerID="2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db" Jul 14 05:07:56.557390 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:07:56.557370 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db\": container with ID starting with 2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db not found: ID does not exist" containerID="2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db" Jul 14 05:07:56.557447 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.557400 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db"} err="failed to get container status \"2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db\": rpc error: code = NotFound desc = could not find container \"2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db\": container with ID starting with 2dfecc61ac4e321930c7fd0c429b79aafc0a7d2a715370d94539787c3d9863db not found: ID does not exist" Jul 14 05:07:56.570586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.570552 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-vsm5b"] Jul 14 05:07:56.572527 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:56.572504 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-vsm5b"] Jul 14 05:07:57.253112 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:07:57.253080 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" path="/var/lib/kubelet/pods/4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b/volumes" Jul 14 05:08:04.539433 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:04.539393 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-c2jzd" Jul 14 05:08:22.857437 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.857361 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jccph"] Jul 14 05:08:22.857812 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.857791 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" containerName="authorino" Jul 14 05:08:22.857812 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.857808 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" containerName="authorino" Jul 14 05:08:22.857902 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.857889 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da251ed-f6e3-41c2-bdbd-1e4dc2750e5b" containerName="authorino" Jul 14 05:08:22.922545 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.922505 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jccph"] Jul 14 05:08:22.922710 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.922614 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:22.925636 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.925609 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ghbkw\"" Jul 14 05:08:22.953556 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:22.953512 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs2l7\" (UniqueName: \"kubernetes.io/projected/7b6ffa1e-012e-4cb3-9718-5edc63a29339-kube-api-access-rs2l7\") pod \"authorino-5d4b67c446-jccph\" (UID: \"7b6ffa1e-012e-4cb3-9718-5edc63a29339\") " pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:23.054853 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.054813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs2l7\" (UniqueName: \"kubernetes.io/projected/7b6ffa1e-012e-4cb3-9718-5edc63a29339-kube-api-access-rs2l7\") pod \"authorino-5d4b67c446-jccph\" (UID: \"7b6ffa1e-012e-4cb3-9718-5edc63a29339\") " pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:23.057885 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.057856 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jccph"] Jul 14 05:08:23.058158 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:08:23.058137 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rs2l7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-jccph" podUID="7b6ffa1e-012e-4cb3-9718-5edc63a29339" Jul 14 05:08:23.071213 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.071184 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs2l7\" (UniqueName: \"kubernetes.io/projected/7b6ffa1e-012e-4cb3-9718-5edc63a29339-kube-api-access-rs2l7\") pod \"authorino-5d4b67c446-jccph\" (UID: \"7b6ffa1e-012e-4cb3-9718-5edc63a29339\") " pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:23.151249 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.151213 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-675b6d8ff5-9vg9x"] Jul 14 05:08:23.169709 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.169667 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-675b6d8ff5-9vg9x"] Jul 14 05:08:23.169898 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.169799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.172509 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.172485 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 05:08:23.256771 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.256741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08c90320-a52a-4e67-8a20-aa77b44bda7d-tls-cert\") pod \"authorino-675b6d8ff5-9vg9x\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.256938 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.256811 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sttdz\" (UniqueName: \"kubernetes.io/projected/08c90320-a52a-4e67-8a20-aa77b44bda7d-kube-api-access-sttdz\") pod \"authorino-675b6d8ff5-9vg9x\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.357406 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.357368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sttdz\" (UniqueName: \"kubernetes.io/projected/08c90320-a52a-4e67-8a20-aa77b44bda7d-kube-api-access-sttdz\") pod \"authorino-675b6d8ff5-9vg9x\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.357816 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.357790 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08c90320-a52a-4e67-8a20-aa77b44bda7d-tls-cert\") pod \"authorino-675b6d8ff5-9vg9x\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.360287 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.360252 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08c90320-a52a-4e67-8a20-aa77b44bda7d-tls-cert\") pod \"authorino-675b6d8ff5-9vg9x\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.366222 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.366198 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sttdz\" (UniqueName: \"kubernetes.io/projected/08c90320-a52a-4e67-8a20-aa77b44bda7d-kube-api-access-sttdz\") pod \"authorino-675b6d8ff5-9vg9x\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.480571 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.480480 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:08:23.632597 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.632557 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-675b6d8ff5-9vg9x"] Jul 14 05:08:23.635651 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:08:23.635619 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08c90320_a52a_4e67_8a20_aa77b44bda7d.slice/crio-ba9ca4c8c2665f29076dc32614cc2f46785638697bed6a4f47a21f0fcd55e70a WatchSource:0}: Error finding container ba9ca4c8c2665f29076dc32614cc2f46785638697bed6a4f47a21f0fcd55e70a: Status 404 returned error can't find the container with id ba9ca4c8c2665f29076dc32614cc2f46785638697bed6a4f47a21f0fcd55e70a Jul 14 05:08:23.678405 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.678374 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:23.678590 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.678369 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" event={"ID":"08c90320-a52a-4e67-8a20-aa77b44bda7d","Type":"ContainerStarted","Data":"ba9ca4c8c2665f29076dc32614cc2f46785638697bed6a4f47a21f0fcd55e70a"} Jul 14 05:08:23.719456 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.719417 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:23.761235 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.761143 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs2l7\" (UniqueName: \"kubernetes.io/projected/7b6ffa1e-012e-4cb3-9718-5edc63a29339-kube-api-access-rs2l7\") pod \"7b6ffa1e-012e-4cb3-9718-5edc63a29339\" (UID: \"7b6ffa1e-012e-4cb3-9718-5edc63a29339\") " Jul 14 05:08:23.763242 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.763210 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6ffa1e-012e-4cb3-9718-5edc63a29339-kube-api-access-rs2l7" (OuterVolumeSpecName: "kube-api-access-rs2l7") pod "7b6ffa1e-012e-4cb3-9718-5edc63a29339" (UID: "7b6ffa1e-012e-4cb3-9718-5edc63a29339"). InnerVolumeSpecName "kube-api-access-rs2l7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:08:23.862548 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:23.862507 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs2l7\" (UniqueName: \"kubernetes.io/projected/7b6ffa1e-012e-4cb3-9718-5edc63a29339-kube-api-access-rs2l7\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:08:24.684867 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:24.684831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" event={"ID":"08c90320-a52a-4e67-8a20-aa77b44bda7d","Type":"ContainerStarted","Data":"a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c"} Jul 14 05:08:24.685074 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:24.684985 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jccph" Jul 14 05:08:24.700081 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:24.700033 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" podStartSLOduration=1.239265732 podStartE2EDuration="1.700010174s" totalImagesPullingTime="460.744442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:08:24.699598099 +0000 UTC m=+540.020363482" watchObservedRunningTime="2026-07-14 05:08:24.700010174 +0000 UTC m=+540.020775536" Jul 14 05:08:24.723666 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:24.723634 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jccph"] Jul 14 05:08:24.727134 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:24.727106 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jccph"] Jul 14 05:08:25.261222 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:08:25.261191 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b6ffa1e-012e-4cb3-9718-5edc63a29339" path="/var/lib/kubelet/pods/7b6ffa1e-012e-4cb3-9718-5edc63a29339/volumes" Jul 14 05:09:07.018082 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:09:07.018048 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:09:25.108354 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:09:25.108322 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:09:25.108826 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:09:25.108494 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:09:46.246537 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:09:46.246328 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:09:55.853198 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:09:55.853160 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:10:13.256236 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:13.256204 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:10:17.454957 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:17.454912 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:10:23.459189 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:23.458498 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:10:25.637721 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.637685 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz"] Jul 14 05:10:25.641426 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.641403 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.644170 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.644146 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 14 05:10:25.645625 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.645601 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qw6h\"" Jul 14 05:10:25.645737 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.645663 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 14 05:10:25.645737 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.645703 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 14 05:10:25.651538 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.651515 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz"] Jul 14 05:10:25.680652 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.680619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.680842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.680659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.680842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.680684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.680842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.680772 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nglbf\" (UniqueName: \"kubernetes.io/projected/e7b27235-993d-4292-b7be-b7ce43ea659a-kube-api-access-nglbf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.680842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.680802 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b27235-993d-4292-b7be-b7ce43ea659a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.680842 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.680838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781362 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781393 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781431 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781491 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nglbf\" (UniqueName: \"kubernetes.io/projected/e7b27235-993d-4292-b7be-b7ce43ea659a-kube-api-access-nglbf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781586 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b27235-993d-4292-b7be-b7ce43ea659a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781840 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781787 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781906 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781836 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.781906 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.781881 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.783722 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.783701 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7b27235-993d-4292-b7be-b7ce43ea659a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.783965 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.783948 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b27235-993d-4292-b7be-b7ce43ea659a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.794358 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.794328 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nglbf\" (UniqueName: \"kubernetes.io/projected/e7b27235-993d-4292-b7be-b7ce43ea659a-kube-api-access-nglbf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz\" (UID: \"e7b27235-993d-4292-b7be-b7ce43ea659a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:25.951495 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:25.951381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:26.088075 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:26.088051 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz"] Jul 14 05:10:26.090101 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:10:26.090071 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7b27235_993d_4292_b7be_b7ce43ea659a.slice/crio-abbdd54646990fe7ea8b639073aa830f00e2dc711c529b578b59c6d0a8e744db WatchSource:0}: Error finding container abbdd54646990fe7ea8b639073aa830f00e2dc711c529b578b59c6d0a8e744db: Status 404 returned error can't find the container with id abbdd54646990fe7ea8b639073aa830f00e2dc711c529b578b59c6d0a8e744db Jul 14 05:10:26.091388 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:26.091373 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 05:10:26.266719 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:26.266628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" event={"ID":"e7b27235-993d-4292-b7be-b7ce43ea659a","Type":"ContainerStarted","Data":"abbdd54646990fe7ea8b639073aa830f00e2dc711c529b578b59c6d0a8e744db"} Jul 14 05:10:28.277136 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:28.277101 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" event={"ID":"e7b27235-993d-4292-b7be-b7ce43ea659a","Type":"ContainerStarted","Data":"c1d3f1f243536f8007db51380c0d693222493241348f779b79ea00a24f3fe3da"} Jul 14 05:10:28.294989 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:28.294933 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" podStartSLOduration=2.089011323 podStartE2EDuration="3.294915523s" totalImagesPullingTime="1.2059042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:10:28.292968504 +0000 UTC m=+663.613733868" watchObservedRunningTime="2026-07-14 05:10:28.294915523 +0000 UTC m=+663.615680914" Jul 14 05:10:34.454204 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:34.454164 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-c2jzd"] Jul 14 05:10:35.951769 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:35.951724 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:35.952268 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:35.951791 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:35.964147 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:35.964119 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:10:36.328520 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:10:36.328409 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz" Jul 14 05:11:24.996203 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:24.996121 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-667b98f486-hdj95"] Jul 14 05:11:24.999593 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:24.999572 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.007453 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.007187 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667b98f486-hdj95"] Jul 14 05:11:25.154838 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.154796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6a4d8a-ffe7-4780-b8a0-e66425755ac0-tls-cert\") pod \"authorino-667b98f486-hdj95\" (UID: \"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0\") " pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.154838 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.154843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gv5\" (UniqueName: \"kubernetes.io/projected/cb6a4d8a-ffe7-4780-b8a0-e66425755ac0-kube-api-access-52gv5\") pod \"authorino-667b98f486-hdj95\" (UID: \"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0\") " pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.255424 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.255343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6a4d8a-ffe7-4780-b8a0-e66425755ac0-tls-cert\") pod \"authorino-667b98f486-hdj95\" (UID: \"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0\") " pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.255424 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.255384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52gv5\" (UniqueName: \"kubernetes.io/projected/cb6a4d8a-ffe7-4780-b8a0-e66425755ac0-kube-api-access-52gv5\") pod \"authorino-667b98f486-hdj95\" (UID: \"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0\") " pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.258202 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.258173 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb6a4d8a-ffe7-4780-b8a0-e66425755ac0-tls-cert\") pod \"authorino-667b98f486-hdj95\" (UID: \"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0\") " pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.272708 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.272676 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gv5\" (UniqueName: \"kubernetes.io/projected/cb6a4d8a-ffe7-4780-b8a0-e66425755ac0-kube-api-access-52gv5\") pod \"authorino-667b98f486-hdj95\" (UID: \"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0\") " pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.310138 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.310093 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-667b98f486-hdj95" Jul 14 05:11:25.473347 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.473192 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-667b98f486-hdj95"] Jul 14 05:11:25.476157 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:11:25.476130 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb6a4d8a_ffe7_4780_b8a0_e66425755ac0.slice/crio-6a0eee26db2d3976247d055b3e0fd7446e2212d8da2960daa4f6ca5d67c31f47 WatchSource:0}: Error finding container 6a0eee26db2d3976247d055b3e0fd7446e2212d8da2960daa4f6ca5d67c31f47: Status 404 returned error can't find the container with id 6a0eee26db2d3976247d055b3e0fd7446e2212d8da2960daa4f6ca5d67c31f47 Jul 14 05:11:25.545756 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:25.545666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667b98f486-hdj95" event={"ID":"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0","Type":"ContainerStarted","Data":"6a0eee26db2d3976247d055b3e0fd7446e2212d8da2960daa4f6ca5d67c31f47"} Jul 14 05:11:26.561667 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:26.561625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-667b98f486-hdj95" event={"ID":"cb6a4d8a-ffe7-4780-b8a0-e66425755ac0","Type":"ContainerStarted","Data":"80f9bee56653dcb1ae0c1723b5153d30800615bd3babfb0f6960aa2265533349"} Jul 14 05:11:26.588307 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:26.588251 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-667b98f486-hdj95" podStartSLOduration=2.1012126269999998 podStartE2EDuration="2.588232922s" totalImagesPullingTime="487.020295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:11:26.585924774 +0000 UTC m=+721.906690135" watchObservedRunningTime="2026-07-14 05:11:26.588232922 +0000 UTC m=+721.908998320" Jul 14 05:11:26.645360 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:26.645324 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-675b6d8ff5-9vg9x"] Jul 14 05:11:26.645611 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:26.645583 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" podUID="08c90320-a52a-4e67-8a20-aa77b44bda7d" containerName="authorino" containerID="cri-o://a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c" gracePeriod=30 Jul 14 05:11:26.924006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:26.923979 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:11:27.073984 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.073892 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08c90320-a52a-4e67-8a20-aa77b44bda7d-tls-cert\") pod \"08c90320-a52a-4e67-8a20-aa77b44bda7d\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " Jul 14 05:11:27.073984 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.073977 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sttdz\" (UniqueName: \"kubernetes.io/projected/08c90320-a52a-4e67-8a20-aa77b44bda7d-kube-api-access-sttdz\") pod \"08c90320-a52a-4e67-8a20-aa77b44bda7d\" (UID: \"08c90320-a52a-4e67-8a20-aa77b44bda7d\") " Jul 14 05:11:27.076101 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.076068 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c90320-a52a-4e67-8a20-aa77b44bda7d-kube-api-access-sttdz" (OuterVolumeSpecName: "kube-api-access-sttdz") pod "08c90320-a52a-4e67-8a20-aa77b44bda7d" (UID: "08c90320-a52a-4e67-8a20-aa77b44bda7d"). InnerVolumeSpecName "kube-api-access-sttdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 05:11:27.084767 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.084722 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08c90320-a52a-4e67-8a20-aa77b44bda7d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "08c90320-a52a-4e67-8a20-aa77b44bda7d" (UID: "08c90320-a52a-4e67-8a20-aa77b44bda7d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 05:11:27.175679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.175642 2560 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08c90320-a52a-4e67-8a20-aa77b44bda7d-tls-cert\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:11:27.175679 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.175677 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sttdz\" (UniqueName: \"kubernetes.io/projected/08c90320-a52a-4e67-8a20-aa77b44bda7d-kube-api-access-sttdz\") on node \"ip-10-0-142-96.ec2.internal\" DevicePath \"\"" Jul 14 05:11:27.574563 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.574518 2560 generic.go:356] "Generic (PLEG): container finished" podID="08c90320-a52a-4e67-8a20-aa77b44bda7d" containerID="a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c" exitCode=0 Jul 14 05:11:27.575050 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.574578 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" Jul 14 05:11:27.575050 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.574598 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" event={"ID":"08c90320-a52a-4e67-8a20-aa77b44bda7d","Type":"ContainerDied","Data":"a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c"} Jul 14 05:11:27.575050 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.574647 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-675b6d8ff5-9vg9x" event={"ID":"08c90320-a52a-4e67-8a20-aa77b44bda7d","Type":"ContainerDied","Data":"ba9ca4c8c2665f29076dc32614cc2f46785638697bed6a4f47a21f0fcd55e70a"} Jul 14 05:11:27.575050 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.574666 2560 scope.go:117] "RemoveContainer" containerID="a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c" Jul 14 05:11:27.583942 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.583920 2560 scope.go:117] "RemoveContainer" containerID="a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c" Jul 14 05:11:27.584259 ip-10-0-142-96 kubenswrapper[2560]: E0714 05:11:27.584239 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c\": container with ID starting with a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c not found: ID does not exist" containerID="a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c" Jul 14 05:11:27.584330 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.584269 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c"} err="failed to get container status \"a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c\": rpc error: code = NotFound desc = could not find container \"a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c\": container with ID starting with a1a71346ebd67f07d92c125078f9669eae7b5d0caa6cd1696cc24baf0ba7a02c not found: ID does not exist" Jul 14 05:11:27.601017 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.600979 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-675b6d8ff5-9vg9x"] Jul 14 05:11:27.608166 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:27.608137 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-675b6d8ff5-9vg9x"] Jul 14 05:11:29.253415 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:11:29.253383 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c90320-a52a-4e67-8a20-aa77b44bda7d" path="/var/lib/kubelet/pods/08c90320-a52a-4e67-8a20-aa77b44bda7d/volumes" Jul 14 05:13:55.532294 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:13:55.532258 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-667b98f486-hdj95_cb6a4d8a-ffe7-4780-b8a0-e66425755ac0/authorino/0.log" Jul 14 05:14:00.571074 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:00.571047 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tphwk_f2c1bcc3-87ea-4493-898e-467fd53ac401/manager/0.log" Jul 14 05:14:01.483011 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:01.482980 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-lxvwt_b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce/manager/0.log" Jul 14 05:14:01.489054 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:01.489028 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-lxvwt_b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce/copy-manifests/0.log" Jul 14 05:14:03.358441 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:03.358387 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-667b98f486-hdj95_cb6a4d8a-ffe7-4780-b8a0-e66425755ac0/authorino/0.log" Jul 14 05:14:03.738522 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:03.738488 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9wd7m_8cde7b2f-8af8-471d-a53b-e3dd21839067/kuadrant-console-plugin/0.log" Jul 14 05:14:04.190108 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:04.190078 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c2jzd_7c7dd460-7de9-4bc8-ac3c-6217048958da/limitador/0.log" Jul 14 05:14:04.942569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:04.942542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-vmtkr_d90f6e47-8a71-4c2f-9572-66efcf8ac315/kube-auth-proxy/0.log" Jul 14 05:14:06.488529 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:06.488493 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-fftfz_e7b27235-993d-4292-b7be-b7ce43ea659a/main/0.log" Jul 14 05:14:10.775378 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.775342 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7m6n/must-gather-k8hpd"] Jul 14 05:14:10.775802 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.775722 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c90320-a52a-4e67-8a20-aa77b44bda7d" containerName="authorino" Jul 14 05:14:10.775802 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.775733 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c90320-a52a-4e67-8a20-aa77b44bda7d" containerName="authorino" Jul 14 05:14:10.775879 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.775805 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c90320-a52a-4e67-8a20-aa77b44bda7d" containerName="authorino" Jul 14 05:14:10.778698 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.778678 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:10.781368 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.781331 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7m6n\"/\"openshift-service-ca.crt\"" Jul 14 05:14:10.781722 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.781704 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7m6n\"/\"kube-root-ca.crt\"" Jul 14 05:14:10.782726 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.782707 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7m6n\"/\"default-dockercfg-l2qr6\"" Jul 14 05:14:10.795916 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.795887 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7m6n/must-gather-k8hpd"] Jul 14 05:14:10.897492 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.897425 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8njtt\" (UniqueName: \"kubernetes.io/projected/d3e16947-0708-41d9-bd6c-e9221be508be-kube-api-access-8njtt\") pod \"must-gather-k8hpd\" (UID: \"d3e16947-0708-41d9-bd6c-e9221be508be\") " pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:10.897666 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.897509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3e16947-0708-41d9-bd6c-e9221be508be-must-gather-output\") pod \"must-gather-k8hpd\" (UID: \"d3e16947-0708-41d9-bd6c-e9221be508be\") " pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:10.998836 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.998798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8njtt\" (UniqueName: \"kubernetes.io/projected/d3e16947-0708-41d9-bd6c-e9221be508be-kube-api-access-8njtt\") pod \"must-gather-k8hpd\" (UID: \"d3e16947-0708-41d9-bd6c-e9221be508be\") " pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:10.998836 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.998838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3e16947-0708-41d9-bd6c-e9221be508be-must-gather-output\") pod \"must-gather-k8hpd\" (UID: \"d3e16947-0708-41d9-bd6c-e9221be508be\") " pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:10.999234 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:10.999215 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3e16947-0708-41d9-bd6c-e9221be508be-must-gather-output\") pod \"must-gather-k8hpd\" (UID: \"d3e16947-0708-41d9-bd6c-e9221be508be\") " pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:11.013601 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:11.013571 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8njtt\" (UniqueName: \"kubernetes.io/projected/d3e16947-0708-41d9-bd6c-e9221be508be-kube-api-access-8njtt\") pod \"must-gather-k8hpd\" (UID: \"d3e16947-0708-41d9-bd6c-e9221be508be\") " pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:11.110643 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:11.110550 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7m6n/must-gather-k8hpd" Jul 14 05:14:11.247168 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:11.247036 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7m6n/must-gather-k8hpd"] Jul 14 05:14:11.249735 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:14:11.249702 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3e16947_0708_41d9_bd6c_e9221be508be.slice/crio-a578f9c8eb6db469cf4fdcdbbdce1626a63e277249199ebb06c235ea09c45b20 WatchSource:0}: Error finding container a578f9c8eb6db469cf4fdcdbbdce1626a63e277249199ebb06c235ea09c45b20: Status 404 returned error can't find the container with id a578f9c8eb6db469cf4fdcdbbdce1626a63e277249199ebb06c235ea09c45b20 Jul 14 05:14:11.344313 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:11.344277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/must-gather-k8hpd" event={"ID":"d3e16947-0708-41d9-bd6c-e9221be508be","Type":"ContainerStarted","Data":"a578f9c8eb6db469cf4fdcdbbdce1626a63e277249199ebb06c235ea09c45b20"} Jul 14 05:14:12.353566 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:12.353434 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/must-gather-k8hpd" event={"ID":"d3e16947-0708-41d9-bd6c-e9221be508be","Type":"ContainerStarted","Data":"f80051513291c883af7ad0126b9e1f93cccf169180bc9b8e0bf38e168495112e"} Jul 14 05:14:12.353566 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:12.353525 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/must-gather-k8hpd" event={"ID":"d3e16947-0708-41d9-bd6c-e9221be508be","Type":"ContainerStarted","Data":"1a68f9e1758cf91e4a22c2827de8c9362d20aa0d5f8006c81ae624fe454fb2d7"} Jul 14 05:14:12.371724 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:12.371661 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7m6n/must-gather-k8hpd" podStartSLOduration=1.631454323 podStartE2EDuration="2.371641634s" totalImagesPullingTime="740.187311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 05:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:14:12.371126631 +0000 UTC m=+887.691892026" watchObservedRunningTime="2026-07-14 05:14:12.371641634 +0000 UTC m=+887.692406996" Jul 14 05:14:13.576504 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:13.576447 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kmvxx_1ea96973-aa43-444d-9bf1-1809b00cf89a/global-pull-secret-syncer/0.log" Jul 14 05:14:13.648375 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:13.648341 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mn6z8_cedfbd0a-7dea-496c-9fcc-7fcb7e52259c/konnectivity-agent/0.log" Jul 14 05:14:13.738912 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:13.738878 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-96.ec2.internal_73dd704072130945e0f1c07d602a42f6/haproxy/0.log" Jul 14 05:14:18.358033 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:18.357993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-667b98f486-hdj95_cb6a4d8a-ffe7-4780-b8a0-e66425755ac0/authorino/0.log" Jul 14 05:14:18.440779 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:18.440748 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9wd7m_8cde7b2f-8af8-471d-a53b-e3dd21839067/kuadrant-console-plugin/0.log" Jul 14 05:14:18.560408 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:18.560379 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-c2jzd_7c7dd460-7de9-4bc8-ac3c-6217048958da/limitador/0.log" Jul 14 05:14:20.312804 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.312720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/alertmanager/0.log" Jul 14 05:14:20.338413 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.338376 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/config-reloader/0.log" Jul 14 05:14:20.361804 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.361777 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/kube-rbac-proxy-web/0.log" Jul 14 05:14:20.391044 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.391003 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/kube-rbac-proxy/0.log" Jul 14 05:14:20.411851 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.411810 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/kube-rbac-proxy-metric/0.log" Jul 14 05:14:20.435291 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.435256 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/prom-label-proxy/0.log" Jul 14 05:14:20.475006 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.474971 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_00a5aad5-e708-4ab3-a1b6-ddacd9a99bef/init-config-reloader/0.log" Jul 14 05:14:20.526637 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.526605 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-vspn6_062c49a8-ece7-412a-bd62-96ec663e4ca7/kube-state-metrics/0.log" Jul 14 05:14:20.551709 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.551672 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-vspn6_062c49a8-ece7-412a-bd62-96ec663e4ca7/kube-rbac-proxy-main/0.log" Jul 14 05:14:20.580655 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.580581 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-vspn6_062c49a8-ece7-412a-bd62-96ec663e4ca7/kube-rbac-proxy-self/0.log" Jul 14 05:14:20.607218 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.607184 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-bbfd457b5-jhx5j_a2df6e72-358e-4c7a-825f-3bf1e5758c3f/metrics-server/0.log" Jul 14 05:14:20.738895 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.738866 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwhsg_0bd1b775-cf5e-4a94-b68b-d7b23ad23c33/node-exporter/0.log" Jul 14 05:14:20.763378 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.763351 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwhsg_0bd1b775-cf5e-4a94-b68b-d7b23ad23c33/kube-rbac-proxy/0.log" Jul 14 05:14:20.792380 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.792355 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fwhsg_0bd1b775-cf5e-4a94-b68b-d7b23ad23c33/init-textfile/0.log" Jul 14 05:14:20.916779 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.916700 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-k5dgs_4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389/kube-rbac-proxy-main/0.log" Jul 14 05:14:20.939048 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.939004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-k5dgs_4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389/kube-rbac-proxy-self/0.log" Jul 14 05:14:20.959482 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.959414 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-k5dgs_4e7b25de-f30f-4e1c-9b5e-9fdd79ffe389/openshift-state-metrics/0.log" Jul 14 05:14:20.994441 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:20.994404 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/prometheus/0.log" Jul 14 05:14:21.016476 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.016430 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/config-reloader/0.log" Jul 14 05:14:21.048410 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.048370 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/thanos-sidecar/0.log" Jul 14 05:14:21.067530 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.067489 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/kube-rbac-proxy-web/0.log" Jul 14 05:14:21.099347 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.099309 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/kube-rbac-proxy/0.log" Jul 14 05:14:21.132709 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.132669 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/kube-rbac-proxy-thanos/0.log" Jul 14 05:14:21.161692 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.161583 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1a61998d-0948-4724-9ef2-550de2c1ee2c/init-config-reloader/0.log" Jul 14 05:14:21.363993 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.363869 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c99dff7d-bm94m_013974e7-1ef9-4d01-84dd-98b18e76ea56/telemeter-client/0.log" Jul 14 05:14:21.390072 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.390011 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c99dff7d-bm94m_013974e7-1ef9-4d01-84dd-98b18e76ea56/reload/0.log" Jul 14 05:14:21.414614 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.414583 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-59c99dff7d-bm94m_013974e7-1ef9-4d01-84dd-98b18e76ea56/kube-rbac-proxy/0.log" Jul 14 05:14:21.447095 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.447066 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7456587457-pfw49_f91dc92d-7c19-4a9e-a2d5-3ea571363ab8/thanos-query/0.log" Jul 14 05:14:21.469502 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.469474 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7456587457-pfw49_f91dc92d-7c19-4a9e-a2d5-3ea571363ab8/kube-rbac-proxy-web/0.log" Jul 14 05:14:21.493520 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.493488 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7456587457-pfw49_f91dc92d-7c19-4a9e-a2d5-3ea571363ab8/kube-rbac-proxy/0.log" Jul 14 05:14:21.518334 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.518306 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7456587457-pfw49_f91dc92d-7c19-4a9e-a2d5-3ea571363ab8/prom-label-proxy/0.log" Jul 14 05:14:21.544550 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.544507 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7456587457-pfw49_f91dc92d-7c19-4a9e-a2d5-3ea571363ab8/kube-rbac-proxy-rules/0.log" Jul 14 05:14:21.568490 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:21.568434 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7456587457-pfw49_f91dc92d-7c19-4a9e-a2d5-3ea571363ab8/kube-rbac-proxy-metrics/0.log" Jul 14 05:14:24.144405 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.144374 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59d79b66c5-wcnkv_221f6d0d-193d-473d-930c-3955194eb5d8/console/0.log" Jul 14 05:14:24.242250 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.242210 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w"] Jul 14 05:14:24.247886 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.247851 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.259711 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.259675 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w"] Jul 14 05:14:24.350217 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.350179 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-lib-modules\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.350400 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.350245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-proc\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.350400 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.350322 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhflh\" (UniqueName: \"kubernetes.io/projected/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-kube-api-access-qhflh\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.350581 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.350550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-sys\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.350759 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.350738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-podres\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451369 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451260 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-sys\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451369 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-podres\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451367 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-sys\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-lib-modules\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451434 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-proc\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhflh\" (UniqueName: \"kubernetes.io/projected/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-kube-api-access-qhflh\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451516 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-podres\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-lib-modules\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.451617 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.451561 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-proc\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.460170 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.460138 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhflh\" (UniqueName: \"kubernetes.io/projected/32b6a67b-8373-4aaf-9cbd-0c6071c88e95-kube-api-access-qhflh\") pod \"perf-node-gather-daemonset-sm88w\" (UID: \"32b6a67b-8373-4aaf-9cbd-0c6071c88e95\") " pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.567830 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.567541 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:24.765986 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:24.765959 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w"] Jul 14 05:14:24.769207 ip-10-0-142-96 kubenswrapper[2560]: W0714 05:14:24.769166 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod32b6a67b_8373_4aaf_9cbd_0c6071c88e95.slice/crio-c63f376382b262ac742ac35b8100777e11b150d4eb5131fa3a96b9710a064bcd WatchSource:0}: Error finding container c63f376382b262ac742ac35b8100777e11b150d4eb5131fa3a96b9710a064bcd: Status 404 returned error can't find the container with id c63f376382b262ac742ac35b8100777e11b150d4eb5131fa3a96b9710a064bcd Jul 14 05:14:25.155172 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.155140 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:14:25.156359 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.156323 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:14:25.464199 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.464100 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" event={"ID":"32b6a67b-8373-4aaf-9cbd-0c6071c88e95","Type":"ContainerStarted","Data":"4e66063bd1fc9749dbec7272746af85a5f908f3041b0ce983decf64b90dee0f5"} Jul 14 05:14:25.464374 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.464220 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" event={"ID":"32b6a67b-8373-4aaf-9cbd-0c6071c88e95","Type":"ContainerStarted","Data":"c63f376382b262ac742ac35b8100777e11b150d4eb5131fa3a96b9710a064bcd"} Jul 14 05:14:25.465103 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.465079 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:25.483258 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.483194 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" podStartSLOduration=1.483170074 podStartE2EDuration="1.483170074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 05:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 05:14:25.481452801 +0000 UTC m=+900.802218165" watchObservedRunningTime="2026-07-14 05:14:25.483170074 +0000 UTC m=+900.803935439" Jul 14 05:14:25.986629 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:25.986586 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmmhp_41bab6bc-bf01-452b-a893-4b16a897001c/dns/0.log" Jul 14 05:14:26.007980 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:26.007944 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bmmhp_41bab6bc-bf01-452b-a893-4b16a897001c/kube-rbac-proxy/0.log" Jul 14 05:14:26.128848 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:26.128826 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lvxpf_b666e712-652e-43d6-b8e3-821a0768d8a0/dns-node-resolver/0.log" Jul 14 05:14:26.790569 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:26.790539 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgpgl_865b5f3c-f4c9-46d6-b8ab-6b719a1bfd8e/node-ca/0.log" Jul 14 05:14:27.732846 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:27.732817 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-vmtkr_d90f6e47-8a71-4c2f-9572-66efcf8ac315/kube-auth-proxy/0.log" Jul 14 05:14:28.431991 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:28.431966 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7np52_6fc7b090-f345-4c8c-af65-7b548ec27799/serve-healthcheck-canary/0.log" Jul 14 05:14:28.910631 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:28.910602 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7vdzd_d4f40e57-96f9-413a-bb30-7dde49268b82/kube-rbac-proxy/0.log" Jul 14 05:14:28.931002 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:28.930970 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7vdzd_d4f40e57-96f9-413a-bb30-7dde49268b82/exporter/0.log" Jul 14 05:14:28.955007 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:28.954976 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7vdzd_d4f40e57-96f9-413a-bb30-7dde49268b82/extractor/0.log" Jul 14 05:14:31.205236 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:31.205207 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-tphwk_f2c1bcc3-87ea-4493-898e-467fd53ac401/manager/0.log" Jul 14 05:14:31.446846 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:31.446820 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-lxvwt_b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce/manager/0.log" Jul 14 05:14:31.469529 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:31.469441 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d474f5bbf-lxvwt_b9fbfc2c-ca51-4b0c-96cb-b847b67c39ce/copy-manifests/0.log" Jul 14 05:14:32.490787 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:32.490760 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7m6n/perf-node-gather-daemonset-sm88w" Jul 14 05:14:32.587647 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:32.587621 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bc55cf4-98tfs_fefe0f91-6bcf-4aa2-98c5-99eb7459d3ab/manager/0.log" Jul 14 05:14:32.613494 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:32.613431 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-s8k5f_62ba4dc1-a409-4487-8093-7953352d576b/openshift-lws-operator/0.log" Jul 14 05:14:34.445411 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:34.445320 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-vmtkr_d90f6e47-8a71-4c2f-9572-66efcf8ac315/kube-auth-proxy/0.log" Jul 14 05:14:35.925509 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:35.925405 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4dd7888d-vmtkr_d90f6e47-8a71-4c2f-9572-66efcf8ac315/kube-auth-proxy/0.log" Jul 14 05:14:39.576830 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.576800 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/kube-multus-additional-cni-plugins/0.log" Jul 14 05:14:39.613477 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.613436 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/egress-router-binary-copy/0.log" Jul 14 05:14:39.647331 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.647303 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/cni-plugins/0.log" Jul 14 05:14:39.667525 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.667492 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/bond-cni-plugin/0.log" Jul 14 05:14:39.688721 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.688680 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/routeoverride-cni/0.log" Jul 14 05:14:39.708767 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.708741 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/whereabouts-cni-bincopy/0.log" Jul 14 05:14:39.728946 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.728899 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzfhr_3c88a251-0244-450f-84d3-6f6c661b1bb2/whereabouts-cni/0.log" Jul 14 05:14:39.758571 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.758539 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f9dv2_8bb04b68-aa46-482b-bb3b-106ae6ff69c3/kube-multus/0.log" Jul 14 05:14:39.868228 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.868135 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q8tq9_c4e4f4e9-23c4-4351-9058-5593fae027ec/network-metrics-daemon/0.log" Jul 14 05:14:39.885910 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:39.885870 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q8tq9_c4e4f4e9-23c4-4351-9058-5593fae027ec/kube-rbac-proxy/0.log" Jul 14 05:14:41.224688 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.224658 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-controller/0.log" Jul 14 05:14:41.251209 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.251179 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/0.log" Jul 14 05:14:41.251378 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.251347 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovn-acl-logging/1.log" Jul 14 05:14:41.271435 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.271394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/kube-rbac-proxy-node/0.log" Jul 14 05:14:41.306118 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.306082 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/kube-rbac-proxy-ovn-metrics/0.log" Jul 14 05:14:41.337718 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.337686 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/northd/0.log" Jul 14 05:14:41.370074 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.370043 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/nbdb/0.log" Jul 14 05:14:41.402588 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.402556 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/sbdb/0.log" Jul 14 05:14:41.453473 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:41.453441 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gczhh_108c5802-60a1-4d8d-aeb0-be2e47e67a3a/ovnkube-controller/0.log" Jul 14 05:14:42.772744 ip-10-0-142-96 kubenswrapper[2560]: I0714 05:14:42.772713 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-z9zls_b2d58eda-602f-4b76-9cf1-6a459b1e26ae/network-check-target-container/0.log"